Stack For AI Avatar
Hello everyone.
I've been trying to generate an AI avatar to be used in YouTube videos. However, I couldn't get consistent images.
What I've done so far:
- I used Flux Dev on Runpod. Generated an image. Found my character and fixed the seed.
- Everytime the scene and the light changed, even with the same seed, face changed a little bit.
- I got help with my prompts from ChatGPT and Gemini. Results didn't change.
- One way or another, I gathered similar face, different angles and different shots. 50 images in total. Similar to my original image.
- Trained a Lora by captioning images with Joycaption & ai-toolkit. Some sample images were acceptable, others are not.
- Used the Lora over Flux Dev with fixed and random seeds. No luck. My avatar works well in dark light but when it comes to daylight and different poses, facial expressions etc, I completely lose the original face.
- Tried everything above with a few realism checkpoints for Flux. Same result.
- I've added Flux Dev, PulID. With or without the Lora, I either kept losing the face or getting anatomically wrong results.
What I want to achieve is:
- Keep the same character, including face, in different scenes and shots
- If I could get consistent images, then I'll move forward with the video generation. I need that base images for different videos like sports events, concerts, public transportation etc.
What am I missing? What would be your suggested stack?