Say I want to create a style transfer LoRA, does it have to include before and after photos in the training or is it possible to train a style tranfer LoRA using only pairs of an image and its caption in the dataset?
Basically input the initial frame, then have the last frame as guidance rather than the absolute thing it should follow, I tried setting the last frame strength as 0.5 in LTXVaddguidemulti node, and it’s kinda close to what I want but it will still try prioritize the frame above the prompt.
For example, if put a closeup of my character in the last frame changing their facial expression, and ask it to not zoom in for the closeup and just change the facial expression while keeping the frame static it will always zoom in to get a closeup of the character before changing their facial expressions.
I know I can do the example I attached using photoshop, I am just using it to show how even simple tasks will still result in the artstyle changing. I have tried many models and all of them have the same problems, the one in the example is qwen edit 2511.
It seems like its almost impossible to keep the artstyle and it defaults to making all characters have that AI-ish anime look.
-using the default comfyui template workflow
-tried both the speed lora on and off
-the reference image was generated using anima
Is there any workaround?