u/7h3_50urc3

Hey,

I'm finetuning a LoRA with Gemma-4-E4B.

Everything is finde until I try to load the lora on top of the base with vllm. There are not expected vision- and audio-layers in it.

Any chance to save only text-layers in the final LoRA?