u/CooperOxide

I am currently trying to create a multilingual end-to-end home assistant on Jetson Orin Nano 8GB, and have had good success with Whisper.cpp running the medium model at around 1.2GB of VRAM with piper-tts for audio generation.

I have had moderate success with the gemma3-4b-it-q4-km.gguf model and was wondering what other models excel at multilingual capabilities for my hardware.

Has anyone else had any similar setups?