u/Beneficial-Border-26

Currently using Bazzite but I’ve had issues with MoE models either being absurdly slow (qwen3.5 30b) or not loading at all (qwen3 omni) so far I’ve tried both ollama and lm studio. Should I try localai? Set up vLLM? TensorRT? I just need a foundation to build upon haha

Thanks!