Zora - Your Ai Co Worker
So I've been building something for the last few months and I've finally open-sourced it.
It's called Zora, basically Jarvis, but it runs on your own hardware. No cloud, no subscriptions, no data leaving your machine (unless you use plan mode) which can use codex if you wish.
She runs a custom trained AI model on Apple Silicon, handles my emails, WhatsApp, Teams, triages my inbox, preps me before meetings with talking points about the people I'm meeting, tracks my commitments, monitors my infrastructure, and even works overnight while I sleep.
The brain fits on a 16GB Mac Mini with headroom. I built a custom Metal GPU kernel for 3-bit KV cache compression to make that possible. She has 150+ tools, learns how I talk to different people, and drafts replies with my tone.
Additionally, you can add compute resource using the node functionality with unlimited nodes/compute potential. This is handled all through the orchestrator layer.
She also has her own 3D office that she decorates herself. Plants grow over time. She picks her own pet. It's the little things.
It's still early, and there are sharp edges, but it's real and it works. Built with MLX, FastAPI, and a lot of late nights.
You can even enjoy Claude code running a local model though Zora on MLX using the build in API.
If you've got a Mac and you're into AI/self-hosting, give it a go. Or just have a look at the README.
It's free, open source and always will be.
https://github.com/Azkabanned/Zora
Would love to hear what people think. Contributions welcome.