
My C=64 can run AI locally now! No REU, no SuperCPU..
Hey y'all, I already posted this over on r/LocalLLaMA, but now the full sources and training data are up, so I figured you lot might want to have a quick look, too.
So this is a real AI chatbot running on my original C=64 from 1983. No REU, no cartridge, no fastloader. ~60+ seconds per reply. It is proudly slow and talks mostly friendly gibberish... BUT it is the same architecture as ChatGPT et al.. attention, feed-forward, etc.. all of it in just 25k parameters speaking to you through mind-shifting 6510 Integer math! :D
project page: https://indiepixel.de/meful/index.html,
github: https://github.com/gizmo64k/soulplayer-c64.
orig. thread is over here: https://www.reddit.com/r/LocalLLaMA/comments/1sfzz9n/i_put_a_transformer_model_on_a_stock_commodore_64/
And you can train your own soul, too. On a PC.. with a GPU.. uhm.. yeah, I know... ;)