u/-UndeadBulwark

I noticed these parts are going for 50 to 150 on the used mark wanted to ask how is the performance on them?

Just started trying out 3B, 7B, and 13B local LLMs and it runs great, anywhere from 50 to 200 t/s. The quality varies wildly but they can sometimes surpass the cloud models I use. I might honestly sell my current GPU and upgrade to a Radeon Pro 9700 for the 32GB. I think I could be happy with 27B at Q4, but can it game or should I just get a Strix Halo or sit on what I have and get Medusa Halo when it is out?