▲ 12 r/LLMDevs
I heard about SambaNova's SN50 because they've been in the news with Intel recently so I looked into their RDU arch and it seems like it sidesteps a lot of the memory bandwidth issues that make inference painful on GPUs. I'm hesitant to get excited until I hear from someone who has pushed real traffic through it though. Like there are tons of these new startups that are claiming to be better than nvidia but I'm skeptical. Probably all bs, right? Does anyone here have hands-on time with SN50?
u/Impossible-Skirt-803 — 15 days ago