▲ 2
How much storage do you need to hoard models locally?
Hi All, I'm wondering how many TBs of storage you would fill with locally saved LLMs if you thought they would become unavailable online for download. I'm thinking about both large and small models, like a snapshot of the best of everything there is available online right now. Could be for coding, for writing, or for automation/robotics. Assuming that you also have the hardware to run models of any size, what's in your bugout load out if the grid goes down?
u/somebodys-something — 2 days ago