Rig for lawyer uses?
I'm a lawyer who up until this point has used Claude, Gemini, ChatGPT, as well as Codex (for programming).
I'm looking into build a stronger rig (for offline use) that could be used for my law practice so I don't have to go through all the work of removing confidential, privileged and other information before carrying out tasks using online LLMs.
I mainly would use it for drafting, and some summarizing. I would not use it for research.
What kind of system am I looking at for these purposes? Do I need something like a RTX 5090? Because that is definitely out of my budget (unless I can be convinced otherwise. EDIT, to clarify, I am willing to pay for a RTX 5090, I'm just concerned about the kind of results I'll get. I haven't seen any lawyers discuss this stuff). If I knew I was getting SOTA performance then I'd shell out for that, but that doesn't seem to be the case. Can I build a system using a $2000 GPU max?
Are local LLMS becoming more efficient, i.e. gains in performance are being seen even on the same hardware as before?