u/AgentEisehorn

I happen to purchase a PC a couple of years ago which has the following:

-dual 3090
-256 GB DDR4 RAM
-AMD Threadripper 3970
-ROG Zenith 2 Extreme motherboard

having mostly superficial knowledge in tech, it was a good purchase.

I came across the possibilities to run local LLM on my PC, and I would like to ask where I should start looking into it? What could I run on my setup? What would be the best LLM to run?

I mostly use my PC for CAD/CAM, video editing, biological modeling.