EDIT: I meant GTX 5070 TI, not the 970.
I need to replace the GPU on my main workstation for other reasons, but I also want to dip my toes into experimenting with local LLMs. I'd be running this on my Linux workstation.
I've kind of narrowed things down to the Radeon RX 9070 XT with 16 GB, vs the Nvidia GTX 5070 TI with 12 GB. These both have a similar price point. From my reading it seems the Nvidia has a slight edge in horsepower, but I'm thinking that 16GB vs 12GB is a much larger factor.
I also have an AI Max 395+ with 128 GB (also running Linux) but haven't tried running LLMS on it yet. If I have this is it worth investing in an LLM capable GPU on my main workstation?
Until now I use these systems for gaming and development work, both personal and professional. The LLM would be mostly used for personal coding and I'm also interested in doing some image processing. I don't know if that matters. If the local LLM turns out to be useful and interesting enough, then I can invest more money in serious hardware.
Mostly looking for a reality check deciding between these two GPUs, and possibly whether I'm wasting my time even attempting this with midrange hardware.