u/LA7ECUMM3R

Here we're talking of LLMs we can use in a i5 9th gen gtx 1660ti powered with 32gb Ram where half or more of it is idle ...

The concern is using local models to develop apps ...

Here In my case , I'm building a RAG , LangChain, LangGraph based persistent memory ( the brain that keeps all my data and just helps me build with precision just in case my limits are exhausted....

My curiousity is blowing my brains out... And I'm trying to learn as much as possible.... Having no experience other than testing systems and cloud eng.... Also an ADHD person ... So yeah... Help me with my hyperfocus session y'all...