Engineering For AI/ML Systems
Hey folks,
I'm an experienced engineer - got years of experience in the industry and well versed with cloud technologies and distributed systems. However, my understanding of the whole AI/ML field is little to none, the most I have done is use GenAI/LLMs in order to supplement my work. I do not know what I do not know, and do not know where to even start. In fact, I even struggle to find the words to describe the problem below
With the industry shifting so fast, I have started seeing a lot of skills within jobs being around the ability to build backends for AI systems. Whether it is building data pipelines to feed into vector databases, scaling vector databases, embeddings (or whatever the heck that is), RAGs, MCPs, Agents, Agentic AI, etc
Does anyone have any suggestion on how experienced engineers can learn/prepare for the engineering part of AI systems ? For example, I would suspect system design interviews will start shifting to scaling vector databases (instead of just SQL/NoSQL), how to build scalable RAGs/MCPs/fine tuning, etc
Furthermore, are these considered 'ML System Design Interviews' ? Since I have started seeing that word being thrown around a lot. I do not intend to become a scientist that makes models, or understand the maths that make LLMs work. I want to learn the ENGINEERING side of it that can take existing models and deploy them as SCALABLE systems, along with scaling all its related surrounding infrastructure.
One of the ways I started learning System Design was by going through examples & problems in the book 'System Design Interview'. Is there any book or course that would cover the use case I have above ? I know they have new books such as 'The GenAI System Design Interview' and 'The ML System Design Interview', but I am not sure if thats for scientest/ML engineers or for regular engineers who are deploying these systems.
Please suggest !