Over the past few months, while upskilling in AI/ML at International Institute of Information Technology Bangalore upGrad, one thing has become very clear to me:
Bringing AI into real-world operations is not just a technology problem — it’s a risk, design, and decision-making problem.
Most discussions around GenAI focus on what it can do.
What’s equally important is understanding what it should not do without guardrails.
Coming from a risk and operations background, I’ve started looking at AI systems a bit differently:
• Where can the model hallucinate, and what’s the business impact when it does?
• What decisions should remain human-in-the-loop vs fully automated?
• How do we define acceptable error vs costly error?
• What kind of monitoring needs to exist post-deployment?
• How do we ensure consistency when models evolve over time?
In one of the use cases I’ve worked on, even a small improvement in decision accuracy had a large-scale impact — but only after we clearly defined boundaries for the model and built checks around it.
The biggest shift for me has been this:
AI is not just about building smarter systems, it’s about building safer and more accountable systems.
As I continue learning, I’m increasingly interested in problems at the intersection of:
AI × Risk × Operations × Decision Systems
Would love to hear how others are thinking about guardrails and limitations when deploying AI in real-world environments.
myquals