Anyone here using LLMs to debug dashboards? Stuck on scaling this
Lately I’ve been experimenting with a small LLM setup to help me debug Tableau dashboards and handle change requests.
What I’m doing is:
Taking the XML from the dashboard
Preprocessing it
Feeding it to an LLM
Then when a bug ticket or change request comes in, I just describe it—and it actually does a pretty good job pointing me to where the issue is and what needs to change. That part is working better than I expected.
But I built this as a POC with just 2–3 dashboards.
Right now I’m just storing the processed data as JSON ,and I know this is not going to scale at all.
If I want to take this further (say dozens of dashboards), what’s the right way to store and retrieve this data?
Should I be looking at vector DBs, Postgres, or some mix of both?
Would love to hear how others are approaching this, especially for LLM + debugging / analysis use cases.