So I am building an AI agent on my own device using n8n. I've used multiple AIs to help me build it and I have a Postgres short term memory working great and so I've been working on a long term memory using NocoDB (all data is being inputted accurately into the table) and I've built a tool to go in and find information from it, which the AI agent does do and it *can* retrieve information from it.
However, there are some serious problems when trying to access it. I've used both qwen3:30b-a3b-q4_k_m and minstral-small and have run into similar issues. This is a completely new build so I'm open to suggestions. Here are the issues:
The llm is having a hard time "accepting" it as a long term memory and would prefer to hallucinate answers rather than use the tool. What are the best instructions to put in the "Description" of the AI Agent to help the llm. Anything AI support has given me hasn't felt very helpful with this.
The much bigger issue I'm having is when the llm does use the "recall tool" to retrieve information from the NocoDB table it comes back with information I either wasn't asking for or it can't find it or it's just bad quality. The AI supports all point to the "Filter by Formula" field and this is where things get totally nutty. I will provide screenshot after screenshot to multiple AIs and they'll all give me different scripts to put in there and almost none of them work and the few they actually provide that do work the llm will often search it and say they can't find the information or come back with low quality answers. When I provide these screenshots to the AI support they make it seem like it's the llm which is why I tried both qwen and minstral with similar issues. Of course I've also tried "let the model define the parameter" but that seems like the worst responses yet.
Any advice or pointing me in the right direction on this I would be super appreciative. The AI supports have spun me in circles for hours on this and I just feel like after everything else it helped me set up this really shouldn't be the thing holding me back.