u/Different-Phrase6018

Hello Everyone, I am working on a project and using GROQ to translate my content and then retrieve information and put them into JSON for which I have provided the keys.

Here is my rough workflow.

txt data (in different language -> GROQ(Translate to english) -> GROQ(Give me JSON)

The reason i need two calls is that if i use small model like llama-3.1-8b-instant it works fine for 1 task at a time.

The problem is I want to use free tier and I know its limited capacity so as the capacity hits i want to switch model but if i switch model the output is going to change slightly any suggestions for this or any new thing that I can try to work this.

Happy to listen all inputs.

Hello Everyone, I am working on a project and using GROQ to translate my content and then retrieve information and put them into JSON for which I have provided the keys.

Here is my rough workflow.

txt data (in different language -> GROQ(Translate to english) -> GROQ(Give me JSON)

The reason i need two calls is that if i use small model like llama-3.1-8b-instant it works fine for 1 task at a time.

The problem is I want to use free tier and I know its limited capacity so as the capacity hits i want to switch model but if i switch model the output is going to change slightly any suggestions for this or any new thing that I can try to work this.

Happy to listen all inputs.