How to manage LLM API costs?
This has been wrecking my head lately so curious what others are doing.
We're building with LLMs and the bills are all over the place. One decent week of usage and it's 3x what I expected. The worst part is I can't give customers a straight answer on pricing because I don't have one myself.
Is anyone actually solving this properly or is everyone just dealing with it the same way?