u/Prestigious_Work_632

How to manage LLM API costs?

This has been wrecking my head lately so curious what others are doing.

We're building with LLMs and the bills are all over the place. One decent week of usage and it's 3x what I expected. The worst part is I can't give customers a straight answer on pricing because I don't have one myself.

Is anyone actually solving this properly or is everyone just dealing with it the same way?

reddit.com
u/Prestigious_Work_632 — 19 hours ago

How to handle costs?

Hey everyone, my projects were tipping along with a small user base, but there has been a bit of an uptick in signups, which is great! But how might I manage costs?

I am slightly worried that costs might explode and erase my runway, any help appreciated!

reddit.com
u/Prestigious_Work_632 — 21 hours ago