u/BonusObjective8477

AI Inference Costs are way too high for my business!

Title. I'm an AI startup founder managing a team of four including myself and my co-founder. Recently I've noticed my AI token bill skyrocketing, $12K last month alone and projected to increase. I'm curious if anyone else has the same problem as me. I was also thinking of putting together something like a group purchasing organization for AI inference spend - maybe joining together 20-30 startups and negotiating enterprise rates with LLM providers. Would appreciate some feedback on this idea (as it seriously intrigues me) as well as any other strategies employed in order to lower costs.

reddit.com
u/BonusObjective8477 — 1 day ago