r/OpenAI

OpenAI recently announced it is guaranteeing compute capacity for companies that sign 1-3 year deals.

https://openai.com/business/guaranteed-capacity/

What struck me as interesting is they’re willing to give companies discounts in exchange for term. In a normal industry that isn’t unusual; however, the model companies often talk about compute demand as if it’s effectively limitless and stating the obvious… companies don’t typically give discounts if they’re supply constrained.

So… my question is do you think OpenAI has overbuilt capacity (originally geared at consumer) and is now trying to backfill with enterprise? Do you think this is a play at stealing customers from Anthropic because the Anthropic is/was compute constrained? Both? Neither? Good or Bad strategy from OpenAI?

I am building an API gateway for agents that can make your agentic AI code model and provider agnostic. I am also grouping agent runs that show multiple llm calls and tool calls in the visualization piece. It gives details on tokens, cost and model latency. I am doing this without requiring any instrumentation in the agentic code.

The agents (python for now) are started by a rust correlator that assigns a job_id to each agent so we could track api and tool (inferred from http requests and responses) calls across the entire agentic run. The servers are also in rust.

I also have an implementation where instead of the rust correlator i have python and other platform shims that do the same job and the servers are in go.

I would appreciate comments from people who are in AI ops who use tools like litellm and Helicone and can provide feedback or complicated use cases.

I plan to make everything open source so looking for collaborators too.