Orla is an open source framework written in Go that makes your agentic workflows 3 times faster and half as costly
Most agent frameworks today treat inference time, cost management, and state coordination as implementation details buried in application logic. This is why we built Orla, an open-source framework for developing multi-agent systems that separates these concerns from the application layer. Orla lets you define your workflow as a sequence of "stages" with cost and quality constraints, and then it manages backend selection, scheduling, and inference state across them.
Orla is the first framework to deliberately decouple workload policy from workload execution, allowing you to implement and test your own scheduling and cost policies for agents without having to modify the underlying infrastructure. Currently, achieving this requires changes and redeployments across multiple layers of the agent application and inference stack.
Orla supports any OpenAI-compatible inference backend, with first-class support for AWS Bedrock, vLLM, SGLang, and Ollama. Orla also integrates natively with LangGraph, allowing you to plug it into existing agents. Our initial results show a 41% cost reduction on a GSM-8K LangGraph workflow on AWS Bedrock with minimal accuracy loss. We also observe a 3.45x end-to-end latency reduction on MATH with chain-of-thought on vLLM with no accuracy loss.
Orla currently has 210+ stars on GitHub and numerous active users across industry and academia. We encourage you to try it out for optimizing your existing multi-agent systems, building new ones, and doing research on agent optimization.
Please star our github repository to support our work, we really appreciate it! Would greatly appreciate your feedback, thoughts, feature requests, and contributions!
Thank you!