Aperture is exactly the kind of thing I hoped Tailscale would build
Aperture AI Gateway is one of those apps where I started out thinking OK... this could be useful. And then.. oh... that's clever. And then ... alrite, good thinking! followed by.. OMG, that's friggin brilliant.. This thing solves so many problems in one sweep. Gradually switching everything to Aperture, starting with our internal tools. My favourite features from first week of use..
- No API key needed in API calls to AI models. We're on the tailnet, no need to authenticate, send "abc123" as API key in the call. The Gateway has the real API key. Compromised/Expired/New account? Switch key in Aperture.
- Metrics by model, and token use per request in dashboard
- OpenAI compatible. Swap out the https://api.openai.com/v1/ for the Aperture URL, http://my\_aperture\_host.ts.net/v1
- Tool use tracking! Since all model API calls are routed through Aperture, it can track Tool use in admin
- Mix open model Inference with Claude/chatGPT/Grok etc - one gateway for all of them. Add a model in Aperture and it is available to the team.
- ACL integration, access to a model can be restricted/allowed for specific user, host, or app
There's also filtering and security alerts, haven't gotten around to that one yet, Oso, Cerbos, Highflame.
In preview now, wondering what the cost will be when this thing goes into general release