u/High-Speed-Diesel

We are building a visualization tool for agentic loads that group the llm and tool calls (inferred from http requests and responses). This is accomplished without any instrumentation of the agentic code. Agentic code can be in any language.

The agentic task needs to be started with a rust correlator that uses http headers to group together llm calls. We have an API server and a reverse proxy that forwards llm calls to providers.

The front end gives the usual statistics like input/output tokens, cost, model latency, latency of proxy (minimal in microseconds as servers implemented in rust).

We would appreciate comments from people who are in AI ops who use tools like litellm and Helicone and can provide some input on complicated use cases.

Next step is to normalise the JSON body from one provider to another to make agentic code provider agnostic.

We are looking for collaborators too as we are making this open source.

I am building an API gateway for agents that can make your agentic AI code model and provider agnostic. I am also grouping agent runs that show multiple llm calls and tool calls in the visualization piece. It gives details on tokens, cost and model latency. I am doing this without requiring any instrumentation in the agentic code.

The agents (python for now) are started by a rust correlator that assigns a job_id to each agent so we could track api and tool (inferred from http requests and responses) calls across the entire agentic run. The servers are also in rust.

I also have an implementation where instead of the rust correlator i have python and other platform shims that do the same job and the servers are in go.

I would appreciate comments from people who are in AI ops who use tools like litellm and Helicone and can provide feedback or complicated use cases.

I plan to make everything open source so looking for collaborators too.

I am building an API gateway for agents that can make your agentic AI code model and provider agnostic. I am also grouping agent runs that show multiple llm calls and tool calls in the visualization piece. It gives details on tokens, cost and model latency. I am doing this without requiring any instrumentation in the agentic code.

The agents (python for now) are started by a rust correlator that assigns a job_id to each agent so we could track api and tool (inferred from http requests and responses) calls across the entire agentic run. The servers are also in rust.

I also have an implementation where instead of the rust correlator i have python and other platform shims that do the same job and the servers are in go.

I would appreciate comments from people who are in AI ops who use tools like litellm and Helicone and can provide feedback or complicated use cases.

I plan to make everything open source so looking for collaborators too.

I would like to connect with some experienced folks and brainstorm some ideas on multi cloud environment for enterprises that involves some security too. Please comment and DM freely.

software to nail salon owners in California on commission basis. Please DM me.

I am starting a business where I want to have a bunch of AI agents (about 30) running all aspects of a small business. Just like Salesforce but on a smaller scale. Please let me know what you think.

I am thinking of setting up a Co-operative for gig workers. Their monthly dues can get them shares in the co-operative. The money that we collect can be used for marketing purposes. This will help cut down the current egregious digital middlemen for them. We can have an open source repository that the contributors can contribute to and build the apps required. The contributors can also be awarded shares in the co-operative. Do you think opening such a co-operative is possible? I am based in CA. THe co-operative can be based in any state.

Hi Folks,

I think we can have an open source community that contributes source code for the platform and the contributors can band together to form a non profit to host the source code so that the gig workers bypass the egregious digital middlemen in each vertical.

What do you guys think?

Hi Folks,

I am doing some research on creating an alternate digital platform for different gig workers. I think we can have an open source community that contributes source code for the platform and the contributors can band together to form a non profit to host the source code so that the gig workers bypass the egregious digital middlemen in each vertical.

Should I build an app to assess the interest of the gig workers or do you think they will always say yes to such an idea.