I got tired of tracking best/new models for OpenRouter, so I automated it
Hi everyone!
I recently started using Hermes and OpenRouter, but one pain point has been limiting the selection of models when using openrouter/auto to get the best balance of quality and price per token. I automated the process in two steps: On one side, there is a cron job that does sentiment analysis on models, then reranks them based on model popularity and price. On the other side, there is a skill (/automodel) that configures the selection of models in the Hermes config. As a starting point, it builds three lists (free, balanced, best), and it can pull the data from either a local folder (your own cron job output or custom source) or a URL (I have a cron job updating the demo site). I hope you find it useful, and feel free to use it as a starting point for your own model selection workflows!
You can find the source and demo site at https://github.com/crisberrios/openrouter-hermes-automodel
----Update 1----
Based on initial feedback, updated the ranking algorithms and demo UI.