I've been working on something cool that I wanted to share with you all. It's called Viewpoint, an analytics tool for LLMs like OpenAI, Anthropic models, and Gemini.

The idea came from the constant flood of new LLM models and the need to figure out which ones work best for my projects without breaking the bank. With viewpoint, I can track token usage, costs, latency(WIP), and traffic over time, making it easier to compare different models and see which ones perform best and save money.

The tool works asynchronously, so it doesn't add any latency to your LLM requests, and you have full control over the data you share. Plus, I'm working on adding an alert feature to notify me when I hit a certain cost limit.

I’d love to know what you think! Could this be useful for your projects?

Check it out: https://viewpointhq.com

Demo: https://www.loom.com/share/ee5745ca01fc488aa194e54cc9efcac5?...

Thanks!