Made an awesome-list for everything LLM cost, would love contributions
A GitHub repository has been created to compile resources for managing and reducing the costs associated with Large Language Models (LLMs). The list, titled 'awesome-llm-cost', includes tools for cost calculation, token counting, observability, caching, model routing, prompt compression, and self-hosting. The creator, who experienced a significant unexpected bill from Anthropic, aims to consolidate useful tools and techniques to help others avoid similar cost overruns. AI
IMPACT Provides a centralized resource for developers to find tools and techniques for optimizing LLM inference costs.