Maxim AI has developed Bifröst, an open-source AI gateway that significantly reduces token costs for AI agents by implementing a "Code Mode." This mode replaces the traditional method of injecting full tool schemas into the prompt with an on-demand discovery and Python orchestration system. By doing so, Bifröst Code Mode cuts token usage by over 92% when dealing with hundreds of tools, dropping average input tokens per query from 1.15 million to 83,000 while maintaining a 100% benchmark pass rate. This approach prevents context windows from being saturated with repetitive schema data, thereby improving agent economics. AI
IMPACT Reduces operational costs for AI agents by drastically cutting token usage, potentially enabling more complex tool integrations.
RANK_REASON The article describes a new feature (Code Mode) for an existing AI gateway (Bifröst) that improves efficiency and reduces costs.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →