A cost audit of Model Context Protocol (MCP) servers reveals significant token usage for tool definitions, impacting LLM context window costs. Servers like Freee, which expose many tools (270 in this case), incur substantial token expenses simply for establishing a connection, unlike traditional REST APIs. This overhead, priced at $3 per 1 million input tokens, can amount to over $6 annually for a single user with moderate usage, and scales with team size, even before any actual tool invocations occur. AI
IMPACT Highlights potential cost inefficiencies in LLM integrations due to tool definition overhead, impacting developers and businesses.
RANK_REASON Analysis of token costs associated with LLM tool definitions, not a direct release or product launch.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →