A recent analysis of 35,633 MCP servers revealed that while the median server is relatively inexpensive in terms of token cost, a significant long tail of servers consumes a disproportionately large amount of context window space. The median server costs 2,518 tokens, but the average is over three times that due to a few extremely large configurations. Approximately 45 servers have tool definitions alone that exceed a 200,000 token context window, with the largest consuming 1.6 million tokens. The primary driver for this high token cost is the sheer number of tools a server defines, rather than the complexity of individual tool schemas. AI
IMPACT Highlights potential inefficiencies in how large language model tools are defined and managed, impacting context window usage and cost.
RANK_REASON Analysis of token costs for a large number of servers, presenting new data and findings. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →