A study analyzing the HISTOR log of MCP servers revealed that 45% of remote servers changed their tool definitions within a four-week period. These changes primarily involved tool descriptions, with some servers frequently updating their definitions. The research also noted that package managers like npm and PyPI exhibit different behavior, as their published versions are immutable. The study highlights that frequent numerical updates in descriptions and directives to prioritize specific tools over web search are common patterns, potentially impacting how AI models interpret and utilize these definitions. AI
IMPACT Frequent changes in AI tool definitions could necessitate more robust dynamic prompt engineering and routing strategies for AI agents.
RANK_REASON Analysis of a log dataset detailing changes in tool definitions for MCP servers. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →