A study of 74,666 tools revealed that schema nesting depth does not correlate with poorer documentation, contrary to initial expectations. Instead, deeper schemas, particularly those generated from typed sources like OpenAPI or Protocol Buffers, tend to be better documented. Flat schemas, especially those with a single parameter, are the worst-described, suggesting that schema complexity is not the primary issue but rather the care taken in documenting nested fields. AI
IMPACT Suggests that schema design and documentation practices should focus on clarity and completeness, especially for nested structures, to improve model performance.
RANK_REASON Analysis of a dataset of tool schemas. [lever_c_demoted from research: ic=1 ai=0.7]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →