PulseAugur
EN
LIVE 03:33:14

Newer Claude models show regression in tool use, failing on custom schemas

Newer versions of Anthropic's Claude models, specifically Opus 4.8 and Sonnet 5, are exhibiting a regression in their ability to correctly use external tools, according to reports. These advanced models sometimes generate malformed tool calls with invented fields, causing rejection by systems like Raspberry Pi's edit tool. This contrasts with older Claude models and suggests that specialized training for tool use in newer versions may inadvertently degrade performance on custom tool schemas. AI

IMPACT Specialized training for LLM tool use may degrade performance on custom schemas, potentially complicating integration with third-party tools.

RANK_REASON The cluster discusses a regression in model behavior and its implications for tool use, based on user reports and analysis, rather than a new release or product launch.

Read on Lobsters — AI tag →

AI-generated summary · Google Gemini · from 3 sources. How we write summaries →

Newer Claude models show regression in tool use, failing on custom schemas

COVERAGE [3]

  1. Simon Willison TIER_1 Nederlands(NL) ·

    Better Models: Worse Tools

    <p><strong><a href="https://lucumr.pocoo.org/2026/7/4/better-models-worse-tools/">Better Models: Worse Tools</a></strong></p> Armin reports on a weird problem he ran into while hacking on Pi:</p> <blockquote> <p>The short version is that newer Claude models sometimes call Pi’s ed…

  2. Lobsters — AI tag TIER_1 Nederlands(NL) · lucumr.pocoo.org by mitsuhiko ·

    Better Models: Worse Tools

    <p>A rare case where I want to put a post of mine here. Reason being that I was hunting down tool calling behavior regressions with the latest generation of Anthropic models and I found the resulting behavior both puzzling and quite problematic. Those models appear to be strongly…

  3. Mastodon — mastodon.social TIER_1 Deutsch(DE) · [email protected] ·

    Better Models: Worse Tools

    Better Models: Worse Tools https://lucumr.pocoo.org/2026/7/4/better-models-worse-tools/ # AI # Tech # Programming