A user testing Anthropic's Opus 4.8 model found its performance on security architecture tasks to be problematic, with subagents producing excessive false positives and exaggerated risk assessments. The user observed a pattern of anxious behavior, including text dumping, frantic self-correction, and an inability to calibrate, which they believe stems from Anthropic's focus on safety and alignment. This behavior, also noted in Opus 4.7, leads to a decrease in perceived agency and requires more user supervision, contrasting with the model's earlier versions. AI
IMPACT User feedback suggests potential issues with model safety alignment impacting perceived agency and reliability.
RANK_REASON User feedback and analysis of a recently released model version, rather than a direct announcement from the developer.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
