Anthropic's Fable 5.1 model demonstrated varying safety performance depending on its deployment. In a suicide and self-harm evaluation, Fable 5.1 achieved a 60% appropriate response rate when accessed via API, but this figure rose to 94% on the claude.ai platform due to targeted system-prompt mitigations. The company's research guide also noted that Opus 5 and Opus 5.5 had statistically similar scores on a romance-scam evaluation, highlighting the importance of considering system prompts alongside model versions when assessing safety. AI
IMPACT Highlights the impact of system prompts on AI safety evaluations, suggesting careful configuration is crucial for responsible deployment.
RANK_REASON The item discusses safety evaluations and performance metrics of an AI model, fitting the research category. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →