Artificial Analysis has updated its Intelligence Index v5, significantly altering the AI model rankings. The new index heavily relies on private, unseen test sets (60%) and equally weights Knowledge Work, Coding, Science, and General capabilities. Gemini 4 Carbon now leads with 59 points, surpassing Claude Opus 5.5 and GPT-6 Astra, largely due to strong performance in HLE-Diamond, Terminal-Bench-Science, and AutomationBench. However, Gemini 4 Carbon shows increased hallucination rates and lags behind Claude Opus 5.5 in document tasks and FrontierCode 2.0 for coding. AI
IMPACT Changes in benchmarking methodology could influence future model development and selection criteria for AI applications.
RANK_REASON The article details changes to a prominent AI model benchmarking system and the resulting shifts in model rankings. [lever_c_demoted from research: ic=1 ai=1.0]
- AA-LCR
- AA-Omniscience v1.1
- Anthropic
- Artificial Analysis
- AutomationBench
- Claude Opus 5.5
- cognition
- CritPt
- FrontierCode 2.0
- GDPval-AA v2.1
- Gemini 4 Argon
- GPT-6.1 Sol
- GPT-6 Astra
- HLE-Diamond
- Intelligence Index v5
- OpenAI
- SciCode
- Terminal-Bench-Science
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →