Moonshot's Kimi K3.1 Pro, a claimed 2.8 trillion parameter model, has been audited by an external observer. While the model's size and parameter count appear consistent with its claims, its performance on benchmarks shows it losing to Anthropic's Claude Opus 5.5 on 20 out of 39 comparable rows. Specifically, Kimi struggled with hard reasoning tasks, scoring less than half of Opus's score on the Program Bench, though it performed well on agent-with-tools tasks and hallucination benchmarks. AI
IMPACT Highlights the importance of rigorous benchmark analysis over marketing claims for large models.
RANK_REASON Analysis of a released model's performance data, not a direct release announcement.
- Claude Fable 5-1
- Claude Opus 5.5
- GLM 5.3
- GPT -6 Astra
- Hugging Face
- Kimi K3.1 Pro
- Moonshot
- MoonViT-V2
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →