Independent benchmarks reveal the performance of several large language models across various metrics. Muse Spark Open achieved 89% on GPQA and 58.4% on SciCode, while Muse Glimmer scored 83.5% on GPQA and 44.9% on SciCode. Kimi K3.1 Pro demonstrated strong performance in long-context reasoning at 86.3% and SciCode at 60.8%. Qwen3.8 Max led in GPQA with 92.8% and showed 80.3% in long-context reasoning. AI
IMPACT Provides comparative performance data for LLMs on key benchmarks, aiding in model selection and development.
RANK_REASON The cluster reports benchmark results for multiple LLMs, which falls under research.
Read on Mastodon — mastodon.social →
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark
- Humanity's Last Exam
- Kimi K3.1 Pro
- long-context reasoning
- Muse Glimmer
- Muse Spark Open
- SciCode
AI-generated summary · Google Gemini · from 4 sources. How we write summaries →