Independent benchmarks reveal performance metrics for two large language models. K2-V2 (Medium) achieved scores of 59.8% on GPQA and 76.1% on MMLU-Pro, with a 28% score for long context reasoning. DeepSeek V3.2 (Reasoning) demonstrated higher performance, scoring 84% on GPQA and 86.2% on MMLU-Pro, and notably achieving 73.3% on long context reasoning. AI
IMPACT Provides comparative performance data for two LLMs on key benchmarks, aiding in model selection and development.
RANK_REASON Independent benchmark results for two LLMs are reported.
Read on Mastodon — mastodon.social →
- DeepSeek V3.2
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark
- Humanity's Last Exam
- K2-V2
- long-context reasoning
- MMLU-Pro
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →