一组 49 名数学家在德国 Leipzig 为期三天的研讨会上开发了一个包含 100 个具有已知答案的研究级数学问题的数据集。他们用这些问题测试了五个最先进的大型语言模型，发现在三个评估阶段后，只有两个问题仍未解决。这展示了大型语言模型在数学推理能力方面取得的令人印象深刻的进步。 AI
影响 展示了大型语言模型在数学推理方面取得的重大进展，可能影响未来人工智能在 STEM 领域的开发和应用。
排序理由 详细介绍新基准测试和大型语言模型数学推理评估的学术论文。
AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →
arXiv:2606.05818v1 Announce Type: cross Abstract: Between April 1 and May 15, 2026, a group of 49 mathematicians compiled a dataset of research-level mathematics questions with known answers. Most of the work was done during the 3-day workshop *Benchmarks in Leipzig* with 35 part…
Between April 1 and May 15, 2026, a group of 49 mathematicians compiled a dataset of research-level mathematics questions with known answers. Most of the work was done during the 3-day workshop *Benchmarks in Leipzig* with 35 participants at the Max Planck Institute for Mathemati…