研究人员引入了新的基准和评估方法来评估大型语言模型的数学推理能力。ComBench侧重于奥林匹克级别的组合数学，区分证明推理和构造性实现，并发现即使是顶级模型也难以应对这些复杂任务。另一种方法TheoremBench使用Lean4语言评估LLM在形式数学中的定理证明能力，强调需要超越竞赛式问题来评估模型在更长、依赖性更强的数学发展中的表现。此外，一种用于研究级证明的严格步骤级验证方法旨在通过仔细检查每个推理步骤来解决LLM的不可靠性问题。 AI
影响 这些基准和验证方法将推动LLM在数学推理和形式证明能力方面的进步。
排序理由 多篇研究论文介绍了用于LLM数学推理的新基准和评估方法。
AI 生成摘要 · Google Gemini · 来自 7 个来源。 我们如何撰写摘要 →
arXiv:2606.10479v1 Announce Type: new Abstract: Combinatorics is central to Olympiad-level mathematical problem solving, requiring deep discrete reasoning, creative constructions, and rigorous structural insight. Recent evidence suggests that even today's strongest frontier model…
arXiv:2606.10799v1 Announce Type: new Abstract: Large Language Models (LLMs) struggle to rigorously verify complex mathematical proofs. Standard global evaluation approaches suffer from "context poisoning," in which superficially plausible statements mask subtle logical flaws, le…
Large Language Models (LLMs) struggle to rigorously verify complex mathematical proofs. Standard global evaluation approaches suffer from "context poisoning," in which superficially plausible statements mask subtle logical flaws, leading to hallucination or over-skepticism. To ad…
arXiv:2605.22763v2 Announce Type: replace Abstract: Large language models (LLMs) increasingly excel at mathematical reasoning, but their unreliability limits their utility in mathematics research. A mitigation is using LLMs to generate formal proofs in languages like Lean. We per…
arXiv:2606.09450v1 Announce Type: new Abstract: LLMs have recently achieved strong results on formal proving benchmarks. However, existing evaluations remain heavily concentrated on competition-style problems and often fail to capture how models behave on longer, more dependency-…
LLMs have recently achieved strong results on formal proving benchmarks. However, existing evaluations remain heavily concentrated on competition-style problems and often fail to capture how models behave on longer, more dependency-rich mathematical developments. We introduce The…
LLMs have recently achieved strong results on formal proving benchmarks. However, existing evaluations remain heavily concentrated on competition-style problems and often fail to capture how models behave on longer, more dependency-rich mathematical developments. We introduce The…