PulseAugur
EN
LIVE 04:47:08

New benchmarks and tools advance LLM mathematical reasoning capabilities · 6 sources tracked

Researchers have introduced new benchmarks and evaluation methods for large language models (LLMs) in mathematical reasoning. MIRA-Math focuses on minimal information requesting, where models must ask for a single missing fact to solve mathematical problems. Separately, PluraMath extends existing multilingual benchmarks to include underrepresented languages, highlighting performance gaps between high-resource and low-resource linguistic settings. Additionally, a study evaluating SageMath-augmented LLM agents demonstrates significant performance gains when these models can access computational tools, with Qwen 3.7-Max and GPT-5.5 showing notable improvements. AI

IMPACT These advancements in benchmarks and tool integration are crucial for developing more capable and reliable LLMs for complex mathematical and scientific tasks.

RANK_REASON Multiple research papers introducing new benchmarks and evaluation methodologies for LLMs in mathematical reasoning.

Read on Hugging Face Daily Papers →

AI-generated summary · Google Gemini · from 7 sources. How we write summaries →

New benchmarks and tools advance LLM mathematical reasoning capabilities · 6 sources tracked

COVERAGE [7]

  1. arXiv cs.AI TIER_1 English(EN) · Charbel Al Bateh, Samer Saab Jr ·

    MIRA-Math: A Benchmark for Minimal Information Requesting and Mathematical Reasoning

    arXiv:2607.07391v1 Announce Type: new Abstract: Mathematical reasoning benchmarks typically provide all facts needed to solve each problem, while interactive benchmarks often mix reasoning with tools, retrieval, and long-horizon dialogue. We introduce MIRA-Math, a benchmark for a…

  2. arXiv cs.AI TIER_1 English(EN) · Pavel Snopov, German Magai ·

    Evaluating SageMath-Augmented LLM Agents for Computational and Experimental Mathematics

    arXiv:2607.06820v1 Announce Type: new Abstract: Recent advances in AI for Mathematics have focused largely on autoformalization and theorem proving, leaving the role of Computer Algebra Systems (CAS) in agentic LLM workflows underexplored. We propose a ReAct-style agentic setup t…

  3. arXiv cs.AI TIER_1 English(EN) · Samer Saab ·

    MIRA-Math: A Benchmark for Minimal Information Requesting and Mathematical Reasoning

    Mathematical reasoning benchmarks typically provide all facts needed to solve each problem, while interactive benchmarks often mix reasoning with tools, retrieval, and long-horizon dialogue. We introduce MIRA-Math, a benchmark for a narrower diagnostic capability: solving mathema…

  4. arXiv cs.AI TIER_1 English(EN) · Daryna Dementieva, Nikolay Babakov, Kathy H\"ammerl, Ilseyar Alimova, Jind\v{r}ich Libovick\'y, Shu Okabe, Miras Baisbay, Lukas Edman, Abrorkhon Inomkhujaev, Antonia Karamolegkou, Mateusz Lango, Volkan \"Ozer, Nikola Selic, Subhankar Swain, Tsedeniya Kin… ·

    PluraMath: Extending Mathematical Reasoning Evaluation Beyond High-Resource Languages

    arXiv:2607.05992v1 Announce Type: cross Abstract: Mathematical reasoning has become a central task for evaluating and tuning reasoning Large Language Models (LLMs), yet existing benchmarks remain heavily biased toward high-resource languages, with English and Chinese dominating b…

  5. arXiv cs.AI TIER_1 English(EN) · Husnain Amjad, Raja Khurram Shahzad, Aamir Shahzad, Mehwish Fatima ·

    Mathematical Reasoning in Large Language Models: Benchmarks, Architectures, Evaluation, and Open Challenges

    arXiv:2605.19723v2 Announce Type: replace-cross Abstract: Mathematical reasoning is essential for problem-solving in education, science, and industry, serving as a crucial benchmark for evaluating artificial intelligence systems. As Large Language Models (LLMs) improve their reas…

  6. arXiv cs.AI TIER_1 English(EN) · Alexander Fraser ·

    PluraMath: Extending Mathematical Reasoning Evaluation Beyond High-Resource Languages

    Mathematical reasoning has become a central task for evaluating and tuning reasoning Large Language Models (LLMs), yet existing benchmarks remain heavily biased toward high-resource languages, with English and Chinese dominating both pre-training corpora and evaluation suites. Th…

  7. Hugging Face Daily Papers TIER_1 English(EN) ·

    PluraMath: Extending Mathematical Reasoning Evaluation Beyond High-Resource Languages

    PluraMath extends the PolyMath dataset to 18 underrepresented languages, revealing persistent gaps in multilingual mathematical reasoning performance between high-resource and low-resource languages.