Researchers have developed new methods for improving Large Language Model (LLM) reasoning through step-wise rubric rewards. The first approach, Step-wise Rubrics as Rewards (SRaR), uses an LLM judge to assign rubric items to reasoning steps, normalizing scores to focus on quality differences and combining step-wise and outcome rewards. This method improved accuracy on math and code-generation benchmarks, notably increasing the Faithful Reasoning Rate on AIME 2025. The second method, Rubricon, automates the generation and refinement of rubrics for LLM evaluation and training without requiring human preference labels. Rubricon produces rubrics that show greater alignment with expert-authored rubrics and improves performance when used for model training. AI
IMPACT These methods could lead to more reliable and efficient LLM training and evaluation, particularly for complex reasoning tasks.
RANK_REASON Two research papers introducing novel methods for improving LLM reasoning and evaluation using rubrics.
- AIME 2025
- arXiv
- .codex
- HealthBench
- Hugging Face
- OpenRubrics
- QSRG
- Qwen3-32B-Non-Thinking
- Qwen3.5:9b
- Qwen3-8B-Non-Thinking
- RR Donnelley
- Rubricon
- Rubrics as Rewards
- Step-wise Rubrics as Rewards
- Xie Weichu
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →