FormalRewardBench benchmark evaluates LLM reward models for theorem proving

Researchers have introduced FormalRewardBench, a new benchmark designed to evaluate reward models used in formal theorem proving. This benchmark addresses the challenge of sparse credit assignment in reinforcement learning for theorem provers by enabling the comparison of reward models without extensive retraining. FormalRewardBench includes 250 preference pairs with various error injection strategies and has been used to test several large language models, revealing that frontier models perform best in evaluating proof quality. AI

影响 This benchmark aims to improve reward models for AI theorem provers, potentially leading to more capable AI systems in formal mathematics and complex reasoning tasks.

排序理由 The cluster describes a new academic paper introducing a benchmark for evaluating AI models in a specific domain. [lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

• Claude Opus 4.5
• CompassJudger-1-14B
• DeepSeek-Prover-V2-7B
• FormalRewardBench
• Qwen2.5-72B-Instruct

• 论文
• 安全

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →