Formalize Once, Edit the Rest: Efficient Lean-Based Answer Selection for Math Reasoning
Researchers have developed a new method called BASE for improving the efficiency of answer selection in mathematical reasoning tasks using large language models (LLMs) and the formal proof assistant Lean. BASE reduces computational costs by formalizing a single base candidate answer and then editing it to derive the remaining candidate statements, rather than formalizing each independently. This approach, facilitated by a rewriter model named LEANSCRIBE, simultaneously enhances selection accuracy and significantly cuts down the number of autoformalizer calls, offering a Pareto improvement across various datasets and solvers. AI
IMPACT Reduces computational costs for LLM-based mathematical reasoning, potentially enabling more efficient verification and selection of answers.