Stochastic backtracking boosts language model reasoning efficiency

Researchers have developed a new method called stochastic backtracking to improve the efficiency of test-time scaling in language models. This technique allows models to revisit previously generated states, rather than solely expanding the current frontier of solutions. By employing subpool selection and powered backtracking with sequential Monte Carlo methods, the approach aims to enhance accuracy while reducing the total number of tokens generated during reasoning. Experiments on mathematical reasoning benchmarks show improved accuracy per token compared to existing methods. AI

影响 Enhances efficiency in language model reasoning, potentially leading to more capable AI systems with lower computational costs.

排序理由 Academic paper detailing a new method for improving language model reasoning. [lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

• language model
• mathematical reasoning benchmarks
• Stochastic Backtracking
• test-time scaling

• 论文
• 其他

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →