A new paper questions the effectiveness of Reinforcement Learning from Verifiable Rewards (RLVR) in ensuring that language models' reasoning chains accurately reflect their problem-solving processes. Researchers introduced metrics like Causal Importance of Reasoning (CIR) and Sufficiency of Reasoning (SR) to evaluate this, finding that while RLVR boosts accuracy, it doesn't consistently improve these reasoning metrics. The study suggests that fine-tuning before RLVR or using auxiliary rewards alongside outcome-based rewards can lead to more reliable and causally important reasoning. AI
影响 Challenges the assumption that RLVR guarantees reliable reasoning, suggesting modifications for more trustworthy AI outputs.
排序理由 Academic paper introducing new metrics and experimental findings on language model reasoning.
AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →
