New framework attributes LLM reasoning path contributions using Shapley values

Researchers have developed a new reinforcement learning framework called Parallel Shapley to address the challenge of attributing rewards in multi-step reasoning for large language models (LLMs). This method treats each reasoning path as a player in a cooperative game, using Shapley values to quantify individual contributions and a generative reward model with Monte Carlo sampling for efficient approximation. Experiments on mathematical reasoning benchmarks indicate that Parallel Shapley leads to more stable and interpretable training compared to existing methods, effectively identifying and penalizing redundant or detrimental reasoning paths. AI

IMPACT This framework could improve the efficiency and interpretability of training LLMs for complex reasoning tasks.

RANK_REASON The cluster contains an academic paper detailing a new methodology for LLM reasoning. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

• arXiv
• large-language models
• Monte Carlo Sampling Methods
• Parallel Shapley
• reinforcement learning
• Shapley Values

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →