A new research paper argues that the "wait" marker used in reasoning models, often attributed to reinforcement learning (RL), is primarily inherited from training data rather than invented by RL itself. The study traces this marker's provenance across various open models, finding that RL significantly improves accuracy on benchmarks like Math-500 even when the "wait" word is absent. The research also cautions against relying solely on LLM-as-a-judge metrics, as they can misrepresent reasoning trends observed in human evaluations. AI
IMPACT Challenges the perceived role of RL in developing reasoning markers, suggesting a greater reliance on training data and cautioning against automated evaluation metrics.
RANK_REASON The cluster contains a research paper detailing findings about the origin of a specific marker in reasoning models.
Read on Hugging Face Daily Papers →
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →