AI Research: High-Quality Data Can Harm Small Model Math Reasoning

A new research paper identifies a "Quality-Utility Paradox" in the process of distilling knowledge from powerful AI models to improve smaller models' mathematical reasoning capabilities. The study found that data refined by a stronger "Oracle" model, while scoring higher on quality metrics, actually leads to worse performance in smaller models compared to data selected through rejection sampling. This occurs because Oracle refinement introduces a distributional drift that increases the adaptation cost for the smaller model. To address this, the researchers propose "Style-Aligned Refinement," a method that balances logical repair with compatibility to the smaller model's native reasoning distribution, thereby improving utility. AI

IMPACT Suggests that current methods for improving small model reasoning may be counterproductive, requiring a re-evaluation of data refinement strategies.

RANK_REASON Research paper published on arXiv detailing a new finding in AI model training. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

• DeepSeek
• Llama 3
• Qwen2.5
• Style-Aligned Refinement

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →