Researchers are exploring new methods for on-policy distillation (OPD) to improve the efficiency and effectiveness of training large language models. One approach, Streaming On-Policy Distillation, decouples response generation, supervision delivery, and parameter updates to allow for continuous generation and targeted loss computation. Another method, B-OPSD, generates problem briefs from questions alone to provide teacher guidance without needing ground-truth solutions, showing improved accuracy on mathematical reasoning tasks. A third technique, Stochastic Horizons On-Policy Distillation (SH-OPD), reduces redundant supervision by varying rollout horizons, leading to significant cost savings while maintaining competitive performance on reasoning and code generation tasks. AI
IMPACT These new distillation techniques could lead to more efficient training of large language models, reducing computational costs and potentially enabling faster development cycles.
RANK_REASON The cluster contains multiple academic papers detailing novel research methods for on-policy distillation in LLMs.
Read on Hugging Face Daily Papers →
- FLNA
- On-Policy Distillation
- SH-OPD
- Stochastic Horizons On-Policy Distillation
- arXiv
- B-OPSD
- GSM8K
- Hugging Face
- Qwen3
- Qwen3-0.6B
- Qwen3-4B
- Streaming On-Policy Distillation
- Zhi Xu
AI-generated summary · Google Gemini · from 3 sources. How we write summaries →