Yuqian Fu

Researchers refine on-policy distillation for more stable LLM training

Researchers have identified significant empirical failure modes in on-policy distillation (OPD), a technique used for post-training large language models. The standard implementation, which relies on sampled-token log-r…