Importance-Weighted On-Policy Distillation

New distillation method tackles position bias in reinforcement learning

Researchers have identified a position bias in On-Policy Distillation (OPD), a method used to improve reinforcement learning efficiency. They found that OPD's standard KL objective uniformly weights all tokens, but late…