Se-DPO

Se-DPO enhances language model training with self-evolving token credit

Researchers have introduced Se-DPO, a novel method for Direct Preference Optimization (DPO) that dynamically adjusts the contribution of individual tokens to the preference signal. Unlike traditional DPO which treats al…