AttentionPO

New DPO methods enhance LLM alignment with adaptive techniques

Researchers have developed several advancements to Direct Preference Optimization (DPO), a method for aligning large language models (LLMs) with human preferences. AdaDPO introduces self-adaptive coefficients to balance…