AttentionPO

New TwDPO method uses LLM attention for better preference alignment

Researchers have introduced Token-weighted Direct Preference Optimization (TwDPO), a new method for aligning large language models with human preferences. Unlike standard DPO, TwDPO assigns different importance weights …