Anthropic HH

New DPO Method Improves LLM Alignment with Noisy Preference Data

Researchers have developed a new method called Metadata-Free Meta-Reweighted Direct Preference Optimization (MF-MR-DPO) to improve the alignment of large language models (LLMs) with human preferences, even when the pref…