Melissa Tamine

New method efficiently values preference datasets for LLM alignment

Researchers have developed a new method for efficiently valuing preference datasets used to align Large Language Models (LLMs). The proposed Shapley-based approach, called Sequential Preference Optimization (SPO), signi…