RVPO

Apple's RVPO framework enhances LLM alignment by penalizing reward variance

Researchers have introduced Reward-Variance Policy Optimization (RVPO), a novel framework designed to improve the alignment of large language models with multiple objectives. Unlike existing methods that average rewards…