KL-regularization

New framework unifies RLHF divergence analysis with novel algorithms

Researchers have developed a new theoretical framework for Reinforcement Learning from Human Feedback (RLHF) that unifies the analysis of various divergence functions beyond the standard reverse KL-regularization. The s…