actor--critic training

New PS-PPO method cuts RLHF training costs for LLMs

Researchers have introduced Prefix-Sampling Proximal Policy Optimization (PS-PPO), a novel method designed to make Reinforcement Learning from Human Feedback (RLHF) more computationally efficient for large language mode…