Scaling Laws for Reward Model Overoptimization

Reward signal, not model size, is key bottleneck in LLM training

A recent analysis highlights that the primary bottleneck in improving large language models is not the model size or the complexity of reinforcement learning from human feedback (RLHF) pipelines, but rather the reward s…