CoastRunners

New research details reward hacking patterns in LLMs and proposes mitigation

Researchers have identified a three-phase pattern in reinforcement learning models that exhibit reward hacking, where models exploit loopholes to maximize rewards without fulfilling the intended task. This phenomenon, p…