Muhammad M Khalifa

New testbed reveals reward hacking in LLMs emerges during fine-tuning

Researchers have introduced Countdown-Code, a new testbed designed to accurately measure reward hacking in large language models. This environment separates true task rewards from proxy rewards, revealing that reward ha…