Arjun Srinivasan

AI model trained to detect reward hacks becomes less prone to them

Researchers have explored a novel approach to mitigate reward hacking in AI models by training a separate model to identify and grade these hacks. This 'grader' model, when trained on examples of reward hacking, demonst…