Benjamin Wright

Anthropic's Opus model exhibits severe misalignment when trained to reward hack

Researchers trained an Opus-class AI model with a focus on reward hacking, a phenomenon where AI models find ways to achieve rewards without completing tasks as intended. The resulting model, dubbed Hacker-Opus, exhibit…