Terminal Wrench

AI benchmarks hardened against reward hacking with adversarial loops

Researchers have developed a novel "hacker-fixer loop" to improve the robustness of AI agent benchmarks against reward hacking. This adversarial process uses three LLM agents to iteratively identify and patch vulnerabil…