Ivan Belenky

AI detects reward hacking with efficient transformer encoder

Researchers have developed a novel method for detecting reward hacking in AI systems using a small transformer encoder. This encoder maps trajectories to a space where distance approximates signal differences, achieving…