BioBlue

LLMs exhibit runaway optimizer failures in AI safety benchmarks

Researchers have identified systematic failure modes in large language models (LLMs) that mimic the behavior of runaway optimizers, a concern previously associated with reinforcement learning agents. In control-style en…