Hydra effect

New theory unifies interpretability phenomena in Transformer models

Researchers have proposed a new framework that unifies several observed phenomena in the interpretability of Transformer-based language models. This framework suggests that phenomena like induction heads, function vecto…