Cognitive Field Theory

New theory suggests infrared organization governs Transformer dynamics in LLMs

A new paper proposes that the emergent behaviors in large language models are governed by a physical mechanism involving the reorganization of time-scale density of states (TDOS). Researchers used Pythia language models…