Pringle

Group symmetries predict LLM embedding geometry, from music to stars

Researchers have demonstrated that the geometric structures observed in language model embeddings, such as circles for months and saddle-shaped manifolds for chords, are directly predictable from the statistical symmetr…