Pascal Bergsträßer

New research suggests transformers are inherently succinct in representing concepts.

A new paper introduces succinctness as a metric for evaluating the expressive power of transformer models. Researchers demonstrated that transformers can represent formal languages more concisely than traditional method…