ENTITY
Nanda et al.
Nanda et al.
PulseAugur coverage of Nanda et al. — every cluster mentioning Nanda et al. across labs, papers, and developer communities, ranked by signal.
Total · 30d
0
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
0
2 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 2 TOTAL
-
Transformer learns modular multiplication via discrete-log clock algorithm
Researchers have uncovered how transformers learn modular multiplication by analyzing their internal representations in a specific mathematical basis. Contrary to previous assumptions of dense Fourier spectra, the study…
-
New Metric Predicts Transformer 'Grokking' Phenomenon
A new research paper introduces the Frequency Synchronization Degree (FSD), a metric to measure the synchronization of Fourier circuits in Grokking Transformers. This metric consistently predicts grokking, the phenomeno…