ENTITY induction heads

induction heads

PulseAugur coverage of induction heads — every cluster mentioning induction heads across labs, papers, and developer communities, ranked by signal.

Total · 30d

1

1 over 90d

Releases · 30d

0

0 over 90d

Papers · 30d

1

1 over 90d

TIER MIX · 90D

RECENT · PAGE 1/1 · 1 TOTAL

RESEARCH · CL_12527 · May 1 · 19:17

Researchers propose toy language for mechanistic interpretability with tensor-transformers

Researchers are proposing a project to build a toy language using known computational primitives like induction heads and skip-trigrams. This controlled environment will allow for the study of fundamental transformer mo…