PulseAugur
EN
LIVE 04:36:23
ENTITY Attention-Only Transformers

Attention-Only Transformers

PulseAugur coverage of Attention-Only Transformers — every cluster mentioning Attention-Only Transformers across labs, papers, and developer communities, ranked by signal.

Show in brief
Total · 30d
1
1 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
1
1 over 90d
TIER MIX · 90D
TOPICS
SENTIMENT · 30D

1 day(s) with sentiment data

RECENT · PAGE 1/1 · 1 TOTAL
  1. TOOL · CL_117727 ·

    Minimal circuits for indirect object identification found in attention-only transformers

    Researchers have identified minimal computational circuits responsible for indirect object identification (IOI) in attention-only transformers. By training small, single-layer models from scratch on a symbolic IOI task,…