ENTITY
Block Attention Residuals
Block Attention Residuals
PulseAugur coverage of Block Attention Residuals — every cluster mentioning Block Attention Residuals across labs, papers, and developer communities, ranked by signal.
Total · 30d
2
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
1
1 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 2 TOTAL
-
Kimi K3 model breaks long-context and depth bottlenecks with new attention mechanisms · 2 sources tracked
Moonshot's Kimi K3 model tackles the challenges of extremely long context windows and deep neural networks. To handle context windows up to one million tokens, Kimi K3 employs Kimi Delta Attention (KDA), which compresse…
-
AI Routing Interpretability: Block AttnRes Exposure Insufficient for Mechanism
Researchers have investigated the interpretability of routing mechanisms in AI models, specifically focusing on Block Attention Residuals (Block AttnRes). Their study used causal probes on two Qwen3 checkpoints, one tra…