PulseAugur
EN
LIVE 10:54:35
ENTITY Mixture of Activations (MoA)

Mixture of Activations (MoA)

PulseAugur coverage of Mixture of Activations (MoA) — every cluster mentioning Mixture of Activations (MoA) across labs, papers, and developer communities, ranked by signal.

Show in brief
Total · 30d
1
1 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
1
1 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 1 TOTAL
  1. RESEARCH · CL_53504 ·

    New MoA FFN Design Enhances LLM Expressivity and Scaling

    Researchers have introduced a novel feedforward network (FFN) design called Mixture of Activations (MoA) for large language models (LLMs). MoA utilizes token-adaptive activation mixing, allowing different activation fun…