PulseAugur
EN
LIVE 10:51:49
ENTITY Feedforward network (FFN)

Feedforward network (FFN)

PulseAugur coverage of Feedforward network (FFN) — every cluster mentioning Feedforward network (FFN) across labs, papers, and developer communities, ranked by signal.

Show in brief
Total · 30d
1
1 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
1
1 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 1 TOTAL
  1. RESEARCH · CL_53504 ·

    New MoA FFN Design Enhances LLM Expressivity and Scaling

    Researchers have introduced a novel feedforward network (FFN) design called Mixture of Activations (MoA) for large language models (LLMs). MoA utilizes token-adaptive activation mixing, allowing different activation fun…