ENTITY
Gaussian error linear unit
Gaussian error linear unit
PulseAugur coverage of Gaussian error linear unit — every cluster mentioning Gaussian error linear unit across labs, papers, and developer communities, ranked by signal.
Total · 30d
0
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
0
2 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 2 TOTAL
-
New analysis unifies gradient descent convergence for deep neural networks
Researchers have developed a unified convergence analysis for various gradient descent optimization methods used in training deep neural networks. This new analysis applies to a broad range of optimizers, including Adam…
-
New structural interpretation of GELU and other activation functions proposed
Researchers have proposed a new structural interpretation of activation functions like GELU, ReLU, SiLU/Swish, and hard swish. This work views GELU not just as a stochastic gate output, but through a Gaussian complement…