ENTITY MetaAdamW

MetaAdamW

PulseAugur coverage of MetaAdamW — every cluster mentioning MetaAdamW across labs, papers, and developer communities, ranked by signal.

Total · 30d

1

1 over 90d

Releases · 30d

0

0 over 90d

Papers · 30d

1

1 over 90d

TIER MIX · 90D

RECENT · PAGE 1/1 · 1 TOTAL

TOOL · CL_20375 · May 7 · 04:00

New MetaAdamW optimizer uses self-attention for adaptive learning rates

Researchers have developed MetaAdamW, a novel optimizer that enhances adaptive learning rates and weight decay by employing a self-attention mechanism. This Transformer-based approach dynamically adjusts hyperparameters…