AMSGrad

Anon optimizer offers tunable adaptivity, outperforming Adam and SGD on key tasks

Researchers have introduced Anon, a novel optimizer designed to bridge the performance gap between adaptive methods like Adam and non-adaptive methods like SGD. Anon features continuously tunable adaptivity, allowing it…