IWSLT14

New Hybrid Momentum Optimizer Enhances Deep Learning Training

Researchers have developed a novel optimization technique called Hybrid Momentum (HyM) for deep learning models. HyM combines a linearly weighted average of past gradients with a geometrically discounted fast momentum, …