An Improved Adaptive PID Optimizer with Enhanced Convergence and Stability for Deep Learning
Researchers have developed a new optimization algorithm called IAdaPID-ADG, designed to improve the convergence and stability of deep learning models. This novel optimizer integrates concepts from AMSGrad and DiffGrad, specifically a non-increasing effective learning rate and a gradient difference modulation factor, to address limitations inherited from the widely used Adam optimizer. Evaluations on benchmark and real-world datasets demonstrated that IAdaPID-ADG significantly outperforms existing optimizers. AI
IMPACT Introduces a novel optimization algorithm that could lead to faster and more reliable training of deep learning models.