AdaBound

New DBS-Adam optimizer improves deep learning for imbalanced data

Researchers have developed a new optimization algorithm called Dynamic Batch-Sensitive Adam (DBS-Adam) designed to improve the training of deep learning models, particularly those dealing with imbalanced and sequential …