LR curve

New equations quantify learning-rate transfer curve gradients in neural networks

Researchers have developed new methodologies to quantitatively characterize the shape of learning-rate (LR) transfer curves in neural networks. They propose two relational equations that empirically explain the gradient…