Lucas Fernandez-Sarmiento

New theory explains dropout universality in neural networks

Researchers have developed a mean-field theory to understand dropout in neural networks, viewing it as a perturbation of critical signal propagation. The theory establishes distinct universality classes for smooth and R…