Pierfrancesco Beneventano
PulseAugur coverage of Pierfrancesco Beneventano — every cluster mentioning Pierfrancesco Beneventano across labs, papers, and developer communities, ranked by signal.
-
New 'Muon' optimization technique flattens matrix gradients
A new research paper introduces "Muon," an optimization technique that replaces matrix gradients with their polar factors. This method maintains singular directions but flattens the update spectrum, which the authors su…
-
New research tackles deep learning bias, training dynamics, and reliability
Researchers are exploring new theoretical frameworks and practical methods to improve deep learning models. One paper introduces DISCO, a technique for mitigating dataset bias by estimating conditional distance correlat…
-
Paper questions weight decay's role in deep learning stability
A new paper investigates the role of weight decay in deep learning training stability, challenging its common perception as a simple regularization technique. The research analyzes how weight decay affects parameter dyn…
-
Too Sharp, Too Sure: When Calibration Follows Curvature
Researchers have identified a strong link between model calibration, curvature, and margins during the training of deep neural networks. Their findings indicate that Expected Calibration Error closely follows curvature-…