DP-Adam
PulseAugur coverage of DP-Adam — every cluster mentioning DP-Adam across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
New DP-μP framework enables hyperparameter transfer for private model training
Researchers have developed DP-μP, a new framework that extends Maximal Update Parametrization (μP) to differentially private optimization. Standard μP, which allows for zero-shot hyperparameter transfer in normal traini…
-
New technique boosts differentially private training accuracy for vision models
Researchers have developed a new technique called Spectral Gradient Orthogonalization (SGO) to improve the accuracy of differentially private training for vision models. This method addresses the issue where isotropic G…
-
New optimizer DP-IVON-Gradsq enhances differential privacy in Bayesian deep learning
Researchers have developed DP-IVON-Gradsq, a new optimizer designed to enhance differential privacy in Bayesian deep learning. This method aims to mitigate the interference between privacy noise and the stochasticity in…
-
New DP-MacAdam algorithm improves private ML training
Researchers have introduced DP-MacAdam, a new algorithm designed to enhance privacy in machine learning training. This method combines adaptive clipping and adaptive momentum techniques, using the same gradient variance…