two-layer neural networks
PulseAugur coverage of two-layer neural networks — every cluster mentioning two-layer neural networks across labs, papers, and developer communities, ranked by signal.
-
New theory explains training dynamics of partially trained neural networks
Researchers have developed a new theoretical framework to understand the training dynamics of partially trained three-layer neural networks. By extending mean-field theory to functional spaces, they established that the…
-
Dataset Distillation Theory Explained for Two-Layer Neural Networks
Researchers have theoretically analyzed dataset distillation algorithms applied to gradient-based training of two-layer neural networks. The study focuses on a non-linear task structure called the multi-index model, pro…
-
New mean-field model enhances neural network training with Consensus-Based Optimization
Researchers have developed a mean-field model for training two-layer neural networks using Consensus-Based Optimization (CBO). This approach, when combined with Adam, demonstrates faster convergence than CBO alone. The …
-
Neural network loss plateaus geometrically characterized
Researchers have developed a geometric framework to understand stationary plateaus in the loss landscapes of two-layer neural networks. Their work classifies these stationary points, distinguishing between local minima …
-
AI alignment research explores weak-to-strong generalization mechanism
Researchers have theoretically analyzed the mechanism of weak-to-strong generalization, a method for aligning advanced AI systems. Their work, focusing on reward-model learning with two-layer neural networks, demonstrat…