Neural tangent kernel
PulseAugur coverage of Neural tangent kernel — every cluster mentioning Neural tangent kernel across labs, papers, and developer communities, ranked by signal.
- 2026-05-13 research_milestone Publication of a paper introducing a force-aware Neural Tangent Kernel for active learning of MLIPs. source
2 day(s) with sentiment data
-
New theory links correlation propagation to Neural Tangent Kernel in deep learning
Researchers have established a theoretical link between correlation propagation and the Neural Tangent Kernel (NTK) in deep neural networks. By combining mean-field and random matrix theories, they demonstrated that cor…
-
New tools explain neural network training for power system dynamics
Researchers have developed new analytical tools to explain the training performance of machine learning surrogate models used in power system dynamics. By adapting small-signal eigenvalue analysis from power systems, th…
-
Weak correlations principle explains linearization in gradient-based learning systems
A new paper published on arXiv explores the principle of weak correlations as the underlying reason for the linearization observed in gradient-based learning systems. The research suggests that the simplified dynamics s…
-
New framework enhances physics-informed neural networks with information propagation paths
Researchers have developed a new framework for physics-informed neural networks (PINNs) that addresses limitations in how these networks handle partial differential equations. The proposed multi-dimensional training-pri…
-
New Differential Neural Tangent Kernel framework advances PINN analysis
Researchers have introduced the Differential Neural Tangent Kernel (DNTK) as a new theoretical framework for analyzing physics-informed neural networks (PINNs). This framework establishes the positivity of the infinite-…
-
Neural networks outperform NTK limits on compositional tasks, study finds
A new research paper explores the performance gap between trained neural networks and their Neural Tangent Kernel (NTK) limits, particularly for tasks with compositional structure. The study introduces a dichotomy betwe…
-
Paper analyzes SGD convergence for score-based generative models
Researchers have published a paper analyzing the optimization dynamics of training Score-based Generative Models (SGMs). The study focuses on Stochastic Gradient Descent (SGD) and provides convergence rates for general …
-
New research details SGD convergence for score-based generative models
Researchers have published a paper detailing the non-asymptotic convergence of Stochastic Gradient Descent (SGD) when applied to Score-based Generative Models (SGMs). The study provides theoretical guarantees for SGD in…
-
New variational formulation simplifies neural network training
Researchers have introduced a novel variational formulation for shallow neural networks, treating the discrete training problem as a continuous variational surrogate. This approach leverages $\lambda$-convex functionals…
-
New framework analyzes neural network training for PDF fitting
Researchers have developed a theoretical framework using the Neural Tangent Kernel (NTK) to analyze the training dynamics of neural networks used in Parton Distribution Function (PDF) fitting. This approach offers an an…
-
New framework analyzes gradient descent convergence in neural networks
Researchers have developed a new framework to analyze the convergence of gradient descent in neural networks, extending beyond the traditional neural tangent kernel (NTK) regime. This framework applies to a broad range …
-
New research probes catastrophic forgetting in AI models · 4 sources tracked
Three new research papers explore the phenomenon of catastrophic forgetting in continual learning systems, particularly within large language models. The first paper introduces a controlled framework to study the mechan…
-
New theory links neural network ensembles to nuclear reaction models
A new paper proposes a theoretical framework for understanding neural network ensembles in open systems, drawing parallels to nuclear reaction theory. The research suggests that existing ensemble theories primarily addr…
-
New method analyzes generalization in nonlinear least-squares models
Researchers have developed a new method to understand how nonlinear least-squares models generalize. Their approach uses on-average algorithmic stability to derive error bounds for local minimizers. These bounds are lin…
-
Deep Neural Networks Achieve Optimal Generalization Rates
Two new papers submitted to arXiv analyze the generalization performance of gradient descent methods in deep neural networks. The research establishes minimax-optimal rates for excess population risk in deep ReLU networ…
-
NTK theory extended to neural network classification
Researchers have extended the Neural Tangent Kernel (NTK) theory to classification tasks, previously a limitation to regression losses. They identified conditions, including parameter-space regularization or non-degener…
-
New theory explains neural network training speed
Researchers have developed a new theoretical framework to better understand the optimization dynamics of over-parameterized neural networks. This framework, centered around the Neural Tangent Kernel (NTK), introduces co…
-
New optimization technique boosts accuracy for complex physics neural networks
Researchers have developed a new optimization technique called SOAP+GN to improve the accuracy of physics-informed neural networks (PINNs) when dealing with complex, coupled multiphysics systems. This method addresses a…
-
New method enhances neural network uncertainty estimation
Researchers have developed a new method to improve Bayesian Last Layers (BLLs) for estimating uncertainty in neural networks. Their approach leverages a projection of Neural Tangent Kernel (NTK) features to account for …
-
GLU structures accelerate LLM optimization by reshaping NTK spectrum
Researchers have investigated why Gated Linear Units (GLU) are superior to non-GLU structures in large language models. Their analysis in the neural tangent kernel regime indicates that GLU reshapes the NTK spectrum, re…