Neural tangent kernel
PulseAugur coverage of Neural tangent kernel — every cluster mentioning Neural tangent kernel across labs, papers, and developer communities, ranked by signal.
- 2026-05-13 research_milestone Publication of a paper introducing a force-aware Neural Tangent Kernel for active learning of MLIPs. source
4 day(s) with sentiment data
-
New framework analyzes encoder-decoder operator learning via limiting kernels
This paper introduces a novel framework for analyzing operator learning within encoder-decoder architectures. It formulates operator learning on function spaces, addressing the challenge of finite-dimensional training d…
-
Latent-MoE architecture enhances physics-informed neural networks for complex PDEs
Researchers have developed Latent-MoE, a novel domain-aware Mixture-of-Experts architecture designed to improve the performance of physics-informed neural networks (PINNs) on partial differential equations (PDEs) with c…
-
New algorithms enhance neural field reconstruction with NTK and meta-learning
Researchers have developed three new algorithms to improve the reconstruction quality and efficiency of neural fields, which map continuous coordinates to signals like color or density. The first algorithm, NTK-KIP, use…
-
AdaptNTK framework enhances AI for molecular dynamics simulations
Researchers have developed AdaptNTK, a novel framework for quantifying uncertainty and implementing active learning in neural network potentials. This single-model approach uses a regularized Mahalanobis distance in emp…
-
Recurrent Neural Network Learning Dynamics Near Bifurcations Analyzed
A new research paper explores the dynamics of learning in recurrent neural networks (RNNs) near critical transition points, known as bifurcations. The study utilizes the global empirical Neural Tangent Kernel (GeNTK) to…
-
New theory links correlation propagation to Neural Tangent Kernel in deep learning
Researchers have established a theoretical link between correlation propagation and the Neural Tangent Kernel (NTK) in deep neural networks. By combining mean-field and random matrix theories, they demonstrated that cor…
-
New tools explain neural network training for power system dynamics
Researchers have developed new analytical tools to explain the training performance of machine learning surrogate models used in power system dynamics. By adapting small-signal eigenvalue analysis from power systems, th…
-
Weak correlations principle explains linearization in gradient-based learning systems
A new paper published on arXiv explores the principle of weak correlations as the underlying reason for the linearization observed in gradient-based learning systems. The research suggests that the simplified dynamics s…
-
New framework enhances physics-informed neural networks with information propagation paths
Researchers have developed a new framework for physics-informed neural networks (PINNs) that addresses limitations in how these networks handle partial differential equations. The proposed multi-dimensional training-pri…
-
New Differential Neural Tangent Kernel framework advances PINN analysis
Researchers have introduced the Differential Neural Tangent Kernel (DNTK) as a new theoretical framework for analyzing physics-informed neural networks (PINNs). This framework establishes the positivity of the infinite-…
-
Neural networks outperform NTK limits on compositional tasks, study finds
A new research paper explores the performance gap between trained neural networks and their Neural Tangent Kernel (NTK) limits, particularly for tasks with compositional structure. The study introduces a dichotomy betwe…
-
Paper analyzes SGD convergence for score-based generative models
Researchers have published a paper analyzing the optimization dynamics of training Score-based Generative Models (SGMs). The study focuses on Stochastic Gradient Descent (SGD) and provides convergence rates for general …
-
New research details SGD convergence for score-based generative models
Researchers have published a paper detailing the non-asymptotic convergence of Stochastic Gradient Descent (SGD) when applied to Score-based Generative Models (SGMs). The study provides theoretical guarantees for SGD in…
-
New variational formulation simplifies neural network training
Researchers have introduced a novel variational formulation for shallow neural networks, treating the discrete training problem as a continuous variational surrogate. This approach leverages $\lambda$-convex functionals…
-
New framework analyzes neural network training for PDF fitting
Researchers have developed a theoretical framework using the Neural Tangent Kernel (NTK) to analyze the training dynamics of neural networks used in Parton Distribution Function (PDF) fitting. This approach offers an an…
-
New framework analyzes gradient descent convergence in neural networks
Researchers have developed a new framework to analyze the convergence of gradient descent in neural networks, extending beyond the traditional neural tangent kernel (NTK) regime. This framework applies to a broad range …
-
New research probes catastrophic forgetting in AI models · 4 sources tracked
Three new research papers explore the phenomenon of catastrophic forgetting in continual learning systems, particularly within large language models. The first paper introduces a controlled framework to study the mechan…
-
New theory links neural network ensembles to nuclear reaction models
A new paper proposes a theoretical framework for understanding neural network ensembles in open systems, drawing parallels to nuclear reaction theory. The research suggests that existing ensemble theories primarily addr…
-
New method analyzes generalization in nonlinear least-squares models
Researchers have developed a new method to understand how nonlinear least-squares models generalize. Their approach uses on-average algorithmic stability to derive error bounds for local minimizers. These bounds are lin…
-
Deep Neural Networks Achieve Optimal Generalization Rates
Two new papers submitted to arXiv analyze the generalization performance of gradient descent methods in deep neural networks. The research establishes minimax-optimal rates for excess population risk in deep ReLU networ…