PulseAugur
实时 09:58:18

New theory bounds KAN training, reveals privacy-utility gap

Researchers have established new theoretical bounds for training Kolmogorov-Arnold Networks (KANs), a structured alternative to standard MLPs. The work analyzes KANs trained with mini-batch stochastic gradient descent (SGD), including differentially private variants with correlated noise. These findings reveal a gap between non-private and private training regimes, suggesting that polylogarithmic network width is necessary for differential privacy. AI

影响 Establishes theoretical underpinnings for KANs, potentially guiding future research in privacy-preserving machine learning.

排序理由 The cluster contains two academic papers detailing theoretical analysis and bounds for a specific type of neural network architecture (KANs) and its training dynamics, including privacy considerations.

在 arXiv stat.ML 阅读 →

AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →

New theory bounds KAN training, reveals privacy-utility gap

报道来源 [3]

  1. arXiv stat.ML TIER_1 English(EN) · Puyu Wang, Jan Schuchardt, Nikita Kalinin, Junyu Zhou, Sophie Fellenz, Christoph Lampert, Marius Kloft ·

    Population Risk Bounds for Kolmogorov-Arnold Networks Trained by DP-SGD with Correlated Noise

    arXiv:2605.12648v1 Announce Type: cross Abstract: We establish the first population risk bounds for Kolmogorov-Arnold Networks (KANs) trained by mini-batch SGD with gradient clipping, covering non-private SGD as well as differentially private SGD (DP-SGD) with Gaussian perturbati…

  2. arXiv stat.ML TIER_1 English(EN) · Puyu Wang, Junyu Zhou, Philipp Liznerski, Marius Kloft ·

    Optimization, Generalization and Differential Privacy Bounds for Gradient Descent on Kolmogorov-Arnold Networks

    arXiv:2601.22409v3 Announce Type: replace-cross Abstract: Kolmogorov--Arnold Networks (KANs) have recently emerged as a structured alternative to standard MLPs, yet a principled theory for their training dynamics, generalization, and privacy properties remains limited. In this pa…

  3. arXiv stat.ML TIER_1 English(EN) · Marius Kloft ·

    Population Risk Bounds for Kolmogorov-Arnold Networks Trained by DP-SGD with Correlated Noise

    We establish the first population risk bounds for Kolmogorov-Arnold Networks (KANs) trained by mini-batch SGD with gradient clipping, covering non-private SGD as well as differentially private SGD (DP-SGD) with Gaussian perturbations that interpolate between independent and tempo…