PulseAugur
实时 10:48:00
English(EN) A prism hierarchy of learning regimes in large linear autoencoders

新论文分析瓶颈和线性自编码器中的学习机制

研究人员发表了两篇分析自编码器中不同学习机制的论文。一篇论文侧重于具有瓶颈的非线性自编码器,推导出均值场学习动力学,并表明有限网络可以近似无限宽度解决方案。另一篇论文提出了一个理解大型线性自编码器中极端学习机制的框架,确定了五个不同的机制,并推导了其中四个机制的损失演变。 AI

影响 为理解自编码器行为提供了理论基础,可能指导未来的模型开发和优化。

排序理由 arXiv上发表了两篇学术论文,详细介绍了自编码器学习机制的理论分析。

在 arXiv stat.ML 阅读 →

AI 生成摘要 · Google Gemini · 来自 4 个来源。 我们如何撰写摘要 →

报道来源 [4]

  1. arXiv cs.LG TIER_1 English(EN) · Santanu Das, Ramyak Bilas, Pascal Esser, Satyaki Mukherjee ·

    超越线性与过完备模型:瓶颈自编码器的均场分析

    arXiv:2606.07120v1 Announce Type: new Abstract: Autoencoders (AEs) learn low-dimensional representations by mapping data into a latent space while minimizing reconstruction error. Despite their empirical success, theoretical understanding remains limited and largely restricted to…

  2. arXiv cs.LG TIER_1 English(EN) · Satyaki Mukherjee ·

    超越线性与过完备模型:瓶颈自编码器的均场分析

    Autoencoders (AEs) learn low-dimensional representations by mapping data into a latent space while minimizing reconstruction error. Despite their empirical success, theoretical understanding remains limited and largely restricted to linear models or settings without a bottleneck.…

  3. arXiv stat.ML TIER_1 English(EN) · Eugene Golikov, Yaroslav Gusev, Dmitry Yarotsky ·

    大型线性自编码器中的学习范式棱柱分层

    arXiv:2606.05335v1 Announce Type: cross Abstract: Theoretical studies of machine learning models commonly consider different limiting regimes in which the learning dynamics of gradient descent becomes theoretically tractable. It is, however, desirable to have a systematically obt…

  4. arXiv stat.ML TIER_1 English(EN) · Dmitry Yarotsky ·

    大型线性自编码器中的学习范式棱柱分层

    Theoretical studies of machine learning models commonly consider different limiting regimes in which the learning dynamics of gradient descent becomes theoretically tractable. It is, however, desirable to have a systematically obtained picture of all qualitatively different extre…