PulseAugur
实时 16:43:37
English(EN) The paper that killed deep learning theory

论文通过泛化界批评挑战深度学习理论

讨论了两篇论文,一篇是2016年由Zhang等人发表的,另一篇是2019年由Nagarajan和Kolter发表的,它们对深度学习理论产生了影响。2016年的论文表明,标准神经网络可以轻松记住随机数据,挑战了基于假设类复杂度的现有泛化理论。随后的研究试图开发依赖于数据的界限,但2019年的论文被认为是对此类努力的又一次打击,表明一致收敛可能不足以解释深度学习的成功。 AI

影响 挑战了理解深度学习泛化的现有理论框架,可能重定向未来的研究方向。

排序理由 该集群讨论了学术论文及其对深度学习的理论意义。

在 LessWrong (AI tag) 阅读 →

AI 生成摘要 · Google Gemini · 来自 4 个来源。 我们如何撰写摘要 →

论文通过泛化界批评挑战深度学习理论

报道来源 [4]

  1. Alignment Forum TIER_1 English(EN) · LawrenceC ·

    The other paper that killed deep learning theory

    <p><a href="https://www.lesswrong.com/posts/ZvQfcLbcNHYqmvWyo/the-paper-that-killed-deep-learning-theory" rel="noreferrer"><span>Yesterday, I wrote about the state of deep learning theory circa 2016</span></a><span>,</span><span class="footnote-reference" id="fnref6tductjpc8f"><s…

  2. Alignment Forum TIER_1 English(EN) · LawrenceC ·

    The paper that killed deep learning theory

    <p><span>Around 10 years ago, a paper came out that arguably killed classical deep learning theory: Zhang et al.'s aptly titled </span><i><span>Understanding deep learning requires rethinking generalization</span></i><span>.</span></p><p><span>Of course, this is a bit of an exagg…

  3. LessWrong (AI tag) TIER_1 English(EN) · LawrenceC ·

    The other paper that killed deep learning theory

    <p><a href="https://www.lesswrong.com/posts/ZvQfcLbcNHYqmvWyo/the-paper-that-killed-deep-learning-theory" rel="noreferrer"><span>Yesterday, I wrote about the state of deep learning theory circa 2016</span></a><span>,</span><span class="footnote-reference" id="fnref6tductjpc8f"><s…

  4. LessWrong (AI tag) TIER_1 English(EN) · LawrenceC ·

    The paper that killed deep learning theory

    <p><span>Around 10 years ago, a paper came out that arguably killed classical deep learning theory: Zhang et al.'s aptly titled </span><i><span>Understanding deep learning requires rethinking generalization</span></i><span>.</span></p><p><span>Of course, this is a bit of an exagg…