PulseAugur
中
实时 06:05:38
English(EN) We logged 621k changes from 127k papers' ablations: 26% didn't help by the papers' own numbers [P]

研究:26% 的机器学习论文变更未能改善结果

一项对 2016 年至 2026 年间发表的 126,758 篇机器学习和视觉论文的分析发现,相当一部分报告的变更并未带来改进。在记录的 621,000 多项变更中,根据论文自身的指标,有 26% 的变更没有带来帮助,其中较高的采样温度和较大的 LoRA 秩是经常无益的修改。Latentic Labs 进行的研究强调,66% 的论文报告了至少一项没有做出积极贡献的变更。 AI

影响 强调了机器学习研究中潜在的可复现性问题以及常见实验修改的有效性。

排序理由 对已发表的机器学习论文及其报告的实验变更的分析。[lever_c_demoted from research: ic=1 ai=1.0]

在 r/MachineLearning 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

研究:26% 的机器学习论文变更未能改善结果

本文如何被排名

Signal score
16 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
对已发表的机器学习论文及其报告的实验变更的分析。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

  1. r/MachineLearning TIER_1 English(EN) · /u/latenticlabs ·

    我们记录了来自 127k 篇论文消融实验的 621k 项变更:根据论文自身数据,26% 的变更并未带来帮助 [P]

    <!-- SC_OFF --><div class="md"><p>Follow-up to the scime atlas posts from earlier this month. We read 126,758 papers in full (ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV, ECCV, TPAMI, IJCV, JMLR, 2016–2026) and extracted every change a paper added and measured (a layer, a loss, more da…