一篇新发表在arXiv上的论文提出了一个评估基础模型研究的框架，将其视为一个因果推断问题。作者认为，对大型模型进行受控实验的高昂成本，使得必须采用节省成本的策略，如代理实验、标度律和观察性研究。然而，这些方法引入了可能削弱研究结论的有效性威胁。所提出的框架基于统计有效性、内部有效性、外部有效性和构建有效性来评估这些策略，并强调了每种方法固有的权衡。 AI
影响 强调了当前基础模型研究方法论中潜在的缺陷，呼吁更严格的评估框架。
排序理由 该集群包含一篇讨论基础模型研究方法论和有效性威胁的研究论文。[lever_c_demoted from research: ic=1 ai=1.0]
AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →
arXiv:2606.05029v1 Announce Type: cross Abstract: Controlled experiments are the backbone of machine learning research, but at the scale of modern foundation models, they have become prohibitively expensive. Instead, the community increasingly relies on research strategies that a…
Controlled experiments are the backbone of machine learning research, but at the scale of modern foundation models, they have become prohibitively expensive. Instead, the community increasingly relies on research strategies that approximate the ideal experiment at a fraction of t…