一篇新论文提出了一种贝叶斯推理框架，用于审计前沿AI评估的公共档案。研究强调了选择性报告和基准修订如何扭曲对AI进展的认知，并以LiveBench和Open LLM Leaderboard v2作为主要例子。提出的档案和裁决协议旨在重建评估历史，建立经过验证的时间界限，并使关于AI能力的未经证实的说法无效。 AI
影响 提出了一种新的AI评估数据审计框架，有望提高基准结果的透明度和可靠性。
排序理由 该集群包含一篇在arXiv上发表的研究论文，详细介绍了一种评估AI系统的新方法。
AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →
arXiv:2606.17005v1 Announce Type: new Abstract: Public AI evaluations are often read as terminal leaderboards, yet the underlying evidence is a selective time series shaped by reporting rules, benchmark revisions, and missingness. Repeated public archives for LiveBench and Open L…
Public AI evaluations are often read as terminal leaderboards, yet the underlying evidence is a selective time series shaped by reporting rules, benchmark revisions, and missingness. Repeated public archives for LiveBench and Open LLM Leaderboard v2 serve as the primary longitudi…