PulseAugur
中
实时 07:43:53
English(EN) SciWorkBench: A Benchmark for Real Scientific Workflows

新的SciWorkBench基准测试揭示AI代理在真实科学工作流中面临挑战

研究人员推出了SciWorkBench,这是一个旨在评估AI代理在生物学、化学、材料科学和物理学等多个学科中完成复杂科学研究任务的能力的新基准测试。该基准测试使用源自同行评审文献和专家贡献的真实场景构建。使用Claude Code和Codex框架内的代理进行的初步评估显示,即使是表现最好的代理也仅获得57.38%的分数,这凸显了当前AI在科学工作流中面临的重大挑战,特别是在将知识转化为程序、整合证据和自我纠正方面。 AI

影响 强调了当前AI代理在复杂科学任务中的局限性,表明需要改进推理和自我纠正能力。

排序理由 该条目描述了一个新的基准测试以及对用于科学工作流的AI代理的评估,已在arXiv上发布。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

新的SciWorkBench基准测试揭示AI代理在真实科学工作流中面临挑战

本文如何被排名

Signal score
28 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
该条目描述了一个新的基准测试以及对用于科学工作流的AI代理的评估,已在arXiv上发布。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

  1. arXiv cs.AI TIER_1 English(EN) · Yuchen Zhang, Taolin Han, Jinghang Wang, Jinxin Wang, Yun Wu, Wai Yuet Chiu, Xiaogang Li, Yuting Fu, Kewei Sun, Jiaxin Li, Qile Jin, Jiajia Li, Ruodan Chen, Qingteng Chen, Jialu Nie, Junchao Li, Yifei Zhang, Chen Zhao, Hu Wei, Lin Qu, Yanni Yin, Bing Zhao ·

    SciWorkBench:真实科学工作流的基准测试

    arXiv:2611.22490v1 Announce Type: new Abstract: Language models are increasingly being used as agents capable of planning and executing projects, as well as refining their actions through feedback. This shift raises a question: can current agents complete projects like real scien…