PulseAugur
中
实时 09:44:10
English(EN) DAYJOB: A Benchmark for Long-Horizon Professional Work

新的DAYJOB基准测试揭示AI在长时程专业任务上面临挑战

作者 PulseAugur 编辑部 · [1 个来源] ·

一项名为DAYJOB的新基准测试已被开发出来，用于评估AI代理在长时程专业任务中的表现，特别是在医疗保健和金融领域。该基准测试包含130项任务，每项任务平均需要人类专业人士花费13.6至16.6小时才能完成。即使是像Claude Opus 5.5这样先进的模型也表现不佳，仅能完成约24%的医疗保健和金融任务，这表明AI在复杂、多步骤的专业工作中面临重大挑战。研究人员发现，代理模型经常接受有缺陷的前提，并在其分析中传播错误。 AI

影响 凸显了当前AI在复杂、多步骤专业任务方面的显著局限性，表明需要改进推理和错误处理能力。

排序理由 该集群描述了一个用于AI评估的新基准测试，该测试发表在一篇arXiv论文中。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

新的DAYJOB基准测试揭示AI在长时程专业任务上面临挑战

本文如何被排名

Signal score
13 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
该集群描述了一个用于AI评估的新基准测试，该测试发表在一篇arXiv论文中。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

  1. arXiv cs.AI TIER_1 English(EN) · Stephanie Finley, Liudas Panavas, Thomas Mikkelson, Cam Hinton, Stacey Ganss, Bradley Monton, Emily Kendall, Michelle Spradlin, Lydia Bye, Michael O'Brien, Lauren Ylvisaker, Derek Ray, Suhaas Garre, Sushant Mehta, Edwin Chen ·

    DAYJOB：一个用于长时程专业工作的基准测试

    arXiv:2610.01306v1 Announce Type: new Abstract: Professional work often starts with a brief request that leaves the professional to work out what is needed, which documents matter, and whether the request's premise holds. We introduce DAYJOB, a benchmark of 130 tasks built by pro…

相关实体

相关话题