English(EN) FINCOSMOS: An Open-World Evaluation Paradigm for Agents in Finance

FINCOSMOS：新的开放世界基准测试金融领域AI智能体

作者 PulseAugur 编辑部 · [1 个来源] · 2026-11-06 05:00

研究人员推出FINCOSMOS，一个旨在评估AI智能体在开放世界金融任务中表现的新型评估框架。与限制环境的现有基准测试不同，FINCOSMOS模拟了一个具有隐藏策略的用户，要求智能体独立从网络收集数据、进行时间感知回测并提供可验证的结果。对四个编码智能体和一个不使用工具的模型进行的初步测试显示，失败率很高，人类专家将88.33%的失败归因于智能体本身，凸显了在实际金融应用中的挑战。 AI

影响凸显了AI智能体在金融等复杂实际任务中的可靠性方面存在的关键差距，需要更强大的评估方法。

排序理由该项目是一篇研究论文，介绍了一种新的AI智能体评估范式。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 17 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该项目是一篇研究论文，介绍了一种新的AI智能体评估范式。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, product; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.AI TIER_1 English(EN) · Yupeng Cao, Xueqing Peng, Lingfei Qian, Haohang Li, Yangyang Yu, Anke Xu, Wenbo Cao, Yan Wang, Yuechen Jiang, Yuyan Wang, Zhuohan Xie, Yankai Chen, Zehan Li, Jimin Huang, Xue Liu, Jian-Yun Nie, Sophia Ananiadou · 2026-11-06 05:00

FINCOSMOS：金融领域智能体开放世界评估范式

arXiv:2611.07464v1 Announce Type: new Abstract: Language agents increasingly work for users on the open Web, and finance is where trusting them is hardest. The data must come from the Web, the strategy lives in the user's head, and correctness depends on time, so an agent can fai…

本文如何被排名

报道来源 [1]

FINCOSMOS：金融领域智能体开放世界评估范式

相关实体

相关话题