PulseAugur
实时 06:27:16

新基准评估 AI 代理在可审计的金融研究方面的表现

研究人员推出了 BigFinanceBench,这是一个旨在评估金融研究答案可审计推导的新基准。该基准包含 928 个专家撰写的任务,并附有详细的评分标准,用于评估整个工作流程,而不仅仅是最终输出。对十个领先 AI 代理的初步评估显示,表现最好的代理仅达到评分标准的 58.8%,表明在金融研究能力方面仍有很大的改进空间。 AI

影响 该基准将推动更透明、更可审计的金融研究 AI 代理的开发。

排序理由 该集群包含一篇介绍用于评估 AI 代理的新基准的研究论文。

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →

报道来源 [2]

  1. arXiv cs.AI TIER_1 English(EN) · Alex Wang, Georg Meinhardt, Jacob Katz, Joseph H. Kim, Pratyush K. Chaudhary, Chase Blagden, Eric Xu ·

    BigFinanceBench:一个基于工作流的金融研究代理基准测试

    arXiv:2606.03829v1 Announce Type: new Abstract: Financial-research answers are decision-relevant only when another analyst can audit how they were produced: which source was chosen, which period and accounting definition were used, which assumptions were made, and how the calcula…

  2. arXiv cs.AI TIER_1 English(EN) · Eric Xu ·

    BigFinanceBench:一个基于工作流的金融研究代理基准测试

    Financial-research answers are decision-relevant only when another analyst can audit how they were produced: which source was chosen, which period and accounting definition were used, which assumptions were made, and how the calculation was performed. Existing finance benchmarks …