一项名为C-SUITEBENCH的新基准测试旨在评估多模态大语言模型在企业高管业务场景中的决策能力。该基准测试包含文本和多模态条件，涵盖50个场景和五个决策任务。测试发现，尽管视觉输入通常能提升推理能力，尤其是在风险预测和董事会陈述方面，但在资源受限的分配任务中，视觉输入却会降低所有九个前沿模型（frontier models）的性能。这表明结合视觉信息可能导致信号拥挤（signal crowding），并干扰约束满足（constraint satisfaction），凸显了未来企业AI系统需要选择性接地（selective grounding）策略。 AI
影响 强调了多模态大语言模型在复杂、高风险决策制定中的潜在局限性，并提出需要更细致的整合策略。
排序理由 该集群描述了一个新的学术基准测试以及关于多模态大语言模型能力的研究发现。
AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →
arXiv:2608.05864v1 Announce Type: new Abstract: Large language models are increasingly applied as autonomous decision-making agents. However, in executive business decisions, existing benchmarks are limited to textonly settings. This makes it unclear whether models can perceive v…
Large language models are increasingly applied as autonomous decision-making agents. However, in executive business decisions, existing benchmarks are limited to textonly settings. This makes it unclear whether models can perceive visual business evidence and effectively integrat…