English(EN) Modality Maturity Index: A benchmark for assessing multimodal capabilities of omni models

新的MMI基准揭示了前沿大型语言模型低下的多模态能力

作者 PulseAugur 编辑部 · [1 个来源] · 2026-08-28 04:00

研究人员推出了模态成熟度指数（MMI），这是一个旨在评估大型语言模型在文本、图像、音频、视频和文档五种模态下的多模态能力的新基准。MMI基准包含893个问题，要求模型处理多种输入模态并生成包含各种输出格式的响应。对五种前沿多模态模型的初步测试显示，模态存在得分（MPS）较低，Claude Opus 4.6得分为15.6，GPT-5.4得分为34.9，这表明在生成预期的输出模态方面存在显著限制。 AI

影响该基准通过突出模型在各种格式的输出生成方面当前的局限性，可能会推动多模态AI的改进。

排序理由该集群包含一篇介绍AI模型评估新基准的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 24 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该集群包含一篇介绍AI模型评估新基准的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, model release; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.AI TIER_1 English(EN) · Rohit Patel, Dieuwke Hupkes, Sloan Strader · 2026-08-28 04:00

模态成熟度指数：评估全能模型多模态能力的基准

arXiv:2608.26317v1 Announce Type: cross Abstract: Frontier language models are increasingly marketed as omni systems that can perceive and respond across modalities. Existing evaluation frameworks, however, focus almost exclusively on bimodal understanding, typically text plus on…

本文如何被排名

报道来源 [1]

模态成熟度指数：评估全能模型多模态能力的基准

相关实体

相关话题