PulseAugur
中
实时 13:55:15
English(EN) VibeVideoBench:Evaluating Multimodal Agents on Code-Driven Video Generation

新的VibeVideoBench基准评估驱动代码的视频生成代理

引入了一个名为VibeVideoBench的新基准,用于评估多模态代理从代码生成视频的能力。该基准包含12个类别共239个任务,要求代理在一小时内生成带声音的MP4视频。初步评估显示,尽管GPT-6 Astra和Claude Opus 5.5等领先代理表现最佳,但它们仍有相当一部分任务失败,许多失败归因于渲染延迟或任务从未开始。该基准的评估是分层的,包括程序检查、评分卡检查以及VLMs和人类偏好的质量评估。 AI

影响 该基准将推动多模态AI代理在复杂视频生成任务方面的改进。

排序理由 该集群描述了一篇介绍用于评估AI模型基准的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.CV 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

新的VibeVideoBench基准评估驱动代码的视频生成代理

本文如何被排名

Signal score
7 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
该集群描述了一篇介绍用于评估AI模型基准的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Same-day
Cluster formed today. Ranking reflects the current source set at time of score.

完整方法见我们的编辑标准。

报道来源 [1]

  1. arXiv cs.CV TIER_1 English(EN) · Muxi Diao, Wenbin Xu, Lele Yang, Xuyang Ma, Yuzhe Chen, Jiankang Chen, Kaiyu Jiang, Changyi Liu, Haoyu Zhang, Hongyi Fu, Jianxiong Wang, Tianke Zhang, Haonan Fan, Yingxin Li, Bingyi Li, Xu Wang, Xuanyu Zheng, Bin Wen, Tingting Gao, Han Li, Wentao Zhang, … ·

    VibeVideoBench:评估代码驱动视频生成的多模态代理

    arXiv:2610.35864v1 Announce Type: new Abstract: Diffusion video models produce striking clips, but they cannot reliably render an exact formula, a correct chart, a ruleconsistent game or narration synchronized to on-screen events. A different route is emerging: multimodal agents …