PulseAugur
实时 15:53:06
English(EN) Do Video-LLMs Actually Watch? Diagnosing Character-Tracking Failures in Long-Form Video

视频大语言模型在基准测试得分的情况下仍无法跟踪角色

一项发表在arXiv上的新研究表明,当前的视频大语言模型(Video-LLMs)在长视频中准确跟踪角色的能力方面存在困难。尽管在InfiniBench的全局外观任务等基准测试中表现强劲,但模型常常无法识别特定角色,尤其是在区分同性别的个体时。研究表明,这些模型依赖于性别等表面线索,而不是深层的角色识别,导致在开放式提问或角色名称更改时准确率显著下降。 AI

影响 揭示了当前视频大语言模型的局限性,表明需要改进超越表面线索的角色跟踪机制。

排序理由 该集群包含一篇详细介绍视频大语言模型能力研究结果的学术论文。

在 arXiv cs.CV 阅读 →

AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →

视频大语言模型在基准测试得分的情况下仍无法跟踪角色

报道来源 [3]

  1. arXiv cs.AI TIER_1 English(EN) · Mohammad Al-Ratrout, Shayla Sharmin, Aditya Raikwar, Roghayeh Leila Barmaki ·

    Do Video-LLMs Actually Watch? Diagnosing Character-Tracking Failures in Long-Form Video

    arXiv:2607.11078v1 Announce Type: cross Abstract: Can a Video Large Language Model (Video-LLM) follow one person through a long video, keeping track of who they are well enough to report, in order, how their outfit changes across a full TV episode? Benchmarks increasingly score t…

  2. Hugging Face Daily Papers TIER_1 English(EN) ·

    Do Video-LLMs Actually Watch? Diagnosing Character-Tracking Failures in Long-Form Video

    Can a Video Large Language Model (Video-LLM) follow one person through a long video, keeping track of who they are well enough to report, in order, how their outfit changes across a full TV episode? Benchmarks increasingly score this kind of task, and the strongest open-source 7-…

  3. arXiv cs.CV TIER_1 English(EN) · Roghayeh Leila Barmaki ·

    视频大模型真的在看吗?诊断长视频中的角色追踪失败问题

    Can a Video Large Language Model (Video-LLM) follow one person through a long video, keeping track of who they are well enough to report, in order, how their outfit changes across a full TV episode? Benchmarks increasingly score this kind of task, and the strongest open-source 7-…