PulseAugur
中
实时 22:14:24

New benchmark reveals vision-language models struggle with temporal glitches

作者 PulseAugur 编辑部 · [2 个来源] ·

Researchers have introduced TempGlitch, a new benchmark designed to evaluate how well vision-language models (VLMs) can detect temporal glitches in gameplay videos. Unlike previous methods that focused on static visual anomalies, TempGlitch specifically tests the models' ability to identify issues that only become apparent when observing changes across sequential frames. Initial evaluations of 12 different VLMs revealed that current models perform poorly, often struggling to distinguish between actual glitches and normal gameplay, indicating a significant gap in their temporal reasoning capabilities. AI

影响 Highlights a critical gap in current vision-language models' ability to understand temporal dynamics, potentially guiding future research in AI for game quality assurance.

排序理由 The cluster contains an academic paper introducing a new benchmark for evaluating AI models.

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →

报道来源 [2]

  1. arXiv cs.AI TIER_1 English(EN) · Yakun Yu, Ashley Wiens, Adri\'an Barahona-R\'ios, Benedict Wilkins, Saman Zadtootaghaj, Nabajeet Barman, Cor-Paul Bezemer ·

    TempGlitch: Evaluating Vision-Language Models for Temporal Glitch Detection in Gameplay Videos

    arXiv:2605.21443v1 Announce Type: cross Abstract: Vision-language models (VLMs) are increasingly being explored for video game quality assurance, especially gameplay glitch detection. Most existing evaluations, however, treat glitches as static visual anomalies, asking models to …

  2. arXiv cs.AI TIER_1 English(EN) · Cor-Paul Bezemer ·

    TempGlitch: Evaluating Vision-Language Models for Temporal Glitch Detection in Gameplay Videos

    Vision-language models (VLMs) are increasingly being explored for video game quality assurance, especially gameplay glitch detection. Most existing evaluations, however, treat glitches as static visual anomalies, asking models to detect failures from a single frame. We argue that…

相关实体

相关话题