PulseAugur
EN
LIVE 21:26:27

New CRONOS benchmark reveals video models lack physical consistency

By PulseAugur Editorial · [3 sources] ·

Researchers have introduced CRONOS, a new benchmark designed to test the physical consistency of video generation models. This benchmark, built in Unreal Engine, evaluates how well models predict physical events when visual inputs like scene context, viewpoint, and object appearance are altered. Initial evaluations using CRONOS revealed that current open-source video generation models struggle with counterfactual physical consistency, showing degraded performance when conditions change. AI

IMPACT Establishes a new standard for evaluating the physical reasoning capabilities of video generation models.

RANK_REASON The cluster contains a research paper introducing a new benchmark for evaluating AI models.

Read on Hugging Face Daily Papers →

AI-generated summary · Google Gemini · from 3 sources. How we write summaries →

COVERAGE [3]

  1. Hugging Face Daily Papers TIER_1 English(EN) ·

    CRONOS: Benchmarking Counterfactual Physical Consistency in Video Models

    CRONOS is a benchmark for evaluating counterfactual physical consistency in video prediction models through controlled interventions in viewpoint, scene, object category, and appearance while maintaining fixed physical event types.

  2. arXiv cs.CV TIER_1 English(EN) · Le\'on Begiristain, Olaf D\"unkel, Adam Kortylewski ·

    CRONOS: Benchmarking Counterfactual Physical Consistency in Video Models

    arXiv:2605.23699v1 Announce Type: new Abstract: Video prediction is increasingly viewed as a path toward generalizable world models, yet it remains unclear whether these systems learn underlying causal structure or merely exploit superficial visual correlations for future predict…

  3. arXiv cs.CV TIER_1 English(EN) · Adam Kortylewski ·

    CRONOS: Benchmarking Counterfactual Physical Consistency in Video Models

    Video prediction is increasingly viewed as a path toward generalizable world models, yet it remains unclear whether these systems learn underlying causal structure or merely exploit superficial visual correlations for future prediction. We introduce CRONOS, an intervention-based …

RELATED ENTITIES

RELATED TOPICS