PulseAugur
中
实时 11:17:04
English(EN) WorldOracle: Benchmarking Action-Conditioned World Models against Real-World Executions

WorldOracle 基准测试评估面向动作的世界模型与真实世界数据

研究人员推出了 WorldOracle,这是一个新的基准测试,旨在通过将其预测与真实世界执行进行比较来评估面向动作的世界模型(ACWM)。该基准测试评估 ACWM 在给定相同的初始观察和动作序列的情况下,能够多准确地重现物理后果和任务状态转换。WorldOracle 在四个维度上评估模型:物理状态正确性、交互空间对齐性、关键交互区域保真度以及多视图动作连贯性,利用包含成功和失败结果的、具有长段落的剧集数据集。对七个 ACWM 的实验突显了模型各自的优势和劣势,为推进面向动作的世界模型在操作任务中的应用奠定了基础。 AI

影响 为评估机器人领域的世界模型建立了新标准,有望加速操作任务的进展。

排序理由 该集群描述了一个用于评估 AI 模型的新基准测试和数据集,作为一篇 arXiv 论文发布。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.CV 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

WorldOracle 基准测试评估面向动作的世界模型与真实世界数据

本文如何被排名

Signal score
9 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
该集群描述了一个用于评估 AI 模型的新基准测试和数据集,作为一篇 arXiv 论文发布。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Same-day
Cluster formed today. Ranking reflects the current source set at time of score.

完整方法见我们的编辑标准。

报道来源 [1]

  1. arXiv cs.CV TIER_1 English(EN) · Haoyi Duan, Liliang Chen, Nan Wang, Yang Zhang, Yuhang Lu, Xiaotong Chen, Wei-Cheng Tseng, Shenyuan Gao, Zhaoshuo Li, Jingyi Jin, Pooya Jannaty, Dhruv Shah, Yuke Zhu, Ming-Yu Liu, Maoqing Yao, Guanghui Ren ·

    WorldOracle:将条件动作世界模型与真实世界执行进行基准测试

    arXiv:2610.18826v2 Announce Type: replace-cross Abstract: We introduce WorldOracle, a benchmark specifically designed to evaluate action-conditioned world models (ACWMs) against paired real-world executions. Given the same initial observation and low-level action sequence, WorldO…