PulseAugur
中
实时 14:16:38
English(EN) 4Director: Controlling Video World Models with Rigid 3D Geometry

新AI模型提供对三维视频生成和动力学的增强控制

研究人员正在探索控制和理解视频生成的新方法。一种方法,Generative Cinematographer (GenCine),允许艺术家通过指定路径和使用局部三维运动手柄来创作三维摄像机和物体运动。另一项开发,4Director,使用具有重建网格的显式四维场景表示来实现对摄像机和物体运动的精确控制,优于先前的方法。此外,DynaTokens 提供了一种轻量级的方法,通过使用可学习的场景特定令牌来教授现有摄像机控制视频模型动力学,从而改善了动力学和摄像机控制之间的权衡。Reimagine Video Dynamics (RVD) 专注于通过将可编辑的动力学令牌与视觉上下文分离来编辑视频动力学,从而实现场景演变的直接操作。 AI

影响 这些进步为视频创作和编辑提供了更大的控制力和新功能,可能对电影制作和内容生成产生影响。

排序理由 arXiv上发表了多篇研究论文,详细介绍了视频生成和操作的新方法和框架。

在 Hugging Face Daily Papers 阅读 →

AI 生成摘要 · Google Gemini · 来自 9 个来源。 我们如何撰写摘要 →

新AI模型提供对三维视频生成和动力学的增强控制

本文如何被排名

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
arXiv上发表了多篇研究论文,详细介绍了视频生成和操作的新方法和框架。
Source corroboration
9 independent sources
Strong cross-source corroboration — multiple independent publishers covered this within the clustering window.
Topics
model release, product, paper
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
54 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

报道来源 [9]

  1. arXiv cs.LG TIER_1 English(EN) · Wenjie Wang, Yuanyuan Wang, Zixiang Jiang, Shaoan Xie, Mingming Gong ·

    视频中非线性标量动力学的参数:不变性、校准和可辨识性

    arXiv:2609.38877v1 Announce Type: new Abstract: Physical parameter estimation from video aims to recover the parameters of a known family of governing dynamical equations from pixel observations. Existing identifiability theory for this setting has focused on linear time-invarian…

  2. arXiv cs.AI TIER_1 English(EN) · Jiahan Zhang, Chaohao Yang, Namitha Guruprasad, Vivekjyoti Banerjee, Trong-Tung Nguyen, Alan Yuille, Anand Bhattad ·

    生成式电影摄影师:在3D中构图摄影机和物体运动

    arXiv:2610.02180v1 Announce Type: cross Abstract: Current controllable video generation systems often rely on 2D motion trajectories or sparse drag signals for object motion. These controls are ambiguous because the same 2D trajectory can correspond to different 3D motions, espec…

  3. arXiv cs.AI TIER_1 English(EN) · Chia-Hsiang Kao, Belinda Zeng, Bharath Hariharan, Menglin Jia ·

    通过时空类比统一视频任务

    arXiv:2609.33935v2 Announce Type: replace-cross Abstract: Adapting video models to new tasks typically requires dedicated data curation and fine-tuning. While visual analogy provides a training-free alternative by specifying tasks in-context, it remains restricted to the image do…

  4. arXiv cs.AI TIER_1 English(EN) · Ziqi Zhou, Yujian Yuan, Laura Sevilla-Lara ·

    揭示运动对电影摄影机轨迹的价值

    arXiv:2609.38683v1 Announce Type: cross Abstract: Cinematic camera motion is a fundamental storytelling tool, defined not only by where the camera is positioned in the scene, but also by how it moves in terms of direction and speed. Recent work on camera trajectory generation and…

  5. Hugging Face Daily Papers TIER_1 English(EN) ·

    4Director:用刚性3D几何控制视频世界模型

    Precise control over camera and object motion is essential for professional video production. Existing methods control objects only coarsely, through image-plane cues that are ambiguous in depth and rotation or through 3D tracks and blobs that lack complete geometry and lose cons…

  6. Hugging Face Daily Papers TIER_1 English(EN) ·

    DynaTokens:在测试时为相机控制的视频模型教授动态

    Video generation must account for two sources of motion, one induced by the observer's camera path and the other caused by scene dynamics. An ideal camera-controlled video model should account for both motions: let users move the camera while evolving the scene dynamics. While cu…

  7. arXiv cs.CV TIER_1 English(EN) · Wei Cao, Hao Zhang, Vikram Voleti, Yuqun Wu, Mallikarjun B R, Shimon Vainer, Mark Boss, Yaoyao Liu ·

    4Director:用刚性3D几何控制视频世界模型

    arXiv:2610.02160v1 Announce Type: new Abstract: Precise control over camera and object motion is essential for professional video production. Existing methods control objects only coarsely, through image-plane cues that are ambiguous in depth and rotation or through 3D tracks and…

  8. arXiv cs.CV TIER_1 Italiano(IT) · Yu Yuan, Yawen Lu, Guoxian Song, Kevin Duarte, Ratheesh Kalarot, Di Chang, Xijun Wang, Stanley H. Chan ·

    重塑视频动态

    arXiv:2609.36496v1 Announce Type: new Abstract: Most video editing methods focus on changing the appearance of the source video, while offering limited control over its dynamics. We introduce Reimagine Video Dynamics (RVD), a framework that disentangles a compact, editable dynami…

  9. Mastodon — mastodon.social TIER_1 English(EN) · [email protected] ·

    SOMNIA:从AI视频中重建渲染器状态 在从未拥有过渲染指导的合成素材中恢复时间渲染指导的实操实验

    SOMNIA: Reconstructing Renderer State From AI Video An operational experiment in recovering temporal rendering guidance from synthetic footage that never had a renderer https://youtu.be/PGwVhuuKol0 On October 3, 2026, Black Sail Studio completed the first end-to-end run of SOMNIA…