研究人员开发了一种用于视频世界模型的新方法，该方法将3D场景信息直接存储在扩散潜在空间中，无需进行像素空间重建。这种名为Mirage的方法显著降低了计算开销和内存使用量，从而实现了更快的视频生成。实验表明，与现有方法相比，该方法在生成速度和内存占用方面都有显著改进，同时在WorldScore等基准测试中也取得了最先进的性能。 AI
影响 这项技术可以实现更高效、更快速地生成视频中的复杂3D场景，对虚拟现实和内容创作等领域产生影响。
排序理由 该集群包含两篇详细介绍视频世界模型新方法的学术论文。
在 Hugging Face Daily Papers 阅读 →
AI 生成摘要 · Google Gemini · 来自 5 个来源。 我们如何撰写摘要 →
arXiv:2606.07687v1 Announce Type: cross Abstract: Video world models are increasingly used to provide predictive visual representations, yet it remains unclear which pretraining signals induce action-relevant structure in their latent spaces. We study this question through a unif…
Video world models that maintain 3D spatial consistency across generated frames typically rely on explicit point cloud memory constructed in RGB space. This design is both computationally expensive, requiring repeated rendering and VAE encoding, and inherently lossy, as the round…
Latent spatial memory for video world models stores 3D scene information directly in diffusion latent space, eliminating pixel-space reconstruction overhead and achieving faster generation with reduced memory usage.
arXiv:2606.09828v1 Announce Type: new Abstract: Video world models that maintain 3D spatial consistency across generated frames typically rely on explicit point cloud memory constructed in RGB space. This design is both computationally expensive, requiring repeated rendering and …
Video world models that maintain 3D spatial consistency across generated frames typically rely on explicit point cloud memory constructed in RGB space. This design is both computationally expensive, requiring repeated rendering and VAE encoding, and inherently lossy, as the round…