Researchers have developed a Video-Point Model (VPM) capable of predicting future multi-view videos and 3D point trajectories. This model, detailed in a new paper, conditions on multi-view video histories and language instructions to forecast future videos from various viewpoints and track persistent scene points in 3D. The VPM is supported by a new simulation corpus, VPM-Data, and a forecasting benchmark, VP-WorldBench, demonstrating improvements in video fidelity and 3D motion accuracy, and enhancing robot control capabilities. AI
IMPACT This model could advance robot control and improve the accuracy of 3D scene forecasting in complex environments.
RANK_REASON The cluster contains a research paper detailing a new model and benchmark.
Read on Hugging Face Daily Papers →
AI-generated summary · Google Gemini · from 3 sources. How we write summaries →