PulseAugur
EN
LIVE 17:39:44

MolmoMotion predicts 3D object motion from language instructions · 2 sources tracked

Researchers have introduced MolmoMotion, a novel model designed for language-guided 3D motion forecasting. This model predicts the future 3D trajectories of points on an object based on a video frame, initial point positions, and a textual description of the intended action. MolmoMotion significantly outperforms existing methods on a new benchmark, PointMotionBench, and demonstrates utility in downstream applications like robotics and video generation. The project also includes MolmoMotion-1M, a large dataset of 3D trajectories paired with action descriptions, derived from over a million videos. AI

IMPACT Enhances capabilities in robotics and generative AI by enabling more accurate prediction of object motion based on natural language commands.

RANK_REASON Research paper and model release detailing a new approach to 3D motion forecasting.

Read on Hugging Face Daily Papers →

AI-generated summary · Google Gemini · from 3 sources. How we write summaries →

MolmoMotion predicts 3D object motion from language instructions · 2 sources tracked

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
Research paper and model release detailing a new approach to 3D motion forecasting.
Source corroboration
3 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
model release, product, paper
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
101 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.
Coverage growth since scoring
+1 source(s) since last score
New sources have picked up this story since our last re-score. Score will update on the next scoring pass.

Full methodology in our editorial standards.

COVERAGE [3]

  1. Hugging Face Blog TIER_1 English(EN) ·

    MolmoMotion: Language-guided 3D motion forecasting

  2. Hugging Face Daily Papers TIER_1 English(EN) ·

    MolmoMotion: Forecasting Point Trajectories in 3D with Language Instruction

    3D point motion forecasting model predicts object trajectories from visual history and language goals, demonstrating superior performance on benchmarks and transferring effectively to robot manipulation and video generation tasks.

  3. arXiv cs.CV TIER_1 English(EN) · Ranjay Krishna ·

    MolmoMotion: Forecasting Point Trajectories in 3D with Language Instruction

    Motion forecasting is central to visual intelligence: agents must anticipate how objects will move in order to plan actions, reason about physical interactions, and synthesize realistic futures. We argue that 3D points in world coordinates provide a general representation that is…