τ0-WM: The Largest Open-Source Embodied World Model for Pre-training is Here
Researchers have introduced τ0-World Model (τ0-WM), an open-source embodied world model trained on a massive 30,000 hours of data, with a significant portion (17,800 hours) derived from real robot teleoperation. This model goes beyond predicting future states by incorporating Test-Time Computation, allowing robots to evaluate and select optimal actions before execution, even correcting for potential errors. τ0-WM demonstrates improved performance on complex manipulation tasks compared to previous models, challenging the conventional approach of reserving real-world data solely for fine-tuning. AI
IMPACT Sets a new precedent for large-scale pre-training with real-world robot data, potentially accelerating embodied AI development.