Phys4D: Fine-Grained Physics-Consistent 4D Modeling from Video Diffusion
Researchers have developed Phys4D, a novel pipeline designed to enhance the physical consistency of 4D world representations generated by video diffusion models. The system employs a three-stage training process, beginning with pseudo-supervised pretraining for geometry and motion, followed by physics-grounded supervised fine-tuning using simulation data, and concluding with reinforcement learning to correct residual physical inconsistencies. Phys4D aims to improve spatiotemporal and physical coherence beyond appearance-based metrics, maintaining strong generative capabilities. AI
IMPACT Introduces a method to improve the physical realism of AI-generated 4D world models.