Researchers have developed Off-Manifold Refinement (OMR), a novel inference-time technique designed to improve the physical consistency of video generators. OMR injects feedback from a frozen world model directly into the sampling trajectory of a video generator. This method augments the generator's velocity with the gradient of an adapter-space V-JEPA 2.1 surprise energy, guiding the latent representation towards more physically plausible regions. The approach demonstrated a 5.0 percentage point absolute increase in the joint Semantic-Adherence-and-Physical-Commonsense metric on the VideoPhy-2 dataset, while only slightly increasing runtime compared to other methods. AI
IMPACT Enhances physical realism in generated videos without significant computational overhead.
RANK_REASON The cluster contains a research paper detailing a new method for improving video generation models. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →