Video Diffusion Models
PulseAugur coverage of Video Diffusion Models — every cluster mentioning Video Diffusion Models across labs, papers, and developer communities, ranked by signal.
5 day(s) with sentiment data
-
New video world model learns and extrapolates physical dynamics
Researchers have introduced Latent Dynamics Reasoning (LDR), a novel approach for video world models that focuses on learning and extrapolating the underlying dynamics of how scenes evolve. Unlike current video diffusio…
-
New AI framework MirrorWorld enhances video mirror reflection generation
Researchers have developed MirrorWorld, a novel framework designed to improve the generation of realistic mirror reflections in videos using diffusion models. The system addresses the challenges of maintaining scene con…
-
New DAR method enables video models to render 4D scenes
Researchers have developed DAR, a novel approach that enables pretrained video diffusion models to function as 4D renderers. This method conditions these models using an animated mesh, camera trajectory, and a reference…
-
AgentHOI framework generates human-object interaction videos using multi-agent reasoning
Researchers have introduced AgentHOI, a novel framework for generating videos of human-object interactions. This system employs multi-agent reasoning to bridge the gap between textual descriptions and the physical execu…
-
MagicPrompt offers ultra-lightweight tuning for video generation
Researchers have introduced MagicPrompt, a novel framework designed to make video generation models more efficient. This method employs Attention-Embedded Prompt Tuning, which uses significantly fewer parameters than tr…
-
InverseCrafter framework enables efficient video re-capture without VDM fine-tuning
Researchers have introduced InverseCrafter, a novel framework for generating novel views of videos without requiring extensive fine-tuning of pre-trained Video Diffusion Models (VDMs). This approach treats video re-capt…
-
New research tackles diffusion model efficiency and applications · 8 sources tracked
Recent research explores advancements in diffusion models, focusing on improving their efficiency and applicability across various domains. FlashDiff introduces adaptive regional execution and scheduling to reduce servi…
-
New research explores advanced video generation and manipulation with diffusion models
Researchers are exploring advanced techniques to improve video generation and manipulation using diffusion models. One approach involves integrating State Space Models (SSMs) with video diffusion models to enhance effic…
-
NaviCache accelerates video generation with novel self-calibration technique
Researchers have introduced NaviCache, a novel method designed to accelerate video generation by addressing the computational costs associated with Video Diffusion Models (VDMs). Unlike previous approaches that rely on …
-
New REINS method steers video diffusion models to safety without retraining
Researchers have developed a novel training-free method called REINS (REpresentation-space INference-time Safety steering) to align video diffusion models and prevent the generation of unsafe content. This technique wor…
-
New research enhances 3D Gaussian Splatting for efficiency and editing
Researchers are advancing 3D Gaussian Splatting (3DGS) techniques to improve efficiency, accuracy, and editing capabilities. New methods focus on incorporating uncertainty quantification for better active view selection…
-
New SARA method boosts video diffusion model alignment
Researchers have developed SARA, a new method for improving video diffusion models by focusing supervision on semantically relevant parts of the video. This approach uses text-conditioned saliency to determine which tok…
-
Rein3D framework generates consistent 3D indoor scenes using diffusion models
Researchers have developed Rein3D, a new framework for generating detailed 3D indoor scenes. This system uses 3D Gaussian Splatting combined with video diffusion models to reconstruct complete 360-degree environments. R…
-
New benchmark YoCausal tests video models' causal understanding
Researchers have introduced YoCausal, a novel benchmark designed to assess the causal understanding of video diffusion models (VDMs). The benchmark, inspired by cognitive science principles, uses temporally reversed rea…
-
DexSIM framework enables real-time dexterous hand-object simulation
Researchers have developed DexSIM, a novel framework for real-time simulation of dexterous hand-object interactions using a unified causal video diffusion model. This system addresses limitations in existing methods by …
-
New research enhances video generation control and efficiency
Researchers are developing new methods to improve video generation models, focusing on control, efficiency, and quality. One approach, LA-LQR, uses optimal control to steer video generation models, reducing undesired co…
-
New PREX framework enables faithful 4D video editing
Researchers have developed PREX, a novel framework for faithful 4D video editing that addresses the challenge of preserving original regions while synthesizing new content. The method identifies and corrects an "Evidenc…
-
New methods boost video diffusion model efficiency and quality
Researchers are developing new methods to improve the efficiency and quality of video diffusion models. Several papers introduce techniques to optimize attention mechanisms, such as sparse attention (LVSA, Veda) and lin…
-
New Diffusion-APO method aligns video diffusion models with user intent
Researchers have introduced Diffusion-APO, a new method for aligning video diffusion models with human preferences. This approach addresses the gap between training noise distributions and real-world inference by synchr…
-
New research explores 3D consistency, LoRA transferability, and unified frameworks for video diffusion models.
Researchers have developed new methods to improve video generation using diffusion models. One approach, Geometry Forcing, integrates 3D representations with video diffusion models to enhance geometric consistency and v…