Video Diffusion Models
PulseAugur coverage of Video Diffusion Models — every cluster mentioning Video Diffusion Models across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
DSAQuant framework improves video diffusion model quantization
Researchers have developed DSAQuant, a new framework for Quantization-Aware Training (QAT) specifically designed for Video Diffusion Models (VDMs). Existing QAT methods struggle with VDMs, often degrading visual details…
-
Video diffusion models scale effectively with training exposure, study finds
Researchers have conducted a comprehensive scaling-law analysis of video diffusion models specifically for autonomous driving applications. Their study, which involved models ranging from 1 million to 9 billion paramete…
-
AI advances tackle video generation consistency and speed
Recent research in AI-driven video generation focuses on improving consistency and efficiency. ContextAnyone addresses character consistency by treating reference images as explicit anchors within a shared diffusion tra…
-
DreamHand framework repurposes video diffusion models for 3D hand motion recovery
Researchers have developed DreamHand, a new framework that repurposes video diffusion models for improved 3D hand motion recovery from egocentric video. This method addresses challenges like object occlusion and hands l…
-
AvatarDynamizer transforms static 3D avatars into dynamic 4D versions
Researchers have developed AvatarDynamizer, a novel generative method designed to transform static 3D avatars into dynamic, realistic, and multi-view-consistent 4D avatars. This approach tackles the limitations of exist…
-
AnyTalk uses video diffusion models for 3D speech animation
Researchers have developed AnyTalk, a new method for creating 3D speech animations for arbitrary characters without needing existing animation data. This approach adapts pre-trained video diffusion models through a proc…
-
New video world model extrapolates physics laws with fewer parameters
Researchers have developed Latent Dynamics Reasoning (LDR), a novel approach to video world models that integrates kinematic dynamics into a structured latent space. This method allows models to extrapolate physical law…
-
New AI methods tackle video reflection removal and generation · 4 sources tracked
Researchers have developed novel methods for handling reflections in videos, addressing challenges in both removing unwanted reflections and generating realistic mirror reflections. One approach, S2R-Synthesis, uses phy…
-
New DAR method enables video models to render 4D scenes
Researchers have developed DAR, a novel approach that enables pretrained video diffusion models to function as 4D renderers. This method conditions these models using an animated mesh, camera trajectory, and a reference…
-
AgentHOI framework generates human-object interaction videos using multi-agent reasoning
Researchers have introduced AgentHOI, a novel framework for generating videos of human-object interactions. This system employs multi-agent reasoning to bridge the gap between textual descriptions and the physical execu…
-
MagicPrompt offers ultra-lightweight tuning for video generation
Researchers have introduced MagicPrompt, a novel framework designed to make video generation models more efficient. This method employs Attention-Embedded Prompt Tuning, which uses significantly fewer parameters than tr…
-
InverseCrafter framework enables efficient video re-capture without VDM fine-tuning
Researchers have introduced InverseCrafter, a novel framework for generating novel views of videos without requiring extensive fine-tuning of pre-trained Video Diffusion Models (VDMs). This approach treats video re-capt…
-
New research tackles diffusion model efficiency and applications · 8 sources tracked
Recent research explores advancements in diffusion models, focusing on improving their efficiency and applicability across various domains. FlashDiff introduces adaptive regional execution and scheduling to reduce servi…
-
New research explores advanced video generation and manipulation with diffusion models
Researchers are exploring advanced techniques to improve video generation and manipulation using diffusion models. One approach involves integrating State Space Models (SSMs) with video diffusion models to enhance effic…
-
NaviCache accelerates video generation with novel self-calibration technique
Researchers have introduced NaviCache, a novel method designed to accelerate video generation by addressing the computational costs associated with Video Diffusion Models (VDMs). Unlike previous approaches that rely on …
-
New REINS method steers video diffusion models to safety without retraining
Researchers have developed a novel training-free method called REINS (REpresentation-space INference-time Safety steering) to align video diffusion models and prevent the generation of unsafe content. This technique wor…
-
New research enhances 3D Gaussian Splatting for efficiency and editing
Researchers are advancing 3D Gaussian Splatting (3DGS) techniques to improve efficiency, accuracy, and editing capabilities. New methods focus on incorporating uncertainty quantification for better active view selection…
-
New SARA method boosts video diffusion model alignment
Researchers have developed SARA, a new method for improving video diffusion models by focusing supervision on semantically relevant parts of the video. This approach uses text-conditioned saliency to determine which tok…
-
Rein3D framework generates consistent 3D indoor scenes using diffusion models
Researchers have developed Rein3D, a new framework for generating detailed 3D indoor scenes. This system uses 3D Gaussian Splatting combined with video diffusion models to reconstruct complete 360-degree environments. R…
-
New benchmark YoCausal tests video models' causal understanding
Researchers have introduced YoCausal, a novel benchmark designed to assess the causal understanding of video diffusion models (VDMs). The benchmark, inspired by cognitive science principles, uses temporally reversed rea…