Probing into Camera Control of Video Models
Researchers have developed a novel method to control camera movements in video generation models by treating camera control as geometric guidance rather than an implicit mapping problem. This approach reformulates camera control into displacement fields applied via differentiable resampling of latent features during denoising. The technique effectively controls camera movement with minimal degradation and can be applied to most video diffusion models without additional training, serving as a probe to study their inherent camera control capabilities and biases. AI
IMPACT Enables better geometric control in video generation and provides a tool to analyze existing models' capabilities.