Researchers have developed LiveLight, a novel diffusion-based framework designed for real-time video relighting with interactive 3D lighting control. The system addresses challenges in integrating dynamic lighting into diffusion models, maintaining quality at low inference budgets, and enabling continuous streaming. Key innovations include a lightweight adapter for Multi-Plane Light Irradiance (MPLI) injection, a geometry-guided feedback branch to ensure plausible shading, and a progressive rolling-window strategy for temporal coherence in long videos. LiveLight demonstrates state-of-the-art relighting quality and real-time performance, outperforming offline methods in stability and controllability. AI
IMPACT This framework could significantly enhance video editing and virtual production tools by allowing real-time manipulation of lighting.
RANK_REASON The cluster contains a research paper detailing a new technical framework. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
