Loki diffusion model separates identity from expression for portrait animation

Researchers have developed Loki, a new diffusion-based method for animating portraits that separates identity from expression and pose. Unlike previous methods that struggle with disentangling these factors from RGB data, Loki uses a specialized face model to encode expression and pose, which are then rasterized into a spatial map. This approach significantly reduces the need for cross-identity training data and requires fewer inference parameters compared to existing techniques. Loki also demonstrates leading performance on metrics measuring adherence to driver expression and head pose. AI

IMPACT This new method could enable more efficient and realistic AI-driven portrait animation by simplifying the disentanglement of identity, expression, and pose.

RANK_REASON The cluster contains a research paper detailing a new method for portrait animation. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

• arXiv
• Loki

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →