Structural Energy Guidance for View-Consistent Text-to-3D Generation
Researchers have developed a new method called Structural Energy-Guided Sampling (SEGS) to address the Janus problem in text-to-3D generation. This issue causes inconsistent geometry across different viewpoints. SEGS works by identifying viewpoint bias in diffusion models and introducing a structural energy gradient into the denoising process, improving multi-view consistency without retraining. Experiments show SEGS reduces the Janus Rate by approximately 10% and enhances scores on various baselines like DreamFusion and Magic3D. AI
IMPACT Improves 3D content generation by reducing viewpoint inconsistencies, potentially enhancing realism and usability in applications.