PulseAugur
EN
LIVE 09:35:17

New SEGS method improves 3D generation consistency

By PulseAugur Editorial · [2 sources] ·

Researchers have developed a new method called Structural Energy-Guided Sampling (SEGS) to address the Janus problem in text-to-3D generation. This issue causes inconsistent geometry across different viewpoints. SEGS works by identifying viewpoint bias in diffusion models and introducing a structural energy gradient into the denoising process, improving multi-view consistency without retraining. Experiments show SEGS reduces the Janus Rate by approximately 10% and enhances scores on various baselines like DreamFusion and Magic3D. AI

IMPACT Improves 3D content generation by reducing viewpoint inconsistencies, potentially enhancing realism and usability in applications.

RANK_REASON The cluster contains an academic paper detailing a new method for text-to-3D generation.

Read on Hugging Face Daily Papers →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

New SEGS method improves 3D generation consistency

COVERAGE [2]

  1. Hugging Face Daily Papers TIER_1 English(EN) ·

    Structural Energy Guidance for View-Consistent Text-to-3D Generation

    Text-to-3D generation based on diffusion models often suffers from the Janus problem, leading to inconsistent geometry across viewpoints. This work identifies viewpoint bias in 2D diffusion priors as the main cause and proposes Structural Energy-Guided Sampling (SEGS), a training…

  2. arXiv cs.CV TIER_1 English(EN) · Xuesong Li ·

    Structural Energy Guidance for View-Consistent Text-to-3D Generation

    Text-to-3D generation based on diffusion models often suffers from the Janus problem, leading to inconsistent geometry across viewpoints. This work identifies viewpoint bias in 2D diffusion priors as the main cause and proposes Structural Energy-Guided Sampling (SEGS), a training…

RELATED ENTITIES

RELATED TOPICS