PulseAugur
EN
LIVE 14:43:34

New AI methods generate 3D scenes from multi-view images and sketches

Researchers have developed new methods for generating 3D scene assets from limited visual input. One approach, Scene-SAM3D, extends existing single-image 3D generation models to work with multiple calibrated views, improving consistency and reducing redundancy without requiring fine-tuning. Another method tackles the challenge of generating geometrically consistent multi-view scenes from freehand sketches, a task previously unattempted due to the impoverished nature of sketch input. This latter approach introduces a new dataset and uses specialized attention adapters and a novel supervision loss to achieve significant improvements in realism and geometric consistency. AI

IMPACT Advances in 3D scene generation from limited input could accelerate development in embodied AI, robotics, and simulation environments.

RANK_REASON Two research papers introducing novel methods for 3D scene generation from limited input.

Read on arXiv cs.CV →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

New AI methods generate 3D scenes from multi-view images and sketches

COVERAGE [2]

  1. arXiv cs.CV TIER_1 English(EN) · Yuqi Zhang, Yadan Luo, Xiangyu Sun, Fengyi Zhang, Zi Huang, Xin Tan ·

    Scene-SAM3D: Multi-View Scene Asset Generation Without Fine-Tuning

    arXiv:2607.16805v1 Announce Type: new Abstract: High-quality 3D scene assets are critical for embodied applications such as robotic manipulation, navigation, and simulation. Despite their strong object priors, recent single-image 3D generation models such as SAM3D remain insuffic…

  2. arXiv cs.CV TIER_1 English(EN) · Ahmed Bourouis, Savas Ozkan, Andrea Maracani, Yi-Zhe Song, Mete Ozay ·

    Geometrically Consistent Multi-View Scene Generation from Freehand Sketches

    arXiv:2604.14302v2 Announce Type: replace Abstract: We tackle a new problem: generating geometrically consistent multi-view scenes from a single freehand sketch. Freehand sketches are the most geometrically impoverished input one could offer a multi-view generator. They convey sc…