Researchers have introduced PanoCtrl, a novel framework designed to improve text-to-panorama generation by explicitly bridging natural language with spherical panoramic space. This method converts textual descriptions into structured object-level spherical conditions, integrating them into the diffusion process. The framework includes PanoParse for predicting object semantics and spherical bounding parameters, and PanoControl for injecting semantic and spatial guidance into the diffusion transformer. To support this, a new dataset called PanoGround, featuring object-level spherical annotations and directional descriptions, has been created. Experiments indicate that PanoCtrl achieves state-of-the-art results in both spatial alignment and image quality for panoramic image generation. AI
IMPACT Enhances control and alignment in panoramic image generation, potentially improving VR/AR content creation.
RANK_REASON The cluster describes a new research paper detailing a novel framework for text-to-panorama generation. [lever_c_demoted from research: ic=1 ai=1.0]
- alphaXiv
- arXiv
- CatalyzeX
- cs.CV
- DagsHub
- Gotit.pub
- Hugging Face
- PanoControl
- PanoCtrl
- PanoGround
- PanoParse
- ScienceCast
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →