SceneGraphGrounder: Zero-Shot 3D Visual Grounding via Structured Scene Graph Matching
Researchers have introduced SceneGraphGrounder, a novel framework designed for zero-shot 3D visual grounding. This approach tackles the challenge of locating objects in unstructured environments using natural language by transforming the task into a structured scene graph matching problem. The system reconstructs a 3D scene graph from 2D views, encoding both spatial and semantic relationships, and then aligns a query graph with this scene graph for consistent and interpretable reasoning. Experiments on the ScanRefer benchmark show competitive results, and the framework has been validated on a mobile robot for real-world applications. AI
IMPACT Introduces a new method for 3D visual grounding that could improve robot navigation and scene understanding.