SGFormer++: Semantic Graph Transformer for Incremental 3D Scene Graph Generation
Researchers have developed SGFormer++, a novel Semantic Graph Transformer designed for incremental 3D scene graph generation. This model utilizes Transformer layers for global message passing, overcoming limitations of traditional graph convolutional networks. Key innovations include a Graph Embedding Layer++ for efficient context integration and a Semantic Injection Layer++ that enriches visual features with linguistic priors from large language models and vision-language models. SGFormer++ also incorporates a Spatial-guided Feature Adapter and a Cascaded Binary Prediction Head to address challenges in incremental scene graph generation, such as catastrophic forgetting and scale variation. AI
IMPACT This research advances scene graph generation, potentially improving AI's understanding of complex 3D environments and object relationships.