Researchers have developed ADAPT (Adaptive Domain-Aware Pedestrian Crossing Transformer), a new multimodal framework designed to improve the prediction of pedestrian crossing intentions for autonomous driving. This system integrates visual data from RGB images, depth maps, and semantic maps with kinematic information such as pedestrian pose and ego-vehicle speed. ADAPT utilizes specialized modules including Swin Transformer V2 and Mamba for feature extraction and temporal modeling, with a sparse cross-modal attention mechanism to efficiently fuse complementary information. Experiments on benchmark datasets show ADAPT surpasses existing methods in accuracy and AUC while operating at a real-time inference speed. AI
IMPACT This research could lead to safer autonomous driving systems by improving the accuracy and speed of pedestrian intention prediction.
RANK_REASON The cluster contains a research paper detailing a new model and its performance on benchmark datasets.
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →