Beyond Chamfer Distance: Granular Order-aware Evaluation Metric For Online Mapping
Researchers have developed new evaluation metrics, SOSPA and PLD, to more accurately assess online mapping systems used in autonomous driving. These metrics address limitations in current methods like Chamfer Distance and mAP, which fail to account for the order of points in predicted map elements. Evaluations on the nuScenes dataset showed that PLD effectively ranks state-of-the-art mapping methods and provides detailed error analysis, highlighting detection capability as a key bottleneck. AI
IMPACT New metrics offer more granular evaluation for autonomous driving map estimation, potentially accelerating development by better identifying performance bottlenecks.