Distortion-Aware PETR for BEV Object Detection with Mixed Pinhole-Fisheye Cameras
Researchers have developed Distortion-Aware PETR (DAPETR), a new method for 3D object detection using a mix of standard and fisheye cameras. DAPETR addresses the significant distortion issues caused by fisheye lenses, which typically violate assumptions in existing BEV detectors. The system introduces learned modules to harmonize positional encodings and co-modulate image features with 3D embeddings, outperforming previous approaches on a converted KITTI-360 benchmark. AI
IMPACT Enhances 3D object detection capabilities for autonomous driving systems using fisheye cameras.