Is Your Trajectory Displacement Safe in Long-tail?
Researchers have developed FluidTest, a novel evaluation pipeline designed to address the limitations of current autonomous driving assessment methods, particularly in long-tail scenarios. This pipeline integrates a human-annotated WebUI protocol, a taxonomy of 32 semantic threats, and a three-agent verification system to ensure safety, alignment, and verifiability. Experiments on the WOD-E2E dataset demonstrated that FluidTest can identify significant safety-relevant failures in state-of-the-art planners, even when traditional metrics like Rater Feedback Scores and Average Displacement Error appear satisfactory. AI
IMPACT This research offers a more robust method for evaluating autonomous driving systems, potentially improving safety and reliability in complex, real-world scenarios.