Where Will They Go? Modelling Multimodal Pedestrian Manoeuvres from Ego-centric Videos
Researchers have developed a new framework called MMPM to improve pedestrian trajectory prediction from ego-centric videos. This model addresses the challenge of multimodal pedestrian behavior by separately modeling distinct modes, such as crossing or not crossing the road. The MMPM framework includes a behavior-aware Pedestrian Interaction Module (PIM) and a CVAE-based Mode-aware Trajectory Predictor (MTP), which collectively capture complex interactions and intentions. Experiments on PIE and JAAD datasets demonstrate that MMPM outperforms existing state-of-the-art methods and can be integrated with other frameworks like BiTrap-NP and SGNet-ED. AI
IMPACT Enhances the accuracy of predicting pedestrian movements in complex urban environments, potentially improving autonomous navigation and safety systems.