Multi-HMR 2: Multi-Person Camera-Centric Human Detection, Mesh Recovery and Tracking
Researchers have introduced Multi-HMR 2, a new framework designed for multi-person human detection, mesh recovery, and tracking within a camera-centric coordinate system. Unlike previous methods that focused on pelvis-centered recovery, this approach aims for accurate metric 3D localization, crucial for applications like human-robot interaction. The system leverages a DETR-based architecture and incorporates memory features from SAM2 to enable tracking without video supervision, achieving state-of-the-art results in detection accuracy and 3D localization. AI