VIMCAN network fuses Mamba and attention for real-time 3D human pose estimation

Researchers have developed VIMCAN, a novel hybrid network for visual-inertial 3D human pose estimation. This architecture integrates Mamba's efficient sequence modeling with Cross-Attention's spatial reasoning capabilities to fuse RGB keypoint and IMU data. VIMCAN achieves state-of-the-art accuracy, outperforming Transformer-based methods on benchmarks like TotalCapture and 3DPW, while also enabling real-time inference at over 60 FPS on consumer hardware. AI

Summary written by gemini-2.5-flash-lite from 1 source. How we write summaries →

IMPACT Introduces a more efficient architecture for real-time 3D human pose estimation, potentially impacting robotics and augmented reality applications.

RANK_REASON Publication of a new academic paper detailing a novel network architecture. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

• VIMCAN
• Mamba
• Cross-Attention
• TotalCapture
• 3DPW

• paper
• other