Motion-MLLM

Motion-MLLM enhances 3D scene understanding with egomotion data

Researchers have developed Motion-MLLM, a new framework that integrates egomotion data from Inertial Measurement Units (IMUs) with video to enhance Multimodal Large Language Models (MLLMs) for 3D scene understanding. Th…