Grounding Driving VLA via Inverse Kinematics
Researchers have developed a new method for grounding driving vision-language models (VLAs) by reframing trajectory prediction as an inverse kinematics problem. This approach requires both current and future visual states, addressing a limitation in existing VLAs that only use current states, leading to shortcuts. The new method incorporates a next visual state prediction objective and a dedicated Inverse Kinematics Network, enabling a 0.5B-scale model to achieve performance comparable to much larger 7B-8B VLAs. AI
IMPACT This new method for grounding driving VLAs could lead to more robust and visually-aware autonomous driving systems.