TAVIS benchmark advances robotics imitation learning with active vision

Researchers have introduced TAVIS, a new benchmark designed to evaluate active vision in imitation learning for robotics. The benchmark includes two task suites, TAVIS-Head and TAVIS-Hands, built on humanoid embodiments and utilizing IsaacLab. TAVIS offers a paired headcam-vs-fixedcam protocol, a novel Gaze-Action Lead Time (GALT) metric for anticipatory gaze, and procedural in-distribution/out-of-distribution splits. Initial experiments with Diffusion Policy and $\pi_0$ indicate that active vision generally improves performance but is task-dependent, and multi-task policies struggle with distribution shifts. AI

IMPACT Establishes a standardized evaluation framework for active vision in robotics, potentially accelerating progress in imitation learning for complex manipulation tasks.

RANK_REASON The cluster describes a new academic benchmark and evaluation infrastructure for robotics research. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

• Active Vision
• Diffusion Policy
• Gaze-Action Lead Time
• GR1T2
• Imitation Learning
• IsaacLab
• \pi_0
• Reachy2
• Robotics
• TAVIS

• paper
• product

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →