PulseAugur
EN
LIVE 07:40:13

New C2Dex framework transfers human manipulation skills from video to robots

Researchers have developed C2Dex, a novel framework for transferring human manipulation demonstrations from monocular video to dexterous robots. The system focuses on recovering stable object-side contacts as a shared interaction representation, ensuring temporal coherence and physical plausibility. This representation guides both the reconstruction of human-object interactions and the retargeting of these actions to different robotic embodiments, preserving local geometry. Experiments on DexYCB and TACO datasets show significant improvements in trajectory success rates compared to existing methods, with real-world robot replays demonstrating feasibility across various contact-rich tasks. AI

IMPACT Enables more efficient and scalable training of dexterous robots by leveraging readily available human video data.

RANK_REASON The cluster contains a research paper detailing a new framework for robotics. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

New C2Dex framework transfers human manipulation skills from video to robots

COVERAGE [1]

  1. arXiv cs.CV TIER_1 English(EN) · Jie Ren, Zhehao Jiang, Yinhong Yang, Haorui Jia, Han Jiang, Ben Li, Yao Yao, Cheng Lin, Qiu Shen, Zhenshan Bing, Xiao-Xiao Long, Xun Cao ·

    C2Dex: Contact-Consistent Reconstruction and Retargeting for Dexterous Manipulation from Monocular Video

    arXiv:2608.07045v1 Announce Type: cross Abstract: High-quality demonstrations for dexterous robot manipulation are costly and difficult to collect, whereas monocular human videos provide a scalable source of diverse manipulation behaviors. However, transferring such demonstration…