研究人员推出了两个新的数据集和框架,旨在推进具身AI的视觉-触觉学习。TouchScale提供了500小时人类交互的同步视觉和触觉数据,显著提高了零样本接触预测和机器人操作的成功率。另一方面,PhysTacGen是一个通过整合物理感知材料描述和几何条件来生成逼真视觉-触觉传感器图像的框架,可以扩充现有数据集并提高下游任务性能。
AI
arXiv:2610.11945v1 Announce Type: cross Abstract: Collecting tactile demonstrations on robots is costly and slow, motivating the use of lower-cost human tactile gloves for scalable data collection. However, human capacitive/piezoresistive gloves and robotic tactile sensors differ…
arXiv:2610.10288v1 Announce Type: new Abstract: Large-scale egocentric human interaction data is becoming an important source of physical supervision for embodied learning, yet video alone leaves the contact and pressure that characterize physical interaction unrecorded. Recent v…
arXiv:2610.08068v1 Announce Type: new Abstract: Realistic physical interaction is a cornerstone of embodied intelligence, yet collecting paired visual--tactile data remains costly. Visual-to-tactile synthesis offers a promising approach to augmenting such data, but learning this …