研究人员开发了UniTac，这是一种新颖的统一多模态模型，专为跨不同传感器的触觉理解和生成而设计。该模型通过双层表示来捕捉传感器与物体之间的物理交互，使其能够执行物体属性描述和传感器识别等任务。此外，另一项研究引入了一种视觉-触觉策略，该策略利用光学触觉传感器产生的瞬时和累积运动之间的相关性来更好地区分细粒度接触状态。该方法旨在通过有效融合视觉和触觉数据来改进接触式操作。 AI
影响 这些进展可以通过改进机器如何通过触觉感知和与物理世界互动，从而实现更复杂的手臂操作和人机交互。
排序理由 两篇学术论文介绍了用于触觉理解和视觉-触觉操作的新型AI模型。
AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →
arXiv:2606.31451v1 Announce Type: cross Abstract: Unified multimodal models (UMMs) have shown great promise in integrating understanding and generation across diverse modalities. However, existing research rarely extends this paradigm to the tactile domain, where both object-leve…
arXiv:2607.00302v1 Announce Type: new Abstract: Touch supplies the physical grounding needed to perceive intrinsic material properties, such as friction and compliance, that vision alone often cannot resolve. Recent efforts for equipping multimodal LLMs with this tactile sense, h…
arXiv:2606.29941v1 Announce Type: cross Abstract: Visuo-Tactile policies leveraging optical tactile sensors have shown great promise in contact-rich manipulation. These sensors achieve high spatial resolution and multi-dimensional force sensing by utilizing an internal camera to …