Blind Dexterous Grasping via Real2Sim2Real Tactile Policy Learning
Researchers have developed a novel framework for tactile-only blind grasping using a dexterous robotic hand. Their approach utilizes a Real2Sim tactile calibration pipeline to create a digital-twin simulator that accurately reproduces real-world tactile signals. This is combined with a layout-aware tactile encoder that incorporates sensor-geometry priors and a Diffusion Policy trained on object-specific reinforcement learning experts in the simulator. The deployed policy achieved a 27% success rate on a physical robotic hand across 20 objects, without visual input. AI
IMPACT This research advances robotic manipulation capabilities, potentially enabling more sophisticated automation in unstructured environments.