Humanoid robots learn complex loco-manipulation from human data and simulation · 8 sources tracked
ByPulseAugur Editorial·[12 sources]·
Researchers are developing advanced frameworks for humanoid robots to perform complex loco-manipulation tasks, involving both movement and object interaction. These methods leverage techniques like model predictive control, reinforcement learning, and imitation learning, often trained on human demonstrations or simulated data. The goal is to enable humanoids to handle heavy loads, interact with wheeled vehicles, and perform coordinated actions with humans or other robots, with demonstrated success on platforms like the Unitree G1.
AI
IMPACT
Advances in humanoid loco-manipulation could enable robots to perform complex physical tasks in unstructured environments, impacting logistics, manufacturing, and disaster response.
RANK_REASON
Multiple research papers detailing new frameworks and methods for humanoid robot loco-manipulation.
arXiv cs.LG
TIER_1English(EN)·Mert Albaba, Jens Bei{\ss}wenger, Anna Manasyan, Daniel Marta, Michael J. Black, Wieland Brendel, Andreas Krause, Georg Martius, Martin Riedmiller·
arXiv:2610.12435v1 Announce Type: cross Abstract: Teaching a humanoid to follow instructions with its whole body runs into two obstacles. Its action space is large and tightly coupled: legs, arms, and fingers must move together while the robot keeps its balance, which makes joint…
arXiv:2610.11283v1 Announce Type: cross Abstract: Humanoid loco-manipulation requires coordinated locomotion and manipulation informed by future scene evolution and whole-body motion, yet learning these capabilities is constrained by scarce robot demonstrations. Human video and m…
arXiv:2610.12026v1 Announce Type: cross Abstract: Humanoid robots are a promising platform for general-purpose manipulation. Recent Vision-Language-Action (VLA) policies learn actions directly from multimodal observations, while World Action Models (WAMs) further incorporate futu…
arXiv cs.AI
TIER_1English(EN)·Yangsong Zhang, Anujith Muraleedharan, Rikhat Akizhanov, Abdul Ahad Butt, G\"ul Varol, Pascal Fua, Fabio Pizzati, Ivan Laptev·
arXiv:2603.13228v3 Announce Type: replace-cross Abstract: Recent progress in text-conditioned human motion generation has been largely driven by diffusion models trained on large-scale human motion data. Building on this progress, recent methods attempt to transfer such models fo…
arXiv:2610.04238v2 Announce Type: replace-cross Abstract: Humanoid robots could transport payloads substantially heavier than themselves by pulling passive wheeled vehicles instead of carrying the load. This capability, however, creates a coupled locomotion problem: the robot mus…
arXiv cs.LG
TIER_1English(EN)·An Dang, Arturo Flores Alvarez, Yu-Ming Chen, Conor Mc Gartoll, Helen Sun, Aaron Ames, Nima Fazeli, Manikantan Nambi·
arXiv:2610.08970v1 Announce Type: cross Abstract: Humanoid loco-manipulation of large, heavy objects demands forceful interaction across the entire body. However, such payloads shift a humanoid's center of mass and impose sustained loads across the upper body, challenging balance…
arXiv:2610.09117v1 Announce Type: cross Abstract: Humanoid robots still struggle to plan contact-rich whole-body manipulation from egocentric RGB and proprioception. Workhorse learns such manipulation from robot-free human demonstrations. A visual planner predicts five-link targe…
Captured human-object interactions provide rich supervision for humanoid loco-manipulation, but they are sparse, heterogeneous, and not directly executable by robots. We introduce InterMimicGen, a self-evolving motion-imitation framework in which robot motion data and a tracking …
Partnered human-humanoid interaction couples locomotion with continuous physical contact. A humanoid needs to coordinate with a person's motion while responding to interaction forces and maintaining stable and natural movement. We present CoDance, a framework for learning reactiv…
arXiv cs.LG
TIER_1English(EN)·Yifan Hu, Luhang Hong, Mingkang Long, Danning Wang, Chengfeng Jia, Rong Su, Junjie Fu, Guanghui Wen·
arXiv:2610.01102v1 Announce Type: cross Abstract: Coordinated multi-humanoid loco-manipulation is promising yet challenging due to high-dimensional whole-body control, decentralized decision making, and scalability. While recent reinforcement learning methods have improved single…
Coordinated multi-humanoid loco-manipulation is promising yet challenging due to high-dimensional whole-body control, decentralized decision making, and scalability. While recent reinforcement learning methods have improved single-humanoid whole-body control, extending them to th…
arXiv cs.AI
TIER_1English(EN)·Jin Chen, Yiming Jiang, Chongyang Xu, Modi Shi, Shijia Peng, Li Chen, Tianyu Li, Mu Xu, Yilun Chen, Steven Hoi, Hongyang Li·
arXiv:2609.37181v1 Announce Type: cross Abstract: Human demonstrations capture diverse scenes and rich whole-body skills without requiring robot teleoperation. Prior work on egocentric transfer has emphasized scene generalization in loco-manipulation under decoupled control, leav…