Versatile Multi-Contact Planning and Control for Legged Loco-Manipulation

Abstract:
Loco-manipulation planning skills are pivotal for expanding the utility of robots in everyday environments. These skills can be assessed on the basis of a system’s ability to coordinate complex holistic movements and multiple contact interactions when solving different tasks. However, existing approaches have been merely able to shape such behaviors with hand-crafted state machines, densely engineered rewards, or prerecorded expert demonstrations. Here, we propose a minimally guided framework that automatically discovers whole-body trajectories jointly with contact schedules for solving general loco-manipulation tasks in premodeled environments. The key insight is that multimodal problems of this nature can be formulated and treated within the context of integrated task and motion planning (TAMP). An effective bilevel search strategy is achieved by incorporating domain-specific rules and adequately combining the strengths of different planning techniques: trajectory optimization and informed graph search coupled with sampling-based planning. We showcase emergent behaviors for a quadrupedal mobile manipulator exploiting both prehensile and nonprehensile interactions to perform real-world tasks such as opening/closing heavy dishwashers and traversing spring-loaded doors. These behaviors are also deployed on the real system using a two-layer whole-body tracking controller.
Paper: www.science.or...
arxiv.org/abs/2...
Authors: Jean-Pierre Sleiman, Farbod Farshidian, Marco Hutter

[@stevenjensjorgensen]

Excellent work! The sampling-based bi-level optimization is the key novelty and seems very efficient.

[@therobotstudio]

Fantastic work, as always!

[@SHAINON117]

So awesome great work ❤

[@NeuroScientician]

Is this an open source projectt?

[@gf2e]

Great work, and a great explanation. I noticed at 2:06 it seemed to indicate that a foot contacting the door was forbidden. But at 4:10 I see a foot holding the door so it doesn’t spring shut. Is there a difference between the two scenarios?