RL + Model-based Control: Using On-demand Optimal Control to Learn Versatile Legged Locomotion

  Рет қаралды 3,580

Computational Robotics Lab

Computational Robotics Lab

Күн бұрын

Supplementary video for the IEEE RA-L paper
"RL + Model-based Control: Using On-demand Optimal Control to Learn Versatile Legged Locomotion" by Dongho Kang, Jin Cheng, Miguel Zamora, Fatemeh Zargarbashi, and Stelian Coros.
IEEE Robotics and Automation Letters (RA-L)
Abstract:
This letter presents a control framework that combines model-based optimal control and reinforcement learning (RL) to achieve versatile and robust legged locomotion. Our approach enhances the RL training process by incorporating on-demand reference motions generated through finite-horizon optimal control, covering a broad range of velocities and gaits. These reference motions serve as targets for the RL policy to imitate, leading to the development of robust control policies that can be learned with reliability. Furthermore, by utilizing realistic simulation data that captures whole-body dynamics, RL effectively overcomes the inherent limitations in reference motions imposed by modeling simplifications. We validate the robustness and controllability of the RL training process within our framework through a series of experiments. In these experiments, our method showcases its capability to generalize reference motions and effectively handle more complex locomotion tasks that may pose challenges for the simplified model, thanks to RL's flexibility. Additionally, our framework effortlessly supports the training of control policies for robots with diverse dimensions, eliminating the necessity for robot-specific adjustments in the reward function and hyperparameters.
Acknowledgment:
This work has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme.
We express our gratitude to Zijun Hui for his assistance with the robot experiments.
Project website:
donghok.me/rl-...
Preprint:
arxiv.org/abs/...
Computational Robotics Lab:
crl.ethz.ch/
/ computationalr2
Dongho Kang:
donghok.me/
/ eastskykang
Jin Cheng:
jin-cheng.me/
/ catachiii
Stelian Coros:
crl.ethz.ch/cor...

Пікірлер
DeepGait: Planning and Control of Quadrupedal Gaits using Deep Reinforcement Learning (Presentation)
8:18
Robotic Systems Lab: Legged Robotics at ETH Zürich
Рет қаралды 21 М.
Learning Robot Control: From RL to Differential Simulation - (PhD Defense of Yunlong Song)
24:32
UZH Robotics and Perception Group
Рет қаралды 6 М.
Support each other🤝
00:31
ISSEI / いっせい
Рет қаралды 81 МЛН
Mom Hack for Cooking Solo with a Little One! 🍳👶
00:15
5-Minute Crafts HOUSE
Рет қаралды 23 МЛН
DTC: Deep Tracking Control
6:46
Robotic Systems Lab: Legged Robotics at ETH Zürich
Рет қаралды 17 М.
NEW Type of Drone is GAME-CHANGING!
6:16
Tech Planet
Рет қаралды 2,8 МЛН
Legged Robots - Computerphile
10:39
Computerphile
Рет қаралды 42 М.
LLMs or Reinforcement Learning? Which is better for robot control?
6:25
MIT Robotics - Marco Hutter - Robots in the wild
49:31
MIT Robotics
Рет қаралды 10 М.
How are holograms possible? | Optics puzzles 5
46:24
3Blue1Brown
Рет қаралды 1,4 МЛН
Support each other🤝
00:31
ISSEI / いっせい
Рет қаралды 81 МЛН