Journal of Bionic Engineering ›› 2024, Vol. 21 ›› Issue (4): 1733-1746.doi: 10.1007/s42235-024-00541-3

• • 上一篇    下一篇

Perception‑Driven Learning of High‑Dynamic Jumping Motions for Single‑Legged Robots

Nengxiang Sun1 ; Fei Meng1,2 ; Sai Gu1 ; Botao Liu1 ; Xuechao Chen1,2; Zhangguo Yu1,2; Qiang Huang1,2   

  1. 1 School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China  2 Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, Beijing 100081, China
  • 出版日期:2024-07-15 发布日期:2024-09-01
  • 通讯作者: Fei Meng E-mail:mfy0208@bit.edu.cn
  • 作者简介:Nengxiang?Sun1 ; Fei?Meng1,2 ; Sai?Gu1 ; Botao?Liu1 ; Xuechao?Chen1,2; Zhangguo?Yu1,2; Qiang?Huang1,2

Perception‑Driven Learning of High‑Dynamic Jumping Motions for Single‑Legged Robots

Nengxiang Sun1 ; Fei Meng1,2 ; Sai Gu1 ; Botao Liu1 ; Xuechao Chen1,2; Zhangguo Yu1,2; Qiang Huang1,2   

  1. 1 School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China  2 Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, Beijing 100081, China
  • Online:2024-07-15 Published:2024-09-01
  • Contact: Fei Meng E-mail:mfy0208@bit.edu.cn
  • About author:Nengxiang?Sun1 ; Fei?Meng1,2 ; Sai?Gu1 ; Botao?Liu1 ; Xuechao?Chen1,2; Zhangguo?Yu1,2; Qiang?Huang1,2

摘要: Legged robots show great potential for high-dynamic motions in continuous interaction with the physical environment, yet achieving animal-like agility remains signifcant challenges. Legged animals usually predict and plan their next locomotion by combining high-dimensional information from proprioception and exteroception, and adjust the stifness of the body’s skeletal muscle system to adapt to the current environment. Traditional control methods have limitations in handling highdimensional state information or complex robot motion that are difcult to plan manually, and Deep Reinforcement Learning (DRL) algorithms provide new solutions to robot motioncontrol problems. Inspired by biomimetics theory, we propose a perception-driven high-dynamic jump adaptive learning algorithm by combining DRL algorithms with Virtual Model Control (VMC) method. The robot will be fully trained in simulation to explore its motion potential by learning the factors related to continuous jumping while knowing its real-time jumping height. The policy trained in simulation is successfully deployed on the bio-inspired single-legged robot testing platform without further adjustments. Experimental results show that the robot can achieve continuous and ideal vertical jumping motion through simple training

关键词: Deep reinforcement learning , · High-dynamic jump , · Perception driven , · Single-legged robot

Abstract: Legged robots show great potential for high-dynamic motions in continuous interaction with the physical environment, yet achieving animal-like agility remains signifcant challenges. Legged animals usually predict and plan their next locomotion by combining high-dimensional information from proprioception and exteroception, and adjust the stifness of the body’s skeletal muscle system to adapt to the current environment. Traditional control methods have limitations in handling highdimensional state information or complex robot motion that are difcult to plan manually, and Deep Reinforcement Learning (DRL) algorithms provide new solutions to robot motioncontrol problems. Inspired by biomimetics theory, we propose a perception-driven high-dynamic jump adaptive learning algorithm by combining DRL algorithms with Virtual Model Control (VMC) method. The robot will be fully trained in simulation to explore its motion potential by learning the factors related to continuous jumping while knowing its real-time jumping height. The policy trained in simulation is successfully deployed on the bio-inspired single-legged robot testing platform without further adjustments. Experimental results show that the robot can achieve continuous and ideal vertical jumping motion through simple training

Key words: Deep reinforcement learning , · High-dynamic jump , · Perception driven , · Single-legged robot