Journal of Bionic Engineering ›› 2024, Vol. 21 ›› Issue (2): 764-777.doi: 10.1007/s42235-023-00472-5

• • 上一篇    下一篇

Bionic Hand Motion Control Method Based on Imitation of Human Hand Movements and Reinforcement Learning

Jibo Bai1; Baojiang Li1; Xichao Wang1; Haiyan Wang1; Yuting Guo1   

  1. 1 The School of Electrical Engineering, Shanghai DianJi University, Shanghai 201306, China
  • 出版日期:2024-01-30 发布日期:2024-04-08
  • 通讯作者: Baojiang Li E-mail:libj@sdju.edu.cn
  • 作者简介:Jibo Bai1; Baojiang Li1; Xichao Wang1; Haiyan Wang1; Yuting Guo1

Bionic Hand Motion Control Method Based on Imitation of Human Hand Movements and Reinforcement Learning

Jibo Bai1; Baojiang Li1; Xichao Wang1; Haiyan Wang1; Yuting Guo1   

  1. 1 The School of Electrical Engineering, Shanghai DianJi University, Shanghai 201306, China
  • Online:2024-01-30 Published:2024-04-08
  • Contact: Baojiang Li E-mail:libj@sdju.edu.cn
  • About author:Jibo Bai1; Baojiang Li1; Xichao Wang1; Haiyan Wang1; Yuting Guo1

摘要: Bionic hands are promising devices for assisting individuals with hand disabilities in rehabilitation robotics. Controlled primarily by bioelectrical signals such as myoelectricity and EEG, these hands can compensate for lost hand functions. However, developing model-based controllers for bionic hands is challenging and time-consuming due to varying control parameters and unknown application environments. To address these challenges, we propose a model-free approach using reinforcement learning (RL) for designing bionic hand controllers. Our method involves mimicking real human hand motion with the bionic hand and employing a human hand motion decomposition technique to learn complex motions from simpler ones. This approach signifcantly reduces the training time required. By utilizing real human hand motion data, we design a multidimensional sampling proximal policy optimization (PPO) algorithm that enables efcient motion control of the bionic hand. To validate the efectiveness of our approach, we compare it against advanced baseline methods. The results demonstrate the quick learning capabilities and high control success rate of our method.

关键词: Bionic hand , · Reinforcement learning , · Motion decomposition , · Multidimensional sampling PPO algorithm

Abstract: Bionic hands are promising devices for assisting individuals with hand disabilities in rehabilitation robotics. Controlled primarily by bioelectrical signals such as myoelectricity and EEG, these hands can compensate for lost hand functions. However, developing model-based controllers for bionic hands is challenging and time-consuming due to varying control parameters and unknown application environments. To address these challenges, we propose a model-free approach using reinforcement learning (RL) for designing bionic hand controllers. Our method involves mimicking real human hand motion with the bionic hand and employing a human hand motion decomposition technique to learn complex motions from simpler ones. This approach signifcantly reduces the training time required. By utilizing real human hand motion data, we design a multidimensional sampling proximal policy optimization (PPO) algorithm that enables efcient motion control of the bionic hand. To validate the efectiveness of our approach, we compare it against advanced baseline methods. The results demonstrate the quick learning capabilities and high control success rate of our method.

Key words: Bionic hand , · Reinforcement learning , · Motion decomposition , · Multidimensional sampling PPO algorithm