Journal of Bionic Engineering ›› 2022, Vol. 19 ›› Issue (5): 1359-1373.doi: 10.1007/s42235-022-00230-z

• • 上一篇    下一篇

Integral Real-time Locomotion Mode Recognition Based on GA-CNN for Lower Limb Exoskeleton

Jiaqi Wang1, Dongmei Wu1, Yongzhuo Gao1, Xinrui Wang2, Xiaoqi Li2, Guoqiang Xu2, Wei Dong1   

  1. 1 State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin 150001, China  2 Weapon Equipment Research Institute, China South Industries Group Corporation, Beijing 102202, China
  • 收稿日期:2022-03-18 修回日期:2022-06-02 接受日期:2022-06-07 出版日期:2022-09-10 发布日期:2022-09-24
  • 通讯作者: Wei Dong E-mail:dongwei@hit.edu.cn
  • 作者简介:Jiaqi Wang1, Dongmei Wu1, Yongzhuo Gao1, Xinrui Wang2, Xiaoqi Li2, Guoqiang Xu2, Wei Dong1

Integral Real-time Locomotion Mode Recognition Based on GA-CNN for Lower Limb Exoskeleton

Jiaqi Wang1, Dongmei Wu1, Yongzhuo Gao1, Xinrui Wang2, Xiaoqi Li2, Guoqiang Xu2, Wei Dong1   

  1. 1 State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin 150001, China  2 Weapon Equipment Research Institute, China South Industries Group Corporation, Beijing 102202, China
  • Received:2022-03-18 Revised:2022-06-02 Accepted:2022-06-07 Online:2022-09-10 Published:2022-09-24
  • Contact: Wei Dong E-mail:dongwei@hit.edu.cn
  • About author:Jiaqi Wang1, Dongmei Wu1, Yongzhuo Gao1, Xinrui Wang2, Xiaoqi Li2, Guoqiang Xu2, Wei Dong1

摘要: The wearable lower limb exoskeleton is a typical human-in-loop human–robot coupled system, which conducts natural and close cooperation with the human by recognizing human locomotion timely. Requiring subject-specific training is the main challenge of the existing approaches, and most methods have the problem of insufficient recognition. This paper proposes an integral subject-adaptive real-time Locomotion Mode Recognition (LMR) method based on GA-CNN for a lower limb exoskeleton system. The LMR method is a combination of Convolutional Neural Networks (CNN) and Genetic Algorithm (GA)-based multi-sensor information selection. To improve network performance, the hyper-parameters are optimized by Bayesian optimization. An exoskeleton prototype system with multi-type sensors and novel sensing-shoes is used to verify the proposed method. Twelve locomotion modes, which composed an integral locomotion system for the daily application of the exoskeleton, can be recognized by the proposed method. According to a series of experiments, the recognizer shows strong comprehensive abilities including high accuracy, low delay, and sufficient adaption to different subjects.

关键词: Locomotion mode recognition , · Gait mode detection , · Lower limb exoskeleton , · Convolutional neural network , · Genetic algorithm , · Bionic design

Abstract: The wearable lower limb exoskeleton is a typical human-in-loop human–robot coupled system, which conducts natural and close cooperation with the human by recognizing human locomotion timely. Requiring subject-specific training is the main challenge of the existing approaches, and most methods have the problem of insufficient recognition. This paper proposes an integral subject-adaptive real-time Locomotion Mode Recognition (LMR) method based on GA-CNN for a lower limb exoskeleton system. The LMR method is a combination of Convolutional Neural Networks (CNN) and Genetic Algorithm (GA)-based multi-sensor information selection. To improve network performance, the hyper-parameters are optimized by Bayesian optimization. An exoskeleton prototype system with multi-type sensors and novel sensing-shoes is used to verify the proposed method. Twelve locomotion modes, which composed an integral locomotion system for the daily application of the exoskeleton, can be recognized by the proposed method. According to a series of experiments, the recognizer shows strong comprehensive abilities including high accuracy, low delay, and sufficient adaption to different subjects.

Key words: Locomotion mode recognition , · Gait mode detection , · Lower limb exoskeleton , · Convolutional neural network , · Genetic algorithm , · Bionic design