Quick Search Adv. Search

Journal of Bionic Engineering ›› 2022, Vol. 19 ›› Issue (5): 1359-1373.doi: 10.1007/s42235-022-00230-z

Previous Articles     Next Articles

Integral Real-time Locomotion Mode Recognition Based on GA-CNN for Lower Limb Exoskeleton

Jiaqi Wang1, Dongmei Wu1, Yongzhuo Gao1, Xinrui Wang2, Xiaoqi Li2, Guoqiang Xu2, Wei Dong1   

  1. 1 State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin 150001, China  2 Weapon Equipment Research Institute, China South Industries Group Corporation, Beijing 102202, China
  • Received:2022-03-18 Revised:2022-06-02 Accepted:2022-06-07 Online:2022-09-10 Published:2022-09-24
  • Contact: Wei Dong E-mail:dongwei@hit.edu.cn
  • About author:Jiaqi Wang1, Dongmei Wu1, Yongzhuo Gao1, Xinrui Wang2, Xiaoqi Li2, Guoqiang Xu2, Wei Dong1

Abstract: The wearable lower limb exoskeleton is a typical human-in-loop human–robot coupled system, which conducts natural and close cooperation with the human by recognizing human locomotion timely. Requiring subject-specific training is the main challenge of the existing approaches, and most methods have the problem of insufficient recognition. This paper proposes an integral subject-adaptive real-time Locomotion Mode Recognition (LMR) method based on GA-CNN for a lower limb exoskeleton system. The LMR method is a combination of Convolutional Neural Networks (CNN) and Genetic Algorithm (GA)-based multi-sensor information selection. To improve network performance, the hyper-parameters are optimized by Bayesian optimization. An exoskeleton prototype system with multi-type sensors and novel sensing-shoes is used to verify the proposed method. Twelve locomotion modes, which composed an integral locomotion system for the daily application of the exoskeleton, can be recognized by the proposed method. According to a series of experiments, the recognizer shows strong comprehensive abilities including high accuracy, low delay, and sufficient adaption to different subjects.

Key words: Locomotion mode recognition , · Gait mode detection , · Lower limb exoskeleton , · Convolutional neural network , · Genetic algorithm , · Bionic design