Journal of Bionic Engineering ›› 2021, Vol. 18 ›› Issue (5): 1059-1072.doi: 10.1007/s42235-021-00083-y

• • 上一篇    下一篇

 A Novel Gait Pattern Recognition Method Based on LSTM-CNN for Lower Limb Exoskeleton

Chao-feng Chen1, Zhi-jiang Du1, Long He2, Yong-jun Shi1,Jia-qi Wang1, Wei Dong1   

  1. 1 State Key Laboratory of Robotics and System , Harbin 
    Institute of Technology (HIT) , Harbin   150001 , China 
    2 China South Industries Group Corporation , Weapon 
    Equipment Research Institute , Beijing   102202 , China
  • 收稿日期:2020-07-19 修回日期:2021-04-27 接受日期:2021-07-29 出版日期:2021-09-10 发布日期:2021-12-03
  • 通讯作者: Wei Dong E-mail:dongwei@hit.edu.cn
  • 作者简介:Chao-feng Chen1, Zhi-jiang Du1, Long He2, Yong-jun Shi1,Jia-qi Wang1, Wei Dong1

 A Novel Gait Pattern Recognition Method Based on LSTM-CNN for Lower Limb Exoskeleton

Chao-feng Chen1, Zhi-jiang Du1, Long He2, Yong-jun Shi1,Jia-qi Wang1, Wei Dong1   

  1. 1 State Key Laboratory of Robotics and System , Harbin 
    Institute of Technology (HIT) , Harbin   150001 , China 
    2 China South Industries Group Corporation , Weapon 
    Equipment Research Institute , Beijing   102202 , China
  • Received:2020-07-19 Revised:2021-04-27 Accepted:2021-07-29 Online:2021-09-10 Published:2021-12-03
  • Contact: Wei Dong E-mail:dongwei@hit.edu.cn
  • About author:Chao-feng Chen1, Zhi-jiang Du1, Long He2, Yong-jun Shi1,Jia-qi Wang1, Wei Dong1

摘要: This paper describes a novel gait pattern recognition method based on Long Short-Term Memory (LSTM) and Convolutional 
Neural Network (CNN) for lower limb exoskeleton. The Inertial Measurement Unit (IMU) installed on the exoskeleton to 
collect motion information, which is used for LSTM-CNN input. This article considers fi ve common gait patterns, including walking, going up stairs, going down stairs, sitting down, and standing up. In the LSTM-CNN model, the LSTM layer 
is used to process temporal sequences and the CNN layer is used to extract features. To optimize the deep neural network 
structure proposed in this paper, some hyperparameter selection experiments were carried out. In addition, to verify the 
superiority of the proposed recognition method, the method is compared with several common methods such as LSTM, CNN 
and SVM. The results show that the average recognition accuracy can reach 97.78%, which has a good recognition eff ect. 
Finally, according to the experimental results of gait pattern switching, the proposed method can identify the switching gait 
pattern in time, which shows that it has good real-time performance.

关键词: Lower limb exoskeleton, Gait pattern recognition, LSTM-CNN, Recognition accuracy, Real-time performance


Abstract: This paper describes a novel gait pattern recognition method based on Long Short-Term Memory (LSTM) and Convolutional 
Neural Network (CNN) for lower limb exoskeleton. The Inertial Measurement Unit (IMU) installed on the exoskeleton to 
collect motion information, which is used for LSTM-CNN input. This article considers fi ve common gait patterns, including walking, going up stairs, going down stairs, sitting down, and standing up. In the LSTM-CNN model, the LSTM layer 
is used to process temporal sequences and the CNN layer is used to extract features. To optimize the deep neural network 
structure proposed in this paper, some hyperparameter selection experiments were carried out. In addition, to verify the 
superiority of the proposed recognition method, the method is compared with several common methods such as LSTM, CNN 
and SVM. The results show that the average recognition accuracy can reach 97.78%, which has a good recognition eff ect. 
Finally, according to the experimental results of gait pattern switching, the proposed method can identify the switching gait 
pattern in time, which shows that it has good real-time performance.

Key words: Lower limb exoskeleton, Gait pattern recognition, LSTM-CNN, Recognition accuracy, Real-time performance