Journal of Bionic Engineering ›› 2021, Vol. 18 ›› Issue (6): 1439-1451.doi: 10.1007/s42235-021-00113-9

• • 上一篇    下一篇

Brain-like Intelligent Decision-making Based on Basal Ganglia and Its Application in Automatic Car-following 

Tianjun Sun 1,2, Zhenhai Gao 1,2, Zhiyong Chang 3, Kehan Zhao 4    

  1. 1 State Key Laboratory of Automotive Simulation and Control , Jilin University , Changchun   130022 , China 
    2 College of Automotive Engineering , Jilin University , Changchun   130022 , China 
    3 College of Biological and Agricultural Engineering , Jilin University , Changchun   130022 , China
    4 College of Materials Science and Engineering , Jilin University , Changchun   130022 , China 
  • 收稿日期:2021-01-25 修回日期:2021-09-28 接受日期:2021-10-05 出版日期:2021-11-10 发布日期:2021-12-21
  • 通讯作者: Zhenhai Gao E-mail:gaozh@jlu.edu.cn
  • 作者简介:Tianjun Sun 1,2, Zhenhai Gao 1,2, Zhiyong Chang 3, Kehan Zhao 4

Brain-like Intelligent Decision-making Based on Basal Ganglia and Its Application in Automatic Car-following 

Tianjun Sun 1,2, Zhenhai Gao 1,2, Zhiyong Chang 3, Kehan Zhao 4    

  1. 1 State Key Laboratory of Automotive Simulation and Control , Jilin University , Changchun   130022 , China 
    2 College of Automotive Engineering , Jilin University , Changchun   130022 , China 
    3 College of Biological and Agricultural Engineering , Jilin University , Changchun   130022 , China
    4 College of Materials Science and Engineering , Jilin University , Changchun   130022 , China 
  • Received:2021-01-25 Revised:2021-09-28 Accepted:2021-10-05 Online:2021-11-10 Published:2021-12-21
  • Contact: Zhenhai Gao E-mail:gaozh@jlu.edu.cn
  • About author:Tianjun Sun 1,2, Zhenhai Gao 1,2, Zhiyong Chang 3, Kehan Zhao 4

摘要: The anthropomorphic intelligence of autonomous driving has been a research hotspot in the world. However, current studies have not been able to reveal the mechanism of drivers' natural driving behaviors. Therefore, this thesis starts from the perspective of cognitive decision-making in the human brain, which is inspired by the regulation of dopamine feedback in the basal ganglia, and a reinforcement learning model is established to solve the brain-like intelligent decision-making problems in the process of interacting with the environment. In this thesis, first, a detailed bionic mechanism architecture based on basal ganglia was proposed by the consideration and analysis of its feedback regulation mechanism; second, the above mechanism was transformed into a reinforcement Q -learning model, so as to implement the learning and adaptation abilities of an intelligent vehicle for brain-like intelligent decision-making during car-following; finally, the feasibility and effectiveness of the proposed method were verified by the simulations and real vehicle tests. 

关键词: Brain-like intelligent decision-making, Dopamine in basal ganglia, Reinforcement learning, Longitudinal autonomous driving

Abstract: The anthropomorphic intelligence of autonomous driving has been a research hotspot in the world. However, current studies have not been able to reveal the mechanism of drivers' natural driving behaviors. Therefore, this thesis starts from the perspective of cognitive decision-making in the human brain, which is inspired by the regulation of dopamine feedback in the basal ganglia, and a reinforcement learning model is established to solve the brain-like intelligent decision-making problems in the process of interacting with the environment. In this thesis, first, a detailed bionic mechanism architecture based on basal ganglia was proposed by the consideration and analysis of its feedback regulation mechanism; second, the above mechanism was transformed into a reinforcement Q -learning model, so as to implement the learning and adaptation abilities of an intelligent vehicle for brain-like intelligent decision-making during car-following; finally, the feasibility and effectiveness of the proposed method were verified by the simulations and real vehicle tests. 

Key words: Brain-like intelligent decision-making, Dopamine in basal ganglia, Reinforcement learning, Longitudinal autonomous driving