Quick Search Adv. Search

Journal of Bionic Engineering ›› 2024, Vol. 21 ›› Issue (1): 288-302.doi: 10.1007/s42235-023-00454-7

Previous Articles     Next Articles

Reinforcement Learning Navigation for Robots Based on Hippocampus Episode Cognition

Jinsheng Yuan1; Wei Guo1; Zhiyuan Hou3; Fusheng Zha1,2; Mantian Li1; Pengfei Wang1; Lining Sun1   

  1. 1 State Key Laboratory of Robotics and System, Harbin Institute of Technology (HIT), Harbin 150001, China  2 Shenzhen Academy of Aerospace Technology, Shenzhen 518057, China  3 School of Mechanical and Electrical Engineering, Lanzhou University of Technology, Lanzhou 730050, China 
  • Online:2024-01-16 Published:2024-02-26
  • Contact: Fusheng Zha E-mail:zhafusheng@hit.edu.cn
  • About author:Jinsheng Yuan1; Wei Guo1; Zhiyuan Hou3; Fusheng Zha1,2; Mantian Li1; Pengfei Wang1; Lining Sun1

Abstract: Artifcial intelligence is currently achieving impressive success in all felds. However, autonomous navigation remains a major challenge for AI. Reinforcement learning is used for target navigation to simulate the interaction between the brain and the environment at the behavioral level, but the Artifcial Neural Network trained by reinforcement learning cannot match the autonomous mobility of humans and animals. The hippocampus–striatum circuits are considered as key circuits for target navigation planning and decision-making. This paper aims to construct a bionic navigation model of reinforcement learning corresponding to the nervous system to improve the autonomous navigation performance of the robot. The ventral striatum is considered to be the behavioral evaluation region, and the hippocampal–striatum circuit constitutes the position–reward association. In this paper, a set of episode cognition and reinforcement learning system simulating the mechanism of hippocampus and ventral striatum is constructed, which is used to provide target guidance for the robot to perform autonomous tasks. Compared with traditional methods, this system refects the high efciency of learning and better Environmental Adaptability. Our research is an exploration of the intersection and fusion of artifcial intelligence and neuroscience, which is conducive to the development of artifcial intelligence and the understanding of the nervous system.

Key words: Episode cognition , · Reinforcement learning , · Hippocampus , · Robot navigation