Journal of Bionic Engineering ›› 2019, Vol. 16 ›› Issue (3): 442-454.doi: https://doi.org/10.1007/s42235-019-0036-1

• • 上一篇    下一篇

Robust RGB-D Camera and IMU Fusion-based Cooperative and Relative Close-range Localization for Multiple Turtle-inspired Amphibious Spherical Robots

Huiming Xing1,2, Liwei Shi1,2*, Kun Tang1,2, Shuxiang Guo1,2,3*, Xihuan Hou1,2, Yu Liu1,2, Huikang Liu1,2, Yao Hu1,2   

  1. 1. Key Laboratory of Convergence Medical Engineering System and Healthcare Technology, the Ministry of Industry and Information Technology, School of Life Science, Beijing Institute of Technology, Beijing 100081, China
    2. Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, Beijing Institute of Technology, Beijing 100081, China
    3. Faculty of Engineering, Kagawa University, 2217-20 Hayashicho, Takamatsu, Kagawa 761-0396, Japan

  • 收稿日期:2018-08-18 修回日期:2019-01-16 接受日期:2019-03-27 出版日期:2019-05-10 发布日期:2019-06-14
  • 通讯作者: Liwei Shi, Shuxiang Guo E-mail:Liwei Shi, Shuxiang Guo
  • 作者简介:Huiming Xing1,2, Liwei Shi1,2*, Kun Tang1,2, Shuxiang Guo1,2,3*, Xihuan Hou1,2, Yu Liu1,2, Huikang Liu1,2, Yao Hu1,2

Robust RGB-D Camera and IMU Fusion-based Cooperative and Relative Close-range Localization for Multiple Turtle-inspired Amphibious Spherical Robots

Huiming Xing1,2, Liwei Shi1,2*, Kun Tang1,2, Shuxiang Guo1,2,3*, Xihuan Hou1,2, Yu Liu1,2, Huikang Liu1,2, Yao Hu1,2   

  1. 1. Key Laboratory of Convergence Medical Engineering System and Healthcare Technology, the Ministry of Industry and Information Technology, School of Life Science, Beijing Institute of Technology, Beijing 100081, China
    2. Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, Beijing Institute of Technology, Beijing 100081, China
    3. Faculty of Engineering, Kagawa University, 2217-20 Hayashicho, Takamatsu, Kagawa 761-0396, Japan

  • Received:2018-08-18 Revised:2019-01-16 Accepted:2019-03-27 Online:2019-05-10 Published:2019-06-14
  • Contact: Liwei Shi, Shuxiang Guo E-mail:Liwei Shi, Shuxiang Guo
  • About author:Huiming Xing1,2, Liwei Shi1,2*, Kun Tang1,2, Shuxiang Guo1,2,3*, Xihuan Hou1,2, Yu Liu1,2, Huikang Liu1,2, Yao Hu1,2

摘要:
In the narrow, submarine, unstructured environment, the present localization approaches, such as GPS measurement, dead-reckoning, acoustic positioning, artificial landmarks-based method, are hard to be used for multiple small-scale underwater robots. Therefore, this paper proposes a novel RGB-D camera and Inertial Measurement Unit (IMU) fusion-based cooperative and relative close-range local-ization approach for special environments, such as underwater caves. Owing to the rotation movement with zero-radius, the cooperative localization of Multiple Turtle-inspired Amphibious Spherical Robot (MTASRs) is realized. Firstly, we present an efficient Histogram of Oriented Gradient (HOG) and Color Names (CNs) fusion feature extracted from color images of TASRs. Then, by training Support Vector Machine (SVM) classifier with this fusion feature, an automatic recognition method of TASRs is developed. Secondly, RGB-D camera-
based measurement model is obtained by the depth map. In order to realize the cooperative and relative close-range localization of MTASRs, the MTASRs model is established with RGB-D camera and IMU. Finally, the depth measurement in water is corrected and the efficiency of RGB-D camera for underwater application is validated. Then experiments of our proposed localization method with three robots were conducted and the results verified the feasibility of the proposed method for MTASRs.

关键词: vision localization;bio-inspired robots, RGB-D camera, histogram of oriented gradient and color names fusion feature, Cooperative and Relative Localization (CRL)

Abstract:
In the narrow, submarine, unstructured environment, the present localization approaches, such as GPS measurement, dead-reckoning, acoustic positioning, artificial landmarks-based method, are hard to be used for multiple small-scale underwater robots. Therefore, this paper proposes a novel RGB-D camera and Inertial Measurement Unit (IMU) fusion-based cooperative and relative close-range local-ization approach for special environments, such as underwater caves. Owing to the rotation movement with zero-radius, the cooperative localization of Multiple Turtle-inspired Amphibious Spherical Robot (MTASRs) is realized. Firstly, we present an efficient Histogram of Oriented Gradient (HOG) and Color Names (CNs) fusion feature extracted from color images of TASRs. Then, by training Support Vector Machine (SVM) classifier with this fusion feature, an automatic recognition method of TASRs is developed. Secondly, RGB-D camera-
based measurement model is obtained by the depth map. In order to realize the cooperative and relative close-range localization of MTASRs, the MTASRs model is established with RGB-D camera and IMU. Finally, the depth measurement in water is corrected and the efficiency of RGB-D camera for underwater application is validated. Then experiments of our proposed localization method with three robots were conducted and the results verified the feasibility of the proposed method for MTASRs.

Key words: vision localization;bio-inspired robots, RGB-D camera, histogram of oriented gradient and color names fusion feature, Cooperative and Relative Localization (CRL)