Journal of Bionic Engineering ›› 2020, Vol. 17 ›› Issue (2): 215-228.doi: 10.1007/s42235-020-0017-4

• •    下一篇

Natural Feature-based Visual Servoing for Grasping Target with an Aerial Manipulator

Bin Luo, Haoyao Chen, Fengyu Quan, Shiwu Zhang, Yunhui Liu   

  1. 1. School of Mechanical Engineering and Automation, Harbin Institute of Technology Shenzhen, Shenzhen 518055, China
    2. Department of Precision Machinery and Precision Instrumentation, University of Science and Technology of China, Hefei 230026, China
    3. Department of Mechanical and Automation Engineering, Chinese University of Hong Kong, Hong Kong 999077, China
  • 收稿日期:2019-08-05 修回日期:2020-01-30 接受日期:2020-02-17 出版日期:2020-03-10 发布日期:2020-03-27
  • 通讯作者: Haoyao Chen E-mail:hychen5@hit.edu.cn
  • 作者简介:Bin Luo1, Haoyao Chen1*, Fengyu Quan1, Shiwu Zhang2, Yunhui Liu3

Natural Feature-based Visual Servoing for Grasping Target with an Aerial Manipulator

Bin Luo1, Haoyao Chen1*, Fengyu Quan1, Shiwu Zhang2, Yunhui Liu3   

  1. 1. School of Mechanical Engineering and Automation, Harbin Institute of Technology Shenzhen, Shenzhen 518055, China
    2. Department of Precision Machinery and Precision Instrumentation, University of Science and Technology of China, Hefei 230026, China
    3. Department of Mechanical and Automation Engineering, Chinese University of Hong Kong, Hong Kong 999077, China
  • Received:2019-08-05 Revised:2020-01-30 Accepted:2020-02-17 Online:2020-03-10 Published:2020-03-27
  • Contact: Haoyao Chen E-mail:hychen5@hit.edu.cn
  • About author:Bin Luo1, Haoyao Chen1*, Fengyu Quan1, Shiwu Zhang2, Yunhui Liu3

摘要: Aerial transportation and manipulation have attracted increasing attention in the unmanned aerial vehicle field, and visual servoing methodology is widely used to achieve the autonomous aerial grasping of a target object. However, the existing marker-based solutions pose a challenge to the practical application of target grasping owing to the difficulty in attaching markers on targets. To address this problem, this study proposes a novel image-based visual servoing controller based on natural features instead of artificial markers. The natural features are extracted from the target images and further processed to provide servoing feature points. A six degree-of-freedom (6-DoF) aerial manipulator system is proposed with differential kinematics deduced to achieve aerial grasping. Furthermore, a controller is designed when the target object is outside a manipulator’s workspace by utilizing both the degrees-of-freedom of unmanned aerial vehicle and manipulator joints. Thereafter, a weight matrix is used as basis to develop a multi-tasking visual servoing framework to integrate the controllers inside and outside the manipulator’s workspace. Lastly, experimental results are provided to verify the effectiveness of the proposed approach.

关键词: unmanned aerial manipulator, visual servoing, aerial grasping, multi-tasking strategy

Abstract: Aerial transportation and manipulation have attracted increasing attention in the unmanned aerial vehicle field, and visual servoing methodology is widely used to achieve the autonomous aerial grasping of a target object. However, the existing marker-based solutions pose a challenge to the practical application of target grasping owing to the difficulty in attaching markers on targets. To address this problem, this study proposes a novel image-based visual servoing controller based on natural features instead of artificial markers. The natural features are extracted from the target images and further processed to provide servoing feature points. A six degree-of-freedom (6-DoF) aerial manipulator system is proposed with differential kinematics deduced to achieve aerial grasping. Furthermore, a controller is designed when the target object is outside a manipulator’s workspace by utilizing both the degrees-of-freedom of unmanned aerial vehicle and manipulator joints. Thereafter, a weight matrix is used as basis to develop a multi-tasking visual servoing framework to integrate the controllers inside and outside the manipulator’s workspace. Lastly, experimental results are provided to verify the effectiveness of the proposed approach.

Key words: unmanned aerial manipulator, visual servoing, aerial grasping, multi-tasking strategy