Quick Search Adv. Search

Journal of Bionic Engineering ›› 2020, Vol. 17 ›› Issue (2): 215-228.doi: 10.1007/s42235-020-0017-4

    Next Articles

Natural Feature-based Visual Servoing for Grasping Target with an Aerial Manipulator

Bin Luo1, Haoyao Chen1*, Fengyu Quan1, Shiwu Zhang2, Yunhui Liu3   

  1. 1. School of Mechanical Engineering and Automation, Harbin Institute of Technology Shenzhen, Shenzhen 518055, China
    2. Department of Precision Machinery and Precision Instrumentation, University of Science and Technology of China, Hefei 230026, China
    3. Department of Mechanical and Automation Engineering, Chinese University of Hong Kong, Hong Kong 999077, China
  • Received:2019-08-05 Revised:2020-01-30 Accepted:2020-02-17 Online:2020-03-10 Published:2020-03-27
  • Contact: Haoyao Chen E-mail:hychen5@hit.edu.cn
  • About author:Bin Luo1, Haoyao Chen1*, Fengyu Quan1, Shiwu Zhang2, Yunhui Liu3

Abstract: Aerial transportation and manipulation have attracted increasing attention in the unmanned aerial vehicle field, and visual servoing methodology is widely used to achieve the autonomous aerial grasping of a target object. However, the existing marker-based solutions pose a challenge to the practical application of target grasping owing to the difficulty in attaching markers on targets. To address this problem, this study proposes a novel image-based visual servoing controller based on natural features instead of artificial markers. The natural features are extracted from the target images and further processed to provide servoing feature points. A six degree-of-freedom (6-DoF) aerial manipulator system is proposed with differential kinematics deduced to achieve aerial grasping. Furthermore, a controller is designed when the target object is outside a manipulator’s workspace by utilizing both the degrees-of-freedom of unmanned aerial vehicle and manipulator joints. Thereafter, a weight matrix is used as basis to develop a multi-tasking visual servoing framework to integrate the controllers inside and outside the manipulator’s workspace. Lastly, experimental results are provided to verify the effectiveness of the proposed approach.

Key words: unmanned aerial manipulator, visual servoing, aerial grasping, multi-tasking strategy