Ellipse proposal and convolutional neural network discriminant for autonomous landing marker detection

摘要

Abstract Autonomous landing in complex environments is a critical problem for unmanned aerial vehicle autonomous control, and efficiently detecting landing identification mark in real‐world scenario is still challenging. Due to the limited computational power of airborne computing equipment, current target detection algorithms cannot meet the demand efficiently. In this paper, we proposed a new landing marker detection algorithm for autonomous landing systems in a real environment. We used an ellipse detection algorithm to detect the ellipse landmark or other elliptical objects. Furthermore, convolution neural networks were utilized to obtain the correct landmarks, which is robust, fast and can achieve a speed of 25 fps with 720p resolution video on an Intel NUC onboard computer. Unlike the other methods, the accuracy and speed of our algorithm is verified in a real‐time application with more harsh conditions. During system testing, the flight system can detect the object above 20 m, track it, and automatically land on it with this vision algorithm. The algorithm has helped us achieve the first position at Mohamed Bin Zayed International Robotics Challenge in Abu Dhabi this year.