Metric SLAM in Home Environment with Visual Objects and Sonar Features

Abstract

To increase the intelligence of mobile robot, various sensors need to be fused effectively to cope with uncertainty induced from both environment and sensors. Combining sonar and vision sensors possesses numerous advantages of economical efficiency and complementary cooperation. Especially, it can remedy false data association and divergence problem of sonar sensors, and overcome low frequency vision based SLAM update caused by computational burden and weakness in illumination changes of vision sensors. In this paper, we propose a SLAM method to join sonar sensors and stereo camera together. It consists of two schemes: extracting robust point and line features from sonar data, and recognizing planar visual objects using multi-scale Harris corner detector and its SIFT descriptor from pre-constructed object database. Fusing sonar features and visual objects through EKF-based SLAM can give correct data association via object recognition and high frequency update via sonar features. As a result, it can increase robustness and accuracy of SLAM in home environment. The performance of the proposed algorithm was verified by experiments in home environment with dynamic obstacles