Fusion of stereo and Lidar data for dense depth map computation

Abstract

Creating a map is a necessity in a lot of robotic applications, and depth maps are a way to estimate the position of other objects or obstacles. In this paper, an algorithm to compute depth maps is proposed. It operates by fusing information from two types of sensor: a stereo camera, and a LIDAR scanner. The strategy is to estimate reliably the disparities of a sparse set of points, then a bilateral filter is used to interpolate the missing disparities. Finally, the interpolation is refined. Our method is tested on the KITTI dataset and is compared against several other methods which fuse those modalities, or are extended to perform this fusion. Those tests show that our method is competitive with other fusion methods.