Robust Recovery of Heavily Degraded Depth Measurements

Abstract

The revolution of RGB-D sensors is advancing towards mobile platforms for robotics, autonomous vehicles and consumer hand-helddevices. Strong pressures on power consumption and system price requirenew powerful algorithms that can robustly handle very low quality rawdata. In this paper we demonstrate the ability to reliably recover depth measurements from a variety of highly degraded depth modalities, coupled with standard RGB imagery. The method is based on a regularizer which fuses super-pixel information with the total-generalized-variation (TGV) functional. We examine our algorithm on several different degradations, includingnew Intel's RealSense hand-held device, LiDAR-type data and ultra-sparse random sampling. In all modalities which are heavily degraded, our robust algorithm achieves superior performance over the state-ofthe-art. Additionally, a robust error measure based on Tukey's biweight metricis suggested, which is better at ranking algorithm performance since itdoes not reward blurry non-physical depth results.