The real-time video stabilization for the rescue robot

Abstract

When rescue robots navigate in a rough terrain, significant vibration of the video occurs unavoidably and a video stabilization system is proposed in this paper to reduce the disturbance on the visual system of the present rescue robots. The Kalman filter is applied to estimate the motion vector of the robot and the false estimation occurrence can be thus greatly reduced by applying analysis of correlation and variance of the motion vector estimation. With a hierarchical searching algorithm implemented on the TI DSP 6437, the frame rate can be improved from 10 fps to 28 fps to realize the real-time video stabilization and furthermore, the cooperative mission of multiple rescue robots has been achieved by applying the developed visual servo technique. The proposed virtual bounded motion control algorithm further leads the robots approaching the target precisely with cooperation of multiple rescue robots. The demo video is available at: http://lab816.cn.nctu.edu.tw/DemoVideo/. video stabilization