Integrated audio visual information processing in human robot interface

Abstract

A moving robot audio visual system consist from simple microphone or more precise microphone array as an audio sensor and also from a mono or stereo visual robot sensor or video cameras. One of the main functions of audio system in the mobile robots is to help them in speaker localization, in cases of robot interaction with a speaking person via human robot interface. The methods for processing of audio information received with the corresponding audio robot sensors or microphone arrays, as a part of the human robot interface are different, but here in this article is analyzed and tested the ability to integrate the audio information processing and result of sound localization with the results of video information processing in the video part of the human robot interface. It is expected, that this integration can improve both audio sound localization precision and visual finding and tracking accuracy, when the mobile robot use these important information together in his movement to the speaking person.