Visual System of Avatar Robot Using Eye-Tracking and Foveated Rendering

Abstract

Herein, an avatar robot visual system using a head-mounted display (HMD) that performs a foveated rendering processing using eye-tracking technology on images obtained from a stereo camera is developed. The distance between the two cameras of the avatar robot's eyes is automatically controlled according to the interpupillary distance of the operator measured by the HMD. Foveated rendering with eye tracking technology reduces the amount of data and selectively presents visual information to the operator. This minimized discomfort and improves immersion during operation. Consequently, the perceptual precision of the surrounding position is enhanced, because visual information outside the focal area is reduced.