Using HoloLens to create a virtual operator station for mobile robots

Abstract

The article describes the latest progress in the development of the virtual operator station for teleoperated mobile robots. The goal of this project has been to create a comfortable way of controlling a mobile robot equipped with stereovision cameras by utilization of a virtual reality head-mounted device (HMD). After the release of the augmented reality headset Microsoft HoloLens, the idea of a virtual operator station was adapted for augmented reality instead of virtual reality, which brought some interesting new advantages to the solution, at the cost of some drawbacks. The article focuses on the technical implementation of the virtual operator station for HoloLens and provides a comparison of different principles of operator stations.