Mixed reality robotic user interface

Abstract

A Robotic User Interface (RUI) is part of a concept in which a robot is used as an interface for human behavior. By combining the RUI with Mixed Reality (MR) technology, we propose a MR RUI system that enables the presentation of enhanced visual information of a robot existing in the real world. In this paper, we propose the virtual kinematics to enhance robot motion. A MR RUI system with virtual kinematics can present a selection of visual information by controlling the robot through physical simulation and by changing the parameter dynamically.