Mobile display-based manipulation

Abstract

In this paper, we propose the Mobile Display-based Manipulation (MDM) technique for manipulating simple robots such as automated cleaning robots. By capturing images of robots with a camera-attached mobile display and moving it in a three-dimensional space, a user can easily and intuitively manipulate the robots. To verify the validity and effects of the MDM technique, we developed two prototype systems using a handheld display and a projection display. Issues to be investigated and lessons learned through the design and evaluations of the systems are discussed.