Movement Operation Interaction System for Mobility Robot Using Finger-Pointing Recognition

Abstract

Finger pointing is an intuitive method for people to direct a robot to move to a certain location. We propose a system that enables the movement operation of a mobility robot by using finger-pointing gestures for an automatic and intuitive driving experience. We employ a method to recognize gestures by using video images from a USB camera mounted on a wearable device. Our method does not require the use of infrared sensors. Three movement commands for forward motion, turning, and stopping are chosen based on gesture recognition, face orientation detection, and an intelligent safety system. We experimentally demonstrate the usefulness of the system using a scooter-type mobility robot.