Robot System Assistant (RoSA): concept for an intuitive multi-modal and multi-device interaction system

Abstract

This paper presents RoSA, the Robot System Assistant, a concept for intuitive human-machine-interaction based on speech, facial, and gesture recognition. The interaction modalities were found and reviewed through a preceding wizard-of-Oz study showing high impact for speech and pointing gestures. The system’s framework is based on the Robot Operating System (ROS), allowing modularity and extendability. This contactless concept also includes ideas for multi-device and multi-user implementation, using different workstations.