Designing multimodal interaction for assistive robotic arm

Abstract

In this paper, we present our approach for designing interaction with complex assistive devices such as a robotic arm. We combine a previous work on controlling the Manus arm through a PDA and a novel framework that can extend interaction capabilities. The whole system gives the possibility of configuring both graphical and physical user interfaces, by making interaction more generic and open to any assistive environment.