Hybrid team interaction in the mixed reality continuum

Abstract

This paper describes a system, which enables collaboration in a hybrid team consisting of a robot, physically present humans and remote humans, where the latter are connected via Virtual Reality. This setup spans the whole continuum between Physical and Virtual Reality, including Augmented Reality. The work presented herein, describes how such a scattered, hybrid team can interact and cooperate in a virtual representation of a factory, using eye-, head-, hand- and gesture-tracking as multimodal control and communication input.