Towards Unlimited Task Coverage and Direct (far-off) Manipulation in eXtended Reality Remote Collaboration

Abstract

The growing interest in remote collaboration is driven by multiple factors. Advances in digital technology have made it increasingly feasible to collaborate from anywhere, breaking down geographical barriers. Despite the rise of new tools several challenges still exist. These include limitations on the remote member's perspective, confined to what on-site members can capture, as well as potential shortcomings for interacting with on-site physical objects. This position paper discusses the potential of leveraging mobile robots within eXtended Reality (XR) environments to transform how remote collaboration is performed. Mobile robots, equipped with cameras, microphones, articulated arms and various sensors, can serve as physical avatars for remote team members, allowing to navigate through physical spaces, enabling real-time, immersive experiences. Combined with XR tools, these robots may empower on-site and remote collaborators to engage in shared activities. These and other arguments in favor of this position are presented and future directions are proposed.