LeapArm-Facilitating Sensory Spaces for Mid-air Gestural Interaction

Abstract

We present the LeapArm system, which combines a Leap Motion controller for mid-air gestural human-computer interaction with a robotic arm. LeapArm actuates in real-time the orientation of the controller towards a user's hand, dynamically expanding the sensory space for mid-air interaction. We describe several desktop use scenarios and rapid transitions between them, which are enabled by the LeapArm system and discuss how actuated 3D controllers change the design space for gestural interaction.