Unconstrained Real-time Markerless Hand Tracking for Humanoid Interaction

Abstract

Markerless hand tracking of humans can be applied to a broad range of applications, in robotics, animation and natural human-computer interaction. Traditional motion capture and tracking methods involve the usage of devices such as a data glove, or marker points that are fixed and calibrated on the object to perform tracking. Markerless tracking is free from such needs, and therefore allows for more freedom in movement and spontaneous interaction. In this paper, we analyze how a hand tracking system, which reliably tracks arbitrary hand movements can be implemented. We explored a model based approach that uses particle filters for tracking. In this study we also determine the degree to which the inherent parallel properties of particle filter can be exploited to achieve the goal of real-time tracking. We present the effectiveness of the tracking system via the realtime control of a 20 degrees of freedom dexterous robotic hand