Real-time social touch gesture recognition for sensate robots

Abstract

This paper describes the hardware and algorithms for a realtime social touch gesture recognition system. Early experiments involve a sensate bear test-rig with full body touch sensing, sensor visualization and gesture recognition capabilities. Algorithms are based on real humans interacting with a plush bear. In developing a preliminary gesture library with thirteen symbolic gestures and eight touch subtypes, we have taken the first steps toward a robotic touch API, showing that the huggable robot behavior system will be able to stream currently active sensors to detect regional social gestures and local sub-gestures in realtime. The system demonstrates the infrastructure to detect three types of touching: social touch, local touch, and sensor-level touch.