Ambiguous command understanding with commonsense

Abstract

This paper proposes our approach to disambiguate human pointing gesture by using commonsense knowledge. Pointing gesture is a natural way to specify the object that a user needs in the “Bring something” service. However, error in gesture recognition makes robot difficult to select the correct candidate object when there are multiple objects located closely together. To solve this problem, Robot Technology (RT) Ontology was used to make assumption about human activity and necessary objects for the activity. By combining this commonsense reasoning with the spatial constrain from human's pointing direction, robot is able to find appropriate object. Experiment showed the successful rate of object selection was improved, and therefore robotic service becomes more intuitive.