Instruction Taking in the TeamTalk System

Abstract

TeamTalk is a dialog framework that supports multiparticipant spoken interaction between humans and robots in a task-oriented setting that requires cooperation and coordination among team members. We describe two new features to the system, the ability for robots to accept and remember location labels and the ability to learn action sequences. These capabilities were made possible by incorporating an ontology and an instruction understanding component into the system.