A cooking assistant robot using intuitive onomatopoetic expressions and joint attention

Abstract

A novel cooking assistance interface is proposed that guides users in the precise timing of cooking actions by means of intuitive onomatopoetic expressions associated with different cooking states and nonverbal movements on the part of a cooking assistant robot such as focusing attention through eye-gazing and gestures. The effectiveness of the scheme is demonstrated using the system to assist subjects in preparing a familiar recipe (pancakes).