A Voice Instruction Learning System Using PL-T-SOM

Abstract

Learning and relearning ability is important to partner robots. From this point of view, here we propose an intelligent learning system with voice instruction recognition and action learning function. Transient-SOM (T-SOM), an advanced self-organizing map proposed by our previous work for hand gesture recognition and memorization is adopted and improved to be Parameter-Less T-SOM (PL-T-SOM) with an annealing plan. Learning and additional learning experiments used instructions in multiple languages including Japanese, English, Chinese and Malaysian showed the effectiveness of our proposed system.