Gesture Based Music Generation

Abstract

We designed and developed a framework for generation of music and synchronization of dance on Humanoid Robot. Gestures are well suited for communication, here used for producing entertaining rhythmic musical pattern. We applied two different music generation approaches: Random motion and human gesture. The linear and angular body movements are extracted and several motion features were found, these features were mapped to musical knowledge and thus generated the rhythmic pattern. We synchronized the obtained music with HOAP-2 Humanoid Robot dance on Webots simulator. We find very interesting musical patterns which infer gesture can be used for the composition of music.