Development of a Humanoid Reading System with Voice Lip Synchronization

Abstract

With the increasing use of service robots in people’s daily lives, there is a growing expectation that robots not only perform service tasks independently but also play a role in education. To improve the interactive capabilities and functionality of humanoid robots, we have developed a humanoid robot reading system that can read books. The system comprises two main modules: A document character recognition module and a lip synchronization reading module. The document character recognition module detects and recognizes the captured document images from the cameras and extracts the text from the image, and the lip synchronized reading module outputs the reading text by synchronizing voice and lip movements. Our team has independently developed a humanoid robot that has successfully implemented this system.