A Multimodal Interaction System for Speech-Based Autism Intervention in Sinhala-Speaking Sri Lankan Children using the NAO Robot

Abstract

This paper presents a multimodal interaction system designed for speech-based autism intervention in Sinhala-speaking Sri Lankan children, utilizing the NAO robot. The system integrates four components, language content detection, dialog management, voice synthesis, and gesture synthesis, to create an engaging and adaptive therapeutic environment. By leveraging these technologies, the system provides real-time, personalized responses that align with the cultural and linguistic needs of Sinhala-speaking children with autism spectrum disorder (ASD). The NAO robot facilitates natural and supportive interaction through synchronized speech and gestures, aiming to improve communication and social skills in children with ASD. Preliminary evaluations demonstrate the potential of the system to enhance engagement and responsiveness in therapy sessions, marking a significant step forward in developing specialized interventions for autism in non-Western, non-English-speaking contexts.