RPPG Detection in Children with Autism Spectrum Disorder during Robot-Child Interaction Studies

Abstract

Children with ASD (Autism spectrum disorder) have difficulties in expressing their emotions and social interaction with their environment. In recent studies, asistive robots are used to support children's social skills and emotion recognition is performed to improve the quality of the interaction between the robot and the child. In this study, rPPG(remote photoplethysmography) signals were extracted using face images that were captured through camera during the interaction between the robot and children with ASD. These signals were then compared with the physiological data obtained through Empatica E4 wristwatch. The results were evaluated and the reasons that might affect the results were discussed. Although the correlation between these data was low, some advantages were found in the results compared to both the E4 wristwatch and emotion recognition from face. Unlike the signals obtained from E4, rPPG signals can be found when the child moves. In addition, although no emotion can be detected from the child's face, rPPG signals can be obtained. The aim of the study is to use rPPG signals in emotion recognition as an alternative method since other emotion recognition modalities face with challenges during robot child interaction in children with ASD.