Monitoring task engagement using facial expressions and body postures

摘要

As more industries adopt the use of robots to increase productivity, there is an increased need for effective human-robot interaction training, especially in the case of heavy and high precision robots. This implies the need for easy assessment methods that ensure accurate and personalized employee training. Most current assessments are done via manual observation and surveys. This paper addresses the need for the design of intelligent systems to assess a user's training needs based on the user's behavior and engagement while performing a vocational task simulation. In this paper, we propose a multi-sensory intelligent system to predict user engagement using facial expression and body posture data while the user performs a task to provide cognitive assessment of the user's capabilities, a critical factor in successful vocational performance using robots.