A Systematic Review on Vision-Based Proactive Human Assembly Intention Recognition for Human-Centric Smart Manufacturing in Industry 5.0

Abstract

Proactive human-robot collaborative (HRC) assembly has caught great attention as emerging paradigm for flexible mass personalization in manufacturing with respect to Industry 5.0. To realize adaptive and ergonomic collaboration, it is essential to enable robots recognize human assembly intention based on context-aware information precisely at edge side with Industrial Internet of Thing, also known as human assembly intention recognition (HAIR). For this purpose, this paper systematically reviewed the most relevant papers from major digital databases, where 127 papers are investigated with designed search procedure that published until July 2024. And reviewed papers are summarized from the perspective of: (1) assembly scene perception based on multimodalities data; (2) understanding of HAIR based on machine learning; (3) HAIR application for HRC process. In addition, four current challenges and future research trends are also discussed to facilitate full-adaptive and mutual-cognitive HRC assembly environments.