An interactive control system for mobile robot based on cloud services

摘要

Summary Visual interaction is one of the most important ways for mobile robots to serve the elderly in the future. Mobile robots need to recognize human movements to follow human movements or evade actions. An indoor mobile robot interaction system based on cloud servers is presented. In a human‐machine coexistence environment, the mobile robot recognizes human motion, which represents the control intention for robot. In addition, if the person does not issue a control command, the robot follows the operator moving trajectory as a follower. A mobile robot with four Mecanum wheels is used in experiments. In the robot, a 3D camera is used to capture human motion and recognizes the language control commands. Then, the mobile robot executes the command action after translating the human body language to its motion direction control mode. Moreover, a 2D camera in the robot is used to autonomously capture 2D human multi‐view images and combines facial recognition to achieve specific human target to follow‐up. Some experiments are presented to verify the effectiveness of the whole Interaction control system.