The research and design of Smart mobile robotic arm based on gesture controlled

Abstract

In this paper, a smart mobile robotic arm based on gesture control is designed, which is constituted of a remote-control smart car with a robotic arm equipped on the car. The gesture recognition sensor is the Leap Motion module and uses the Processing API function on the PC to locate the position information of both hands in 3D space and convert it into various control data. It uses Bluetooth and the car system to communicate. The car system uses the STM32's NUCLEO-F411RE development board as the controller to analyze and process the gesture data received by Bluetooth accordingly. The left-hand gesture signal was implemented for the movement control of the car, and the right-hand gesture signal is converted into 5 steering gear PWM signals to control the robot arm Elbow and wrist motion and grab. The experimental results show that the car and robot arm can complete the response accurately and quickly, and implement various remote control according to gestures.