Robot Arm System Based on Augmented Reality Approach

Abstract

Augmented reality (AR) is a form of information and communication technology that provides virtual visual information (i.e., images, animation, or video) augmented upon physical reality through computer devices. This study aims to use AR technology on a robot arm system and act as feedback data for this system. The AR technology is applied to an AR marker (i.e., ARTag marker), and ARTag data are acquired using 3D or depth cameras. This robot arm system operates to retrieve target objects located in the scanning area scanned by cameras. After the target object has been identified, the robot arm moves the target object to the target location. The system works by combining the robot arm control and AR algorithms. The control algorithm is used for controlling the robot arm movement, whereas the AR algorithm is for identifying ARTag markers. Therefore, this study focuses on building an efficient AR algorithm to identify the target and non-target objects and test this algorithm on an actual robot arm. Results indicate that the robot arm can capture the target object successfully, and the camera can accurately read the coordinates of the ARTag marker located on the target object. Therefore, this research successfully developed an AR-based robot arm system.