Object tracking with a robotic manipulator mounted on ground vehicle using Image Based Visual Servoing

Abstract

This paper presents an application of a novel approach for detecting and tracking an object with a 2 DOF robotic manipulator which can be equipped with an array of electrically controlled actuators. The said approach utilizes the Image Based Visual Servoing (IBVS) technique. The developed system is able to determine the object pose in real time from features in the image. Object is detected using shaped based approach algorithms of image processing. The position and orientation of the world coordinates of the object being tracked are calculated from the coordinates of the object in image plane using camera's intrinsic and extrinsic parameters. Experimental results demonstrate the effectiveness of this proposed approach.