Grasping of a moving object with a robotic hand-eye system

Abstract

Most visual servoing approaches explore the requirements for tracking and eventually grasping of a moving object based on the task at hand. On the other hand, active vision relies on the properties of the environment and the task to define a strategy of measurements by one or more cameras. The focus of our work is to achieve a high level of interaction between the two approaches. In fact the proposed approach addresses at the same time the optimization of the observation process and the achievement of the task at hand. Simulation results are presented for the case of an uncertain pendulum movement. An integrated sensing and actuation system that can operate in a dynamic as well as static environment is presented. It is a multi-sensor system that coordinates observations control, robotic arm command and intercepting the moving object.