Visual Feedback Control of a Robot in an Unknown Environment (Learning Control Using Neural Networks)

Abstract

In this chapter, a visual feedback control approach based on neural network is presented for a robot with a camera installed on its end-effecter to trace an object in an unknown environment. Firstly, the necessary conditions for mapping the image features of the object to be traced to the joint angles of the robot are derived. Secondly, a method is proposed to generate a goal trajectory of the robot by measuring the image feature parameters of the object to be traced. Thirdly, a multilayer neural network is used to learn off-line the mapping in order to produce on line the reference inputs for controlling the robot. Fourthly, a multilayer neural network-based learning controller is designed for the compensation the nonlinear robotic dynamics. Lastly, the effectiveness of