Machine Vision and Artificial Intelligence in Robotics for Smart Factory

Abstract

In this work, we have illustrated how machine vision and artificial intelligence could enhance operations in a smart factory along with a robot via several use cases. The first use case is to teach the robots with a leap motion sensor. In Industry 4.0 environment, the intelligent factories decide the subsequent actions based on the sensor data. The leap motion sensor can control a robot’s movements and is beneficial, particularly in smart factory environments. We have demonstrated how a leap motion sensor could control picking and dropping off cylindrical objects. The second use case is to control a robot using a mouse and how the robot could play chess. For this use case, we taught the robot to grip a chess object and put it in the designated place. Similarly, we also use a machine vision camera for detecting several entities, such as wingnuts and bolts. The TensorFlow algorithm has been utilized for detecting different shapes and colors.