Transforming library operation with robotics

Abstract

Some years ago, in context of a project titled the UJI librarian robot, UJI Robotic Intelligence Lab developed a robotic mobile manipulator that was able to autonomously locate a book in an ordinary library, and grasp it from a bookshelf, by using eye-in-hand stereo vision and force sensing. The robot was composed of a robot arm mounted on top of a mobile vehicle, and was only provided with book code, a library map and some knowledge about its logical structure. The system took advantage of spatio-temporal constraints and regularities of library environment by applying disparate techniques such as stereo vision, visual tracking, probabilistic matching, optical character recognition, motion estimation, multisensor-based grasping, visual servoing and hybrid control, in such a way that it exhibited a robust and dependable performance. The system was tested, and experimental results showed how it was able to robustly locate and grasp a book in a reasonable time without human intervention. A second version of system was developed later enhancing robot capabilities by replacing parallel-jaw gripper with a three-finger hand, so that book extraction was just one among many possible manipulation skills.