3-D modeling of spatial referencing language for human-robot interaction

摘要

One of the key components for natural interaction between humans and robots is the ability to understand the spatial relationships that exist in the natural world. Previous research has shown that modeling the 2D spatial relationships of FRONT, BEHIND, LEFT, RIGHT, and BETWEEN can be accomplished with results consistent with that of a human being. Upcoming research will involve a human subject study to investigate the use of spatial relationships in 3D space. This will be the first step in extending previous research of the 2D spatial relations into a 3D representation through the use of 3D object point clouds generated by the SIFT algorithm and stereo vision. This will allow for the enrichment of our human-robot dialog to include phrases such as "Bring me the coffee cup on top of the desk and to the right of the computer.