6DoF object pose measurement by a monocular manifold-based pattern recognition technique

Abstract

In this paper, a novel solution to the compound problem of object recognition and 3D pose estimation is presented. An accurate measurement of the geometrical configuration of a recognized target, relative to a known coordinate system, is of fundamental importance and constitutes a prerequisite for several applications such as robot grasping or obstacle avoidance. The proposed method lays its foundations on the following assumptions: (a) the same object captured under varying viewpoints and perspectives represents data that could be projected onto a well-established and highly distinguishable subspace; (b) totally different objects observed under the same viewpoints and perspectives share identical 3D pose that can be sufficiently modeled to produce a generalized model. Toward this end, we propose an advanced architecture that allows both recognizing patterns and providing efficient solution for 6DoF pose estimation. We employ a manifold modeling architecture that is grounded on a part-based representation of an object, which in turn, is accomplished via an unsupervised clustering of the extracted visual cues. The main contributions of the proposed framework are: (a) the proposed part-based architecture requires minimum supervision, compared to other contemporary solutions, whilst extracting new features encapsulating both appearance and geometrical attributes of the objects; (b) contrary to related projects that extract high-dimensional data, thus, increasing the complexity of the system, the proposed manifold modeling approach makes use of low dimensionality input vectors; (c) the formulation of a novel input‐output space mapping that outperforms the existing dimensionality reduction schemes. Experimental results justify our theoretical claims and demonstrate the superiority of our method comparing to other related contemporary projects.