Whole-body imitation of human motions with a nao humanoid

Abstract

We present a system that enables a humanoid robot to imitate complex whole-body motions of humans in real time. For recording the human motions, any sensor system capable of inferring the joint angle trajectories can be used. In our work, we capture the human data with an Xsens MVN motion capture system consisting of inertial sensors attached to the body. Our framework converts the human joint angles to the robot's joint angles in real time. Here, we use a mapping between the human's and the robot's joints to ensure feasibility of the motion. The focus of our system lies in ensuring static stability when the motions are executed which is a challenging task, depending on the complexity of the movements. To avoid falls of the robot that might occur when using direct imitation of the joint angle trajectories due to the different weight distribution, we developed an approach that actively balances the center of mass over the support polygon of the robot's feet. At every point in time, our approach ensures that the robot is in a statically stable configuration, i.e., that the ground projection of the center of mass lies within the convex hull of the foot contact points. To achieve this, we apply inverse kinematics given valid foot positions that satisfy the stability criterion and generate the corresponding leg joint angles. In more detail, our system first finds valid positions for the robot's feet by determining a target plane and its orientation, so that the feet can be placed planar and the robot's center of mass is over the support polygon. The new positions of the feet are chosen as the projection on the target plane. Afterwards, the corresponding leg joint angles are calculated via inverse kinematics. To determine whether the configuration is in the double support modus, and if not, which foot is the stance foot, we evaluate the position of the center of mass relative to the feet.