A Continual Learning Method for Generalized Grasping Manipulation in a Musculoskeletal Robot

Abstract

Musculoskeletal robotic systems offer structural advantages while presenting significant control challenges. Current research on their manipulation capabilities, particularly multi-object grasping scenarios, remains insufficient. Furthermore, as robots operate in dynamic environments with evolving task requirements, developing their ability to grasp novel objects while maintaining existing manipulation skills becomes crucial. To address these challenges, we propose a novel continual learning method for generalized grasping manipulation in a musculoskeletal upper limb robot. First, we propose an end-to-end learning method for multi-object grasping that leverages object-specific latent features and multi-level states of a musculoskeletal robot. Additionally, a novel continual learning method for grasping tasks is proposed with a bio-inspired object-preference-based experience replay selector, which optimizes learning efficiency while mitigating catastrophic forgetting. Our approach successfully masters the grasping manipulation task of 10 objects in the first phase and continually learns 23 additional objects in the second phase, outperforming existing methods in both multi-object grasping and continual learning. Furthermore, our analyses of muscle synergy and methodological robustness demonstrate that the proposed approach generates biologically plausible muscle synergies and exhibits strong robustness against object observation bias and neural excitation noise. Our experiments, conducted both in simulation and on a hardware system, demonstrate the practical transferability of our method to an articulated dexterous hand grasping task.