Fast surgical instruments identification system to facilitate robot picking

Abstract

Surgical instrument sorting, sterilization, and inspection in the hospital are highly time-consuming and labor-intensive due to the sheer volume and variety of tools. It is not easy to find the automation replacement since the diversity and similarity of these instruments bring numerous challenges to their identification, and hence the problem remains largely unresolved. In this paper, we design a system incorporating supervised deep learning networks and conventional methods to realize surgical instruments’ fast and robust identification to facilitate robot picking. Our approach overcomes the difficulties of manually determining the region of interest (ROI) for surgical instruments. We fasten this process through a proposed labeling strategy and hence avoid the high manual labor and time costs. Two types of surgical instruments datasets are created through the design for the first time and are openly available. Robot experiments are performed to demonstrate the effectiveness of our strategy in facilitating surgical instrument automation.