A Collaborative Robot System Based on AR in Surgical Scenarios

Abstract

The concept of telekinesis, often depicted in science fiction as the ability to manipulate objects without physical contact, inspires our research in enhancing human-robot interaction (HRI). This paper introduces a robotic teleoperation system for medical applications, integrating Augmented Reality (AR) and robotic arm technology to enable remote manipulation capabilities. Initially, we outline a methodological framework from the selection to manipulation of surgical instruments, significantly enhancing the precision and responsiveness of the robotic system in telemedical applications. Subsequently, our experimental workflow demonstrates the system's effectiveness in surgical settings, reducing errors and simplifying operations. This innovation not only actualizes remote manipulation but also offers significant improvements in remote medical procedures, providing a labor-saving interaction framework.