Development of an augmented reality simulator for a robotic system used in single incision laparoscopic surgery

Abstract

Augmented Reality (AR) became a very useful tool for various domains, with multiple applications in different medical fields, where this technology is integrated in medical training, image-based diagnosis, simulation of medical tasks, or in guiding systems for surgical procedures. The introduction of AR technology in robotic assisted surgery is relatively new and challenging considering the required precision for this type of medical task. The objective of this study is to develop an AR simulator for robotic assisted Single Incision Laparoscopic Surgery (SILS) where the robot performing the procedure is embedded in a virtual environment, providing both an interactive training and a simulation environment. The architecture and particularities of the proposed robot for SILS are analyzed for a better understanding of the structure, to obtain the validation of the kinematic model. The final result is represented in the form of an application which can be operated with Hololens 2 device.