Simulating tele-manipulator controlled tool-tissue interactions using a nonlinear FEM deformable model.

Abstract

Enhanced visualization of an operating scene presented by a robotically assisted tele-manipulator system such as the da Vinci(TM) can be provided through the use of augmented reality facilities. Generating overlays from 3D models and the intra-operative video allows the surgeon to acquire greater information about the surgical scene. Tool-tissue interactions must be tracked to ensure the overlays are updated regularly and accurately. The work presented here describes how these interactions may be modelled by integrating a nonlinear finite element model with the 3D reconstruction and using the tool kinematic data as input to the deformation.