Wound detection and reconstruction using RGB-D camera

摘要

The advent of inexpensive RGB-D sensors pioneered by the original Kinect sensor, has paved the way for a lot of innovations in computer and robot vision applications. In this article, we propose a system which uses the new Kinect 2 sensor in a medical application for the purpose of detection and 3D reconstruction of chronic wounds. Wound detection is based on a per block classification of wound tissue using color histograms and the nearest neighbor approach. The 3D reconstruction is similar to KinectFusion where ICP is used for determining the rigid body transformation, color enhanced TSDF is applied for scene fusion, while the marching cubes algorithm is used for creating a surface mesh. The entire system is implemented in CUDA which enables real-time operation. The end result of the developed system is a precise 3D colored model which can be used for determining a correct therapy and treatment of chronic wounds.