Respiratory motion tracking using Microsoft’s Kinect v2 camera

Abstract

Abstract In image-guided radiotherapy, monitoring and compensating for respiratory motion is of high importance. We have analysed the possibility to use Microsoft’s Kinect v2 sensor as a low-cost tracking camera. In our experiment, eleven circular markers were printed onto a Lycra shirt and were tracked in the camera’s color image using cross correlation-based template matching. The 3D position of the marker was determined using this information and the mean distance of all template pixels from the sensor. In an experiment with four volunteers (male and female) we could demonstrate that real time position tracking is possible in 3D. By averaging over the depth values inside the template, it was possible to increase the Kinect’s depth resolution from 1 mm to 0.1 mm. The noise level was reduced to a standard deviation of 0.4 mm. Temperature sensitivity of the measured depth values was observed for about 10-15 minutes after system start.