Real-time structured light 3D scanning using colour stripes for hand tracking

Abstract

In this paper, we propose a real-time scanning system for hand tracking based on a novel stripe pattern. This pattern uses colour stripes with quadratic intensity distribution in each stripe. The colour distribution is based on a De Bruijn sequence with six colours and order three. Graph cut is utilised to decode the colour information and the resulting code is calculated using local intensity. As the proposed method uses one pattern only, real-time 3D reconstruction can be achieved. After camera and projector calibration, 3D data of a moving hand can be acquired using the real-time system. For each frame of the sequence, the fingertips are detected by making use of the boundary of the 3D precise data and the tracking results can be achieved by collision detection. Some experiments have been performed to evaluate the effectiveness of the proposed method.