3-D drawing system via hand motion recognition from two cameras

Abstract

The authors propose a novel human interface system, 3-D Drawing System, which allows a user to draw on virtual 3D space in a computer with a user's hand motions and hand poses. The system has two cameras; one camera takes a top-view of the desktop and another takes a side-view. The input image of the top camera is transformed into the distance-transformed image, which is used for deciding Palm Square that gives the base size, position, and direction of hand. The Palm Square determines Finger Windows which are used for detecting each finger's expansion that is decided by the number of pixels in the Finger Window. The user's command is input to the system by the finger's expansion. At the same time, we extract the fingertip and estimate the 3D position by comparison with the image obtained with the side camera. The procedures are very simple so we can develop the real time 3D drawing system, which allows the user to draw figures in 3D space, and handle 3D virtual objects.