フルハイビジョン映像からの音楽演奏時の身体・手・顔のモーションキャプチャ

Abstract

We propose a system that can capture the motion of an entire body from full high-definition (HD) television images. It is possible to precisely measure the movements of the body parts, i.e. the facial expression, trunk, arms, legs, and fingers using a high-resolution image. Processing high-resolution images requires a reduction of the computational efforts. We prepare a low-resolution image by downsizing an HD image to a quarter width and height, since capturing the motion of a person's trunk, arms, and legs does not always require a high-resolution image. After capturing the motion of the body from the low resolution image, we extract the images of the face and left and right hands from the HD image based on the captured motion so that each body part could be located in the center of the extracted images. The finger motion and facial expression are obtained from the HD quality images.