A Fundamental Examination of Recognition of Manual Alphabets on Color Image

Abstract

Recognition of the handshape is the indispensable step to recognize the JSL (Japanese Sign Language) which uses hands as a part of articulators. We start from recognition of Manual Alphabets (MA below) as a basis to understand the handshape of a sign. In our method considering its application to sign recognition at bust shot size image, we succeeded in obtaining a hand region of the bust shot color image (512 x 512 pixels) by transforming RGB system into HVC (Hue, Value and Chroma) system, and by cutting out automatically a region of a hand out of a region in skin color. The finger region was extracted out by the Erosion-Dilation method from the hand region and the features such as finger vector were obtained. We detected a direction of gradient direction and a figure of a contacted extended finger and used them as the features, which constructed a decision tree and made the MA recognized.