Abstract

We are developing a real-time Japanese sign language recognition system that employs abstract hand motions based on three elements familiar to sign language: hand motion, position, and pose. This study considers the method of hand pose recognition using depth images obtained from the Kinect v2 sensor. We apply the contour-based method proposed by Keogh to hand pose recognition. This method recognizes a contour by means of discriminators generated from contours. We conducted experiments on recognizing 23 hand poses from 400 Japanese sign language words. Index Terms: hand pose, contour, sign language recognition, real-time, Kinect

Highlights

  • In Japan, Japanese sign language is usually used among hearing impaired people to communicate

  • Our study develops with real-time recognition of sign language words

  • This study considers a hand pose recognition using depth images obtained from a single depth sensor

Read more

Summary

Introduction

In Japan, Japanese sign language is usually used among hearing impaired people to communicate. These people often communicate with others through a third person who understands both oral and sign language. No practical sign language recognition system exists, even one that recognizes isolated words. Sign language recognition incorporates various visual components, such as hand motions, hand poses and facial expressions. No established study exists on representing the structure of Japanese sign language in a similar manner to that of spoken language. Few attempts recognize sign language by units such as hand motions and hand poses [1, 2]

Methods
Results
Conclusion

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.