New Application of Children’s Sign Language Enlightenment Based on Data Glove

Abstract

In order to enhance the learning interest of deaf-mute children as beginners in sign language and promote the balance of educational reform, we have developed a new application which based on data gloves, to be the enlightenment for children learning sign language. The application mainly includes three parts: data acquisition and conversion, wireless communication, and cartoon interactive application. The application, taking STM32 development board as the control core, is integrated with multiple sensor function modules including Wi-Fi wireless communication, three-axis gyroscope, bending resistor and others, therefore, it can realize the gesture recognition and data transmission. After repeated testing, the system has high accuracy in gesture recognition, not only data transmission is reliable but also the application response timely. Deaf-mute children can use the cartoonish application to get sign language examination questions and to answer by wearing data gloves, and then the system will give a star rating comprehensively based on whether the answer is correct, on whether the cue is clicked in answering question and on other aspects, so as to realize the interaction with the PC program and let deaf-mute children contact and learn sign language in games. The design concept of the application has received favorable response from Qingdao school for the deaf, which has a certain practical and promoted value.