Wireless Wearable for Sign Language Translator Device with Android-Based App

Abstract

Sign language translator device is an assistive device that helps hearing impaired and normal people communicate with each other. The device can be either a camera vision-based or wearable glove-based system that translates hand gestures into text or voice. However, vision-based devices are susceptible to low light conditions and expensive. In contrast, glove-based devices are popular and low cost, but many designs utilized cable system that limits hand motions. The main focus of this work is to develop a wireless wearable sign language translator device, so that free-hand motions can be achieved. An Android-based smartphone application (app) has been developed to receive and display translated gestures from the wearable device in text form. The usage of smartphone app significantly reduces development cost, simplifies the design and improves the ease-of-use for hearing impaired communities. In this article, the developed hardware, circuit diagrams, app development as well as experimental results are presented.