“Mudra” (Text to Speech Conversion with Hand Gestures)

Abstract

One of the non-verbal communication techniques utilized in sign language is the hand gesture. Deaf persons who struggle with speech or hearing most frequently use it to converse with each other and hearing people. Several makers around the world have created various sign language systems, but they are neither adaptable nor cost-effective for end users. The majority of programs only provide text- based results. So, we are going to offer a system prototype in an application that solves the aforementioned issue. Hand gestures can be translated into text and then spoken by the system. Several algorithms will be used by the system, including CNN for classifying hand movements and SVM for detection of hand movement & TTS for conversion of Text To Speech.