Audio to Sign Language conversion using Natural Language Processing

Abstract

People who are deaf never get to enjoy things that hearing folks do, whether it's conversation, playing the game, going to seminars, or participating in virtual meetings, for example. The major challenge they have while interacting among regular people is connection, because every regular person has no concept what sign language is or how it works.. Our project's objective is to help those who have hearing loss develop a system for communication. The spoken message is converted into signs. It converts the spoken word into signs. This system receives voice as inputs, converts the soundtrack into a text, and displays the key symbols used in Indian language using well before graphics or GIFs. The use of this technology makes communication between those who have normal hearing and those who are difficult to hear easier This takes into account how your arms, body, and appearance are combined. Around the universe, there really are 135 different varieties of hand signals. There are numerous different sign languages, including American Sign Language (ASL), Indian Sign Language (ISL), British Sign Language (BSL), Australian Sign Language (Auslan), and many more In this initiative, Indian Sign Language is being used. The deaf community may take advantage of all the activities that hearing people engage in, from social engagement to accessing information, thanks to this technology. NLP is used to pre-process the text (Natural Language Processing). With the help of this technology, hearing-impaired people may participate in a wide range of activities, from socialising to accessing information NLP is used to post the text (Natural Language Processing). This programme converts audio into text, displays Indian sign language, and then accepts speech as input. Accuracy rate for the planned project work is 99%, and Validation accuracy is 96%.