Implementation of a Mobile Application as a Tool for Recognition and Interpretation of Nonverbal Language to Improve Communication with Deaf-Mute People

Abstract

In the present study, it was observed that a certain percentage of people with hearing and sound disabilities are not understood, as some non-disabled people do not know or master sign language, resulting in a lack of communication with deaf-mute people. Although it is true that nowadays communication and social inclusion is essential, it is for this reason that the mobile application for the recognition and interpretation of non-verbal language was implemented through the agile SCRUM methodology, it allows a better flexibility in developing the requirements established by the users, in addition, it adapts to the different changes in the development process of the mobile application based on the needs of the users. For the development of the application, a survey was made to citizens of a community, which helped to determine the contents of the mobile application, in which the information module is responsible for detailing information related to hand language and its application, on the other hand, there are the manual translation and consultation modules, which have the functions of translating hand movements, either by means of a camera or a keyboard, among others. As a result, several modules of the mobile application were developed and optimized to meet the needs of the surveyed users. The implementation of the mobile application provided communication and social inclusion facilities, since it allowed a better interaction between people without disabilities and deaf-mute people, generating knowledge about the meaning and execution of hand language. Keywords— Mobile Application, Communication, Sign Language, Non-verbal Language, Interpretation, Deaf Mutes.