Design and Implementation of Smart System for Interaction Between Blind, Deaf and Mute People

Abstract

Difficulties faced by the deaf and dumb people and the blind people to communicate among themselves is the major motivation for the proposal of this project. The project aims at bridging this communication gap by means of an cost-effective electronic device. This is done by using a prototype hand worn glove which converts hand gestures and Braille codes into speech and text, thus enabling speech-impaired and visually impaired people to effectively communicate with everyone. MEMS sensors are used to recognize the gesture sign given by the deaf and dumb people. The gesture input is sent as an audio file which is understandable to the people. The input given by the blind people is in Braille language which is converted to text using scale-invariant feature transform (SIFT) algorithm and decoded to text and voice output through Artificial Neural Networks (ANN) by means of Back Propagation using Supervised Learning. So this ensures two way communication between blind, deaf and dumb people.