Abstract
In general, a good interaction including communication can be achieved when verbal and non-verbal information such as body movements, gestures, facial expressions, can be processed in two directions between the speaker and listener. Especially the facial expression is one of the indicators of the inner state of the speaker and/or the listener during the communication. Therefore, recognizing the facial expressions is necessary and becomes the important ability in communication. Such ability will be a challenge for the visually impaired persons. This fact motivated us to develop a facial recognition system. Our system is based on deep learning algorithm. We implemented the proposed system on a wearable device which enables the visually impaired persons to recognize facial expressions during the communication. We have conducted several experiments involving the visually impaired persons to validate our proposed system and the promising results were achieved.
Highlights
In everyday life, the visually impaired persons face many challenges such as finding a path in unknown environments as well as visually recognizing their surroundings including the objects, human body or face
Many studies have been done to enable the computer and/or the machine to see the world as human does through developing the algorithm in visual recognition systems including object detection, object recognition, and so forth [1,2,3,4,5,6,7,8,9,10,11,12,13,14,15]
We focus on facial expressions recognition as one of the important non-verbal information during the social interaction
Summary
The visually impaired persons face many challenges such as finding a path in unknown environments as well as visually recognizing their surroundings including the objects, human body or face. Non-verbal information such as body movements, gestures, facial expressions; takes a great role in a face-to-face interaction including communication [16,17,18]. The facial expression is strongly related to human emotion that indicates the inner state of the speaker and/or the listener during communication. Such information is important in engaging a good communication as well as interaction with the others. The visually impaired persons that in general have difficulties to obtain such information having the limitation in social interaction [19]. To the best of our knowledge, there are only few assistive devices available for supporting visually impaired persons in capturing non-verbal information during social interaction
Sign-in/Register to view highlights & summary Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callMore From: Bulletin of Electrical Engineering and Informatics
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
