Augmented Reality Application of Sign Language for Deaf People in Android Based on Smartphone

Abstract

The aim of this study was to create augmented reality application that can display three-dimensional animated hand movements on a media card and implemented on the Android operating system. Modelling was begun with doing observation, in which the object of the observation was people who have a deficiency in hearing and speaking or often called deaf. The system made aimed at helping normal people in studying the letter cues when trying to communicate with the deaf. The results obtained is an application created with augmented reality and can be used by anyone having an Android-based smartphone that wants to recognize the letter cues by using letter card as the card marker. So that, when the camera is directed to the card compiled into a single word, the letter marker on the card will be detected by the application and will appear animated hand movement of each letter scanned by the camera in real-time. This is the purpose of the augmented reality on this letter recognition application, namely giving rise animation in real-time that can attract someone to study the letter cues.