AI empowered Auslan learning for parents of deaf children and children of deaf adults

Abstract

AbstractCommunication poses a challenge for the deaf and hearing loss community. This difficulty is even more pronounced in the families of Children of Deaf Adults (CODAs) and Parents of Deaf Children (PODCs). To help these families overcome this challenge, we design an AI-empowered interactive bi-directional Australian Sign Language (i.e., Auslan) dictionary application to facilitate communication within a household. Technically, our APP can not only look up sign gestures for the given English words but also translate isolated Auslan gestures into English. Through an inviting user interface and experience design, we can further improve engagement within the CODA and PODC families while enabling Auslan education at home. The positive user experience underscores the success of our APP not only in leveraging AI to revolutionise Auslan education but also in promoting cross-generational language acquisition and communication.