Revitalizing Cantonese Proficiency: An Interactive ASR-Driven Approach

Abstract

In recent years, an increasing number of children in the Guangdong region found themselves unfamiliar with Cantonese which is their native language. This trend poses a significant threat to the preservation of the rich cultural heritage and traditions associated with the Cantonese language, meanwhile Cantonese is very different from Mandarin so it is very difficult to learn. Recognizing this challenge, the "Assistant for Cantonese Learning" app has been developed to bridge this gap. The app aids in using an ASR model to provide exercises tailored to a student's proficiency, allowing the user's mastery of Cantonese to be assessed based on the comparison between the translated text and the original text provided by the system, as well as the correctness of the user's pronunciation and intonation. Using OpenAI's advanced Whisper ASR model, the app offers an interactive and dynamic learning experience, ensuring that anyone who wants to learn Cantonese can connect with the linguistic roots efficiently and effectively.