Air writing with Effective Communication Enhancement for Dyslexic Learners

Abstract

Air writing is a unique method that allows individuals to freely write or draw in the air without the need for sensor devices. One of the significant applications is aimed at addressing the challenges faced by dyslexic children, who often struggle with reading, writing, and spelling. Currently, there is a lack of tailored applications to guide dyslexic children through their learning process. This paper presents a groundbreaking solution designed to assist dyslexic individuals in mastering the art of writing alphabets, digits, and words. Using various hand gestures, children can effortlessly write any character, digit, or word on a virtual canvas and memorize them easily through the hand movements. This approach not only makes learning enjoyable but also boosts a child’s confidence. Additionally, the application allows children to unleash their imagination by creating doodles. While existing air writing methods have limitations, such as reliance on devices and restricting content to digits and characters within predefined boundaries. These limitations have been overcome in our proposed approach. Leveraging afordable technologies, our system caters to the needs of dyslexic learners and serves as an interactive tool to enhance their writing skills. It also provides a means of communication for the deaf and mute community. Utilizing cutting-edge technologies such as machine learning, deep learning, computer vision, and web development, we have developed a practical application that seamlessly tracks finger movements and gestures, capturing trajectories and images for classification. Our model exhibits remarkable performance, achieving a training accuracy rate of 98.57% for digit recognition, 98.80% for character recognition, and 97.09% for doodle recognition. This paper contributes valuable insights into the development of an effective and engaging tool to improve learning skills for students, particularly dyslexic children, while also addressing communication barriers for the deaf and mute community. Our approach opens up new possibilities for inclusive and accessible learning experiences.