Abstract
Augmented reality (AR) technology, with its unique immersive interactive experience of virtual reality integration, can show children abstract concepts and theories in an intuitive way. In this paper, we improve the high-precision position and low delay interaction of AR recognition area through edge calculation, so as to enhance the immersion of children’s chord knowledge learning. Meanwhile, multisource fusion perception of audio and touch is used, and the AI algorithm model is used to monitor physical events (cloud AI training and edge execution) and effectively realize intelligent services such as chord combination, melody perception, and control. Chord knowledge in music theory is presented to children through multichannels (kinesthetic, visual, auditory, etc.) situationally, to improve children’s learning efficiency and experience. We invited 12 children to participate in user experiments to test usability of ChordAR. The test results showed that children can master the method of playing the game through simple learning, ultimately correctly imitating C, G, and E chords, and experience full immersion in the game. Finally, we discuss the positive effects of ChordAR on children’s learning and creativity and make suggestions for future AR games.
Highlights
In today’s rapidly developing information society, augmented reality (AR) technology has become popular in all aspects of our lives
Our prototype design includes a game based on AR recognition and supporting hardware and software
Based on the embodied theory, we have developed AR learning tools to teach music theory knowledge, changed the traditional paper learning method, and let children actively explore and learn music theory knowledge through hands-on practice
Summary
In today’s rapidly developing information society, augmented reality (AR) technology has become popular in all aspects of our lives. AR, as an extension of virtual reality (VR), can provide a more immersive experience, and its application in education has increasingly shown benefits. Through the integration of virtual and real teaching aids, highly immersive learning experience can provide better learning effect, as it can enhance children’s focus, engagement, and creativity during the learning process [1]. AR technology, which integrates real and virtual world environments, can be used to develop educational aids that provide highly immersive learning experiences, especially for children [2]. Erefore, we designed an innovative tool that teaches preschool children introductory music theory in an immersive way. We used AR to develop an interesting, easy to learn, fun tool that provides positive feedback, with the goal of teaching children basic chord knowledge
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
