Developing an Immersive Virtual Reality Training System to Enrich Social Interaction and Communication Skills for Children With Autism Spectrum Disorder

Abstract

Virtual Reality systems take an important place in training and rehabilitation of children with psychological problems. This paper proposes developing an Immersive Virtual Reality Training System in Unity software to enrich social interaction and communication skills for children with Autism Spectrum Disorder. Individuals with ASD have trouble with social interaction, adaptation to new surroundings and communication. In this system the behavior of the virtual trainer changes depending on the mood and actions of the patients. The face and speech recognition uses an integration of Artificial Intelligent algorithms with Virtual Reality in Unity software which is implemented in C# programming language. Virtual characters and objects of the training system are designed in Autodesk Maya software. Integration with Virtual Reality carried out using wireless VR headset Oculus Quest2. Earlier research works found that applications with virtual reality have the potential to provide useful clinical treatments for people with autism. The proposed VR Training system will be an innovative solution for the rehabilitation of children with Autism Spectrum Disorder. This system is offered to users with a high degree of interactivity and practicing various social situations in a safe and controlled environment. With the start of the COVID-19 pandemic, the integration of virtual reality training systems has become extremely important. The use of such high-tech solutions allows patients who need the treatment to receive therapy without leaving home. This development of the Immersive Virtual Reality Training System is the first experience of treating children with autism in Kazakhstan.