Abstract

Nowadays ubiquitous technology can be a suitable way to motivate and engage children in interactive learning activities in order to promote their cognitive and social skills. Technologies, like augmented reality (AR), have the ability to catch the children’s imagination and to promote their attention, as they can experiment artificial, safe and fascinating environments. Children with autism spectrum disorders (ASD) usually have difficulty to recognize facial expressions and to understand associated emotions. We propose to design and develop an innovative GameBook to assist children with ASD to recognize and acquire emotions by engaging their attention and motivation, increasing their competence on this handicap. The GameBook will contain a story that can be read by text or listen by audio. The story will describe some scenarios and real world situations which will conduct the children to become involved on fictional contents associated with emotions. The child will have to interact with these scenarios, by playing with one 3D AR avatar with different facial expressions and choosing the correct one to the right situation and environment described in any page of the GameBook. This GameBook will promote the interaction between the child/storyteller and his/her imagination as well as will help the child to identify the correct emotional face to the situation. The GameBook can be played on any mobile device, such as a tablet, a smartphone or a laptop, with either an external web camera or an inbuilt camera. In order to test it, an exploratory study in a classroom context with ASD children will be performed. We also intend to observe the impact of the game on children interaction, as well as to quantify and evaluate their performance, assess the usability of the technology, and evaluate how it affects the child emotion reactions and the benefits it offers.

Highlights

  • Autism Spectrum Disorder (ASD) is a lifelong group of neurodevelopmental disabilities characterized by abnormalities in social interaction, communication and restrictive and repetitive behaviors [1]

  • If we look back and explore how augmented reality (AR) began, the name of Ivan Sutherland appears with the first AR system ever created [27]

  • The child will have to interact on these chapters, by playing with Tobias and learning his five different facial expressions, choosing the appropriate one to each situation and environment described at any page of the GameBook

Read more

Summary

INTRODUCTION

Autism Spectrum Disorder (ASD) is a lifelong group of neurodevelopmental disabilities characterized by abnormalities in social interaction, communication and restrictive and repetitive behaviors [1]. Several studies show that the majority of people with ASD exhibit a natural affinity with technology and a positive attitude towards computerbased training [11] This is primarily due to the fact that software programs offer a predictable and structured environment that can accommodate their need for organisational support and their preference for routine and repetitive behaviours [12]. Technological interventions allow its use at different speeds and locations, and never lose patience with the frequent repetition that many people with ASD desire [16]. This offers the opportunity to reduce some of the crippling personnel costs associated with autism care [17]. This paper is structured as follows: Section II presents AR games for children with ASD, Section III shows the developed GameBook and Section IV presents the conclusions and future work perspectives

Existing games with AR
Evolution Tendences
Methodology
About the GameBook
GameBook Characters
GameBook Scenarios
Text of the Story
Storyboard of the GameBook
CONCLUSION AND FUTURE WORK

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.