Evaluating user interface of a mobile augmented reality coloring application for children with autism: An eye-tracking investigation

Abstract

Mobile augmented reality (AR) solutions are increasingly being used to facilitate learning and skills training for children with autism spectrum disorder (ASD). Derived from the fact that mobile AR systems can be embedded with multimedia effects, such as 3D animations, sounds or personalized images, with potential benefits for learning and engagement. Many mobile AR-based applications have been developed over the past decade; however, little is known about how children with autism interact with mobile AR application interface elements, which limits the accessible user interface (UI) design of such applications. In this study, we conducted an eye-tracking experiment to examine how children with autism interact differently with the UI of mobile AR coloring apps compared to typically developing (TD) children. Both quantitative and qualitative data suggest that 1) icons and images were more attractive to ASD children and could facilitate their understanding of the task more effectively; 2) a richer interface makes participants with autism focus more on irrelevant elements; and 3) the size and position of icons affected their speed of information processing. We recommend that UI be designed to suit the characteristics of children with autism. For example, visual stimuli such as icons or images should be meaningful; screen elements need to be simple and clear; background distractions should be avoided; and text also needs to be brief and precise. This study is expected to inspire researchers to provide AR apps with accessible UIs in the future and improve the user experience (UX) of children with autism.