Beyond Sight: Enhancing Augmented Reality Interactivity with Audio-Based and Non-Visual Interfaces

Abstract

Augmented Reality (AR) is rapidly advancing, with a new focus on broadening accessibility beyond the visually dominant interfaces. This study explores the integration of audio-based non-visual interfaces within AR, aiming to cater to a diverse audience, including users with visual impairments. The objective was to develop a prototype that leverages audio feedback to facilitate interaction with the AR environment, enhancing spatial awareness and mental imagery for all users without relying on visual cues. Employing a user-centered design approach, we conducted a comprehensive evaluation with university students to assess the prototype’s usability and immersive potential compared to traditional touchscreen interfaces. The findings highlighted a pronounced preference for the Audio-Based Natural Interface, emphasizing its capacity to provide an intuitive and immersive AR experience through sound alone. These results underline the potential of audio feedback in creating more inclusive AR experiences, suggesting a paradigm shift towards developing AR technologies that are accessible to a wider user base. Our study concludes that audio-based non-visual interfaces represent a viable and innovative direction for AR development, advocating for their further exploration to ensure AR’s universality and inclusivity.