Abstract
In this study, we investigate to what degree augmented reality technology can be used to create and evaluate a visual-to-auditory sensory substitution device to improve the performance of blind persons in navigation and recognition tasks. A sensory substitution algorithm that translates 3D visual information into audio feedback was designed. This algorithm was integrated in an augmented reality based mobile phone application. Using the mobile device as sensory substitution device, a study with blind participants (n = 7) was performed. The participants navigated through pseudo-randomized obstacle courses using either the sensory substitution device, a white cane or a combination of both. In a second task, virtual 3D objects and structures had to be identified by the participants using the same sensory substitution device. The realized application for mobile devices enabled participants to complete the navigation and object recognition tasks in an experimental environment already within the first trials without previous training. This demonstrates the general feasibility and low entry barrier of the designed sensory substitution algorithm. In direct comparison to the white cane, within the study duration of ten hours the sensory substitution device did not offer a statistically significant improvement in navigation.
Highlights
Many of our everyday tasks and activities rely on the sense of vision
The results demonstrate the feasibility and intuitive usability of the designed sensory substitution algorithm: participants were able to use it to navigate through complex obstacle courses and correctly identify 3D objects within the very first trials
The most likely explanation for this contradiction is the slow identification rate of almost 100 seconds per object on average, as it makes this field of application impractical for everyday life. These findings suggest a follow-up study with stronger focus on object recognition using the Easy-Access SoundView (EASV), including training phases and feedback questions aimed more towards this function and its usefulness in everyday life
Summary
Many of our everyday tasks and activities rely on the sense of vision. Visual information has been estimated to sum up to more than 99% of all the information perceived by the human senses [1]. Sensory substitution for navigation of the blind. Excellence initiative from the Federal Ministry of Education and Research – Germany (BMBF). This work was done in an industry-on-campuscooperation between the University of Tuebingen and Carl Zeiss Vision International GmbH. The authors received no specific funding for this work. The funder provided support in the form of financial compensation for participants but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
