Designing rehabilitative experiences for virtual, mixed, and augmented reality environments

Abstract

It is rapidly becoming possible to conduct nearly all of the diagnostic testing necessary for understanding suprathreshold auditory and visual processing abilities using consumer-grade electronics. It is also the case that all of the psychometric methods used are consistent with a game-based structure, which will encourage engagement and increase reliability of the testing. The obvious next step is to integrate diagnosis and rehabilitation into a single game-based framework, for which virtual, augmented, and mixed reality are an ideal platform. The possibilities include auditory, visual, and memory training and diagnostic games, as well as guided interactions to improve skills in real-life scenarios. Essential to effective design, however, is optimizing interfaces to facilitate universal access. Universal design is essential for rehabilitation because it is necessarily the case that those in need of services cannot be assumed to have optimal auditory, visual, tactile, and balance capabilities. The most exciting challenge for the future will involve designing environments that scale appropriately to engage, challenge, and improve all of the senses and cognitive systems of the participant while being flexible enough to provide engaging experiences for those who can most benefit from the experience.