Virtual‐ and Augmented Reality‐Assisted Screening for Early Detection of Cognitive Impairments

Abstract

AbstractBackgroundA key element in providing future dementia patients with sufficient care is the early detection of cognitive impairment. Using augmented reality (AR) and virtual reality (VR), the project “Smart Cognition & Behaviour Screening powered by Augmented Reality” (SCOBES‐AR) seeks to create a multimodal screening tool (MST) for the early and easy detection of cognitive impairment. The MST focusses on non‐pharmacological prevention by assessing behavioral and lifestyle‐associated risk factors and identifying personal resources.MethodsFirst, a validation study was carried out utilizing the established Cognitive Functions Dementia (CFD) test battery to evaluate a set of selected test procedures. The validated test procedures were implemented in an MST prototype based on AR/VR techniques. Using observational summative evaluation and the co‐discovery method, the usability and applicability of the validated test methods for therapists and subjects were further assessed in a subsequent cross‐over study with 98 healthy individuals (age 60‐75 years).Results310 people were involved in the validation study (age 60‐75 years). Among other things, the assessment of olfactory performance (r = 0.09, p = 0.003), reaction time (r = ‐0.47, p<0.001), and activities of daily living (r = 0.29, p<0.001) revealed a particularly high agreement with the CFD. Further, the MST prototype, that includes a tablet PC, AR head‐mounted display with smartphone, VR head‐mounted display, and Flic Buttons as input devices, was developed (see fig. 1). It allows the therapist to have control and direction over the screening process (see fig. 2).ConclusionThe focus of the MST is on non‐clinical cognitive and physical functionalities, as it integrates tests from multiple health professions and is low‐threshold viable. The development of the MST prototype enables the determination of ideal procedures for multimodal AR/VR‐based testing to measure cognitive impairment in older people. To bolster the findings and advance research, clinical trials involving people with cognitive decline and those who already have dementia would be required.