Activating people with dementia using natural user interface interaction on a surface computer

Abstract

Reminiscence Therapy can act as an effective and conducive method for increasing the Quality of Life (QoL) of people with dementia (PwD) when implemented properly. In addition to non-digital approaches, digitally enhanced systems can be built to elicit positive memories as well as emotions using multimodal interaction and digital content. In the same line, interactive multimedia systems can also be used to provide meaningful, engaging and joyful activities for PwD in order to further increase well-being and QoL. The aim of this study was to investigate whether using natural user interfaces (NUI) provides benefits to interactive multimedia systems for PwD. Elaborated interaction possibilities should further facilitate the physical and mental activation of PwD as well as stimulate positive feelings, empowerment and joy. Since there are no applications available that satisfy the particular requirements of our user group, we developed an interactive aquarium application as our study object. The application supports touch gestures as well as tangible object interaction. The application can be used to playfully activate and engage PwD. It can help to establish and to improve communication with PwD, promote positive feelings and, last but not least, be fun. The study demonstrated that interactive multimedia systems using NUI and object interaction are a promising approach to improve the QoL of PwD.