Kinect4FOG: monitoring and improving mobility in people with Parkinson’s using a novel system incorporating the Microsoft Kinect v2

Abstract

Parkinson’s is a neurodegenerative condition associated with several motor symptoms including tremors and slowness of movement. Freezing of gait (FOG); the sensation of one’s feet being “glued” to the floor, is one of the most debilitating symptoms associated with advanced Parkinson’s. FOG not only contributes to falls and related injuries, but also compromises quality of life as people often avoid engaging in functional daily activities both inside and outside the home. In the current study, we describe a novel system designed to detect FOG and falling in people with Parkinson’s (PwP) as well as monitoring and improving their mobility using laser-based visual cues cast by an automated laser system. The system utilizes a RGB-D sensor based on Microsoft Kinect v2 and a laser casting system consisting of two servo motors and an Arduino microcontroller. This system was evaluated by 15 PwP with FOG. Here, we present details of the system along with a summary of feedback provided by PwP. Despite limitations regarding its outdoor use, feedback was very positive in terms of domestic usability and convenience, where 12/15 PwP showed interest in installing and using the system at their homes.Implications for RehabilitationProviding an automatic and remotely manageable monitoring system for PwP gait analysis and fall detection.Providing an automatic, unobtrusive and dynamic visual cue system for PwP based on laser line projection.Gathering feedback from PwP about the practical usage of the implemented system through focus group events.