A falls recognition framework based on faster R-CNN and temporal action sequences that can be deployed on home service robots

Abstract

With the popularity of home service robots (e.g. floor sweepers), robots should be considered to have more features for older adult care. Compared to fixed home monitors with a limited field of view, fall detection with service robots is an ideal solution to keep older adults and disabled people within sight. However, the user’s actions, such as lying on the bed to sleep or slumping on the sofa to rest, cause the traditional fall detection system to generate false alarms, which disrupts the user’s family life. The present work proposed an enhanced faster R-convolutional neural network (CNN) network by incorporating temporal action sequences and fall acceleration computation, demonstrating a reduced misjudgment rate on the service robot platform. Firstly, motion images were captured to obtain the target’s motion area description and action timing at the input stage. Then, the faster R-CNN algorithm was implemented to check the suspected falls further based on the falling acceleration of the detected actions during the training phase. Finally, the proposed temporal action sequences module eliminated the action mistaken for falling. Network training and robotic platform testing demonstrated that the proposed approach distinguished between falls and false alarms, which mitigated the occurrence of false positives. On the service robot platform, experimental results showed that the FAR was 8.19 and processing time was 0.79 s.