UR Fall Detection Dataset Research Articles

Enhancing elderly care: Efficient and reliable real-time fall detection algorithm.

Falls pose a significant risk to public health, especially for the elderly population, and could potentially result in severe injuries or even death. A reliable fall detection system is urgently needed to recognise and promptly alert to falls effectively. A vision-based fall detection system has the advantage of being non-invasive and affordable compared with another popular approach using wearable sensors. Nevertheless, the present challenge lies in the algorithm's limited on-device operating speed due to extremely high computational demands, and the high computational demands are usually essential to improve the performance for the complex scene. Therefore, it is crucial to address the above challenge in computational power and complex scenes. This article presents the implementation of a real-time fall detection algorithm with low computational costs using a single webcam. The suggested method optimises precision and efficiency by synthesising the strengths of background subtraction and the human pose estimation model BlazePose. The biomechanical features, derived from body key points identified by BlazePose, are utilised in a random forest model for classifying fall events. The proposed algorithm achieves 89.99% accuracy and 29.7 FPS with a laptop CPU on the UR Fall Detection dataset and the Le2i Fall Detection dataset. The algorithm shows great generalisation and robustness in different scenarios. Due to the low computational power of the system, the findings also suggest the potential for implementing the system in small-scale medical monitoring equipment, which maximises its practical value in digital health.

A robust multimodal detection system: physical exercise monitoring in long-term care environments.

Falls are a major cause of accidents that can lead to serious injuries, especially among geriatric populations worldwide. Ensuring constant supervision in hospitals or smart environments while maintaining comfort and privacy is practically impossible. Therefore, fall detection has become a significant area of research, particularly with the use of multimodal sensors. The lack of efficient techniques for automatic fall detection hampers the creation of effective preventative tools capable of identifying falls during physical exercise in long-term care environments. The primary goal of this article is to examine the benefits of using multimodal sensors to enhance the precision of fall detection systems. The proposed paper combines time-frequency features of inertial sensors with skeleton-based modeling of depth sensors to extract features. These multimodal sensors are then integrated using a fusion technique. Optimization and a modified K-Ary classifier are subsequently applied to the resultant fused data. The suggested model achieved an accuracy of 97.97% on the UP-Fall Detection dataset and 97.89% on the UR-Fall Detection dataset. This indicates that the proposed model outperforms state-of-the-art classification results. Additionally, the proposed model can be utilized as an IoT-based solution, effectively promoting the development of tools to prevent fall-related injuries.

Human Action Recognition-Based IoT Services for Emergency Response Management

Emergency incidents can appear anytime and any place, which makes it very challenging for emergency medical services practitioners to predict the location and the time of such emergencies. The dynamic nature of the appearance of emergency incidents can cause delays in emergency medical services, which can sometimes lead to vital injury complications or even death, in some cases. The delay of emergency medical services may occur as a result of a call that was made too late or because no one was present to make the call. With the emergence of smart cities and promising technologies, such as the Internet of Things (IoT) and computer vision techniques, such issues can be tackled. This article proposes a human action recognition-based IoT services architecture for emergency response management. In particular, the architecture exploits IoT devices (e.g., surveillance cameras) that are distributed in public areas to detect emergency incidents, make a request for the nearest emergency medical services, and send emergency location information. Moreover, this article proposes an emergency incidents detection model, based on human action recognition and object tracking, using image processing and classifying the collected images, based on action modeling. The primary notion of the proposed model is to classify human activity, whether it is an emergency incident or other daily activities, using a Convolutional Neural Network (CNN) and Support Vector Machine (SVM). To demonstrate the feasibility of the proposed emergency detection model, several experiments were conducted using the UR fall detection dataset, which consists of emergency and other daily activities footage. The results of the conducted experiments were promising, with the proposed model scoring 0.99, 0.97, 0.97, and 0.98 in terms of sensitivity, specificity, precision, and accuracy, respectively.

Elderly Fall Detection by Sensitive Features Based on Image Processing and Machine Learning

The world’s elderly population is growing every year. It is easy to say that the fall is one of the major dangers that threaten them. This paper offers a Trained Model for fall detection to help the older people live comfortably and alone at home. The purpose of this paper is to investigate appropriate methods for diagnosing falls by analyzing the motion and shape characteristics of the human body. Several machine learning technologies have been proposed for automatic fall detection. The proposed research reported in this paper detects a moving object by using a background subtraction algorithm with a single camera. The next step is to extract the features that are very important and generally describe the human shape and show the difference between the human falls from the daily activities. These features are based on motion, changes in human shape, and oval diameters around the human and temporal head position. The features extracted from the human mask are eventually fed in to various machine learning classifiers for fall detection. Experimental results showed the efficiency and reliability of the proposed method with a fall detection rate of 81% that have been tested with UR Fall Detection dataset.

Vision Based Real Time Monitoring System for Elderly Fall Event Detection Using Deep Learning

Human fall detection plays a vital part in the design of sensor based alarming system, aid physical therapists not only to lessen after fall effect and also to save human life. Accurate and timely identification can offer quick medical services to the injured people and prevent from serious consequences. Several vision-based approaches have been developed by the placement of cameras in diverse everyday environments. At present times, deep learning (DL) models particularly convolutional neural networks (CNNs) have gained much importance in the fall detection tasks. With this motivation, this paper presents a new vision based elderly fall event detection using deep learning (VEFED-DL) model. The proposed VEFED-DL model involves different stages of operations namely preprocessing, feature extraction, classification, and parameter optimization. Primarily, the digital video camera is used to capture the RGB color images and the video is extracted into a set of frames. For improving the image quality and eliminate noise, the frames are processed in three levels namely resizing, augmentation, and min–max based normalization. Besides, MobileNet model is applied as a feature extractor to derive the spatial features that exist in the preprocessed frames. In addition, the extracted spatial features are then fed into the gated recurrent unit (GRU) to extract the temporal dependencies of the human movements. Finally, a group teaching optimization algorithm (GTOA) with stacked autoencoder (SAE) is used as a binary classification model to determine the existence of fall or non-fall events. The GTOA is employed for the parameter optimization of the SAE model in such a way that the detection performance can be enhanced. In order to assess the fall detection performance of the presented VEFED-DL model, a set of simulations take place on the UR fall detection dataset and multiple cameras fall dataset. The experimental outcomes highlighted the superior performance of the presented method over the recent methods.

Abnormal Behavior Detection and Warning Based on Deep Intelligent Video Analysis for Geriatric Patients

With the rapid growth of the aging population, abnormal detection has become a key issue in the medical and health field. Accurately detecting abnormal events in the monitoring video and giving feedback in real time can effectively reduce injuries even deaths caused by falls in the elderly. A novel Deepgait-based event detection method is proposed in this study for the elderly monitoring application. The classes of this problem contains abnormal behaviors, unusual events and normal daily life activities. To solve the above recognition problem, a novel deep convolutional features combined with joint Bayesian is proposed to model view variance. To evaluate the performance of the proposed model, two open behavioral data sets: Multiple cameras fall dataset and UR Fall Detection Dataset are adopted, where the mAP value of the improved Deepgait algorithm is 2.23% higher than that of Deepgait algorithm, and 5.4% higher than that of energy model (SSD) approach. The results suggest that our proposed monitoring system is an effective method for the elderly monitoring application.

Internet of Things and Deep Learning Enabled Elderly Fall Detection Model for Smart Homecare

Recently, the techniques of Internet of Things (IoT) and mobile communications have been developed to gather human and environment information data for a variety of intelligent services and applications. Remote monitoring of elderly and disabled people living in smart homes is highly challenging due to probable accidents which might occur due to daily activities such as falls. For elderly people, fall is considered as a major reason for death of post-traumatic complication. So, early identification of elderly people falls in smart homes is needed to increase the survival rate of the person or offer required support. Recently, the advent of artificial intelligence (AI), IoT, wearables, smartphones, etc. makes it feasible to design fall detection systems for smart homecare. In this view, this paper presents an IoT enabled elderly fall detection model using optimal deep convolutional neural network (IMEFD-ODCNN) for smart homecare. The goal of the IMEFD-ODCNN model is to enable smartphones and intelligent deep learning (DL) algorithms to detect the occurrence of falls in the smart home. Primarily, the input video captured by the IoT devices is pre-processed in different ways like resizing, augmentation, and min-max based normalization. Besides, SqueezeNet model is employed as a feature extraction technique to derive appropriate feature vectors for fall detection. In addition, the hyperparameter tuning of the SqueezeNet model takes place using the salp swarm optimization (SSO) algorithm. Finally, sparrow search optimization algorithm (SSOA) with variational autoencoder (VAE), called SSOA-VAE based classifier is employed for the classification of fall and non-fall events. Finally, in case of fall event detected, the smartphone sends an alert to the caretakers and hospital management. The performance validation of the IMEFD-ODCNN model takes place on UR fall detection dataset and multiple cameras fall dataset. The experimental outcomes highlighted the promising performance of the IMEFD-ODCNN model over the recent methods with the maximum accuracy of 99.76% and 99.57% on the multiple cameras fall and UR fall detection dataset.

A Novel Artificial Intelligence Based Internet of Things for Fall Detection of Elderly Care Monitoring

A fall of an older adult often leads to severe injuries and is found to be a significant reason for the death due to post-traumatic complications. Many falls happen in the home atmosphere and prevail unrecognized. Thus, the need for reliable early fall detection is necessary for fast help. Lately, the emergence of wearables, smartphones, IoT, etc., made it possible to develop systems fall detection which aids in the remote monitoring of the elderly. The goal is to allow intelligent algorithms and smartphones to detect falls for elderly care and to monitor them regularly. This work presents the Artificial Intelligence of Things for Fall Detection (AIOTFD) system using a slime mould algorithm (SMA) to optimize the final data. The features extracted using SqueezeNet further CNN based SMA used for data optimization. The validation of the AIOTFD model performance is evaluated through the Multiple Cameras Fall Dataset (MCFD) and UR Fall Detection dataset (URFD). The empirical results accentuated the assuring realization of the model compared to other state-of the art methods.The obtained results shows our proposed AIOTFD attains accuracy of 99.82% and 99.79% and databases can be used for additional investigation and optimizations to increase the recognition rate to enhance the independent life of the elderly.

A multimodal approach using deep learning for fall detection

A computational system able to automatically and efficiently detect and classify falls would be beneficial for monitoring the elderly population and speed up the assistance proceedings, reducing the risk of prolonged injuries and death. One of the most common problems in such systems is the high number of false-positives in their recognition scheme, which may cause an overload on surveillance system calls. We address this problem by proposing different topologies of a multimodal convolution neural network, which is trained to detect falls based on RGB images and information from accelerometers. We train and evaluate our networks with the UR Fall Detection dataset and UP-Fall dataset, and provide an extensive comparison with state-of-the-art models. Our model reached good results on UR Fall Detection dataset and achieved the state-of-art on UP-Fall detection dataset, relying on easily available sensors to do so, demonstrating it can be a scalable solution for robust fall detection in the real world.

Detection of fall for the elderly in an indoor environment using a tri-axial accelerometer and Kinect depth data

Monitoring elderly people who are living alone is a crucial task as they are at great risk of fall occurrence. In this paper, we present a robust framework for fall detection that makes use of two different signals namely tri-axial data from an accelerometer and depth maps from a Kinect sensor. Our approach functions at two stages. At the first stage, the accelerometer data is continuously being monitored and is used to indicate fall whenever the sum vector magnitude of the tri-axial data crosses a specific threshold. This fall indication denotes a high probability of fall occurrence. To confirm this and to avoid false alarms, the depth maps of a predefined window length captured prior to the instant of fall indication are obtained and processed. We propose a new descriptor, Entropy of Depth Difference Gradient Map that acts as a discriminative descriptor in differentiating fall from other daily activities. Finally, fall confirmation is done by employing a sparse representation-based classifier using the extracted descriptors. To ascertain the proposed model, we have performed experimental analysis using a publicly available UR Fall Detection dataset and also using a Synthetic dataset. The experimental results clearly depict the superior performance of our model.

Fall Detection Based on Dual-Channel Feature Integration

Falls have caught great harm to the elderly living alone at home. This paper presents a novel visual-based fall detection approach by Dual-Channel Feature Integration. The proposed approach divides the fall event into two parts: falling-state and fallen-state, which describes the fall events from dynamic and static perspectives. Firstly, the object detection model (Yolo) and the human posture detection model (OpenPose) are used for preprocessing to obtain key points and the position information of a human body. Then, a dual-channel sliding window model is designed to extract the dynamic features of the human body (centroid speed, upper limb velocity) and static features (human external ellipse). After that, MLP (Multilayer Perceptron) and Random Forest are applied to classify the dynamic and static feature data separately. Finally, the classification results are combined for fall detection. Experimental results show that the proposed approach achieves an accuracy of 97.33% and 96.91% when tested with UR Fall Detection Dataset and Le2i Fall Detection Dataset.

A Robust Framework for Abnormal Human Action Recognition Using $\boldsymbol{\mathcal{R}}$ -Transform and Zernike Moments in Depth Videos

The aim of the algorithm is to detect the abnormal actions that are more prone to elderly people in order to make them more independent and improve their quality of life. The framework is structured to construct a robust feature vector by computing R-transform and Zernike moments on average energy silhouette images (AESIs). The AESIs are generated by the integral sum of the segmented silhouettes obtained from the Microsoft's Kinect sensor v1. The proposed feature descriptor possesses scale-, translation-, and rotation-invariant properties that are also less sensitive to noise and minimizes data redundancy. It enhances the proposed algorithm's robustness and makes the classification process more efficient. The proposed work is validated on a novel abnormal human action (AbHA) dataset and three publically available 3D datasets-UR fall detection dataset, Kinect Activity Recognition dataset, and multiview NUCLA dataset. The proposed framework exhibits superior results from other state-of-the-art methods in terms of average recognition accuracy (ARA). The experimental results demonstrate 96.5%, 96.64%, 95.9%, and 86.4% ARA on the UR fall detection dataset, the KARD dataset, the AbHA dataset, and the multi-view NUCLA dataset, respectively.

Supporting Independent Living for Older Adults; Employing a Visual Based Fall Detection Through Analysing the Motion and Shape of the Human Body

Falls are one of the greatest risks for older adults living alone at home. This paper presents a novel visual-based fall detection approach to support independent living for older adults through analysing the motion and shape of the human body. The proposed approach employs a new set of features to detect a fall. Motion information of a segmented silhouette when extracted can provide a useful cue for classifying different behaviours, while variation in shape and the projection histogram can be used to describe human body postures and subsequent fall events. The proposed approach presented here extracts motion information using best-fit approximated ellipse and bounding box around the human body, produces projection histograms and determines the head position over time, to generate 10 features to identify falls. These features are fed into a multilayer perceptron neural network for fall classification. Experimental results show the reliability of the proposed approach with a high fall detection rate of 99.60% and a low false alarm rate of 2.62% when tested with the UR Fall Detection dataset. Comparisons with state of the art fall detection techniques show the robustness of the proposed approach.