Human Fall Detection Research Articles

A Comprehensive Survey of Various Approaches on Human Fall Detection for Elderly People

A Comprehensive Survey of Various Approaches on Human Fall Detection for Elderly People

Using Deep Neural Networks for Human Fall Detection Based on Pose Estimation.

Requests for caring for and monitoring the health and safety of older adults are increasing nowadays and form a topic of great social interest. One of the issues that lead to serious concerns is human falls, especially among aged people. Computer vision techniques can be used to identify fall events, and Deep Learning methods can detect them with optimum accuracy. Such imaging-based solutions are a good alternative to body-worn solutions. This article proposes a novel human fall detection solution based on the Fast Pose Estimation method. The solution uses Time-Distributed Convolutional Long Short-Term Memory (TD-CNN-LSTM) and 1Dimentional Convolutional Neural Network (1D-CNN) models, to classify the data extracted from image frames, and achieved high accuracies: 98 and 97% for the 1D-CNN and TD-CNN-LSTM models, respectively. Therefore, by applying the Fast Pose Estimation method, which has not been used before for this purpose, the proposed solution is an effective contribution to accurate human fall detection, which can be deployed in edge devices due to its low computational and memory demands.

Virtual reality in training artificial intelligence-based systems: a case study of fall detection

Artificial Intelligent (AI) systems generally require training data of sufficient quantity and appropriate quality to perform efficiently. However, in many areas, such training data is simply not available or incredibly difficult to acquire. The recent developments in Virtual Reality (VR) have opened a new door for addressing this issue. This paper demonstrates the use of VR for generating training data for AI systems through a case study of human fall detection. Fall detection is a challenging problem in the public healthcare domain. Despite significant efforts devoted to introducing reliable and effective fall detection algorithms and enormous devices developed in the literature, minimal success has been achieved. The lack of recorded fall data and the data quality have been identified as major obstacles. To address this issue, this paper proposes an innovative approach to remove the afformentioned obstacle using VR technology. In this approach, a framework is, first, proposed to generate human fall data in virtual environments. The generated fall data is then tested with state-of-the-art visual-based fall detection algorithms to gauge its effectiveness. The results have indicated that the virtual human fall data generated using the proposed framework have sufficient quality to improve fall detection algorithms. Although the approach is proposed and verified in the context of human fall detection, it is applicable to other computer vision problems in different contexts, including human motion detection/recognition and self-driving vehicles.

Human fall detection using neuro-fuzzy models based on ensemble learning

Human fall detection using neuro-fuzzy models based on ensemble learning

Human fall detection and activity monitoring: a comparative analysis of vision-based methods for classification and detection techniques

Human fall detection and activity monitoring: a comparative analysis of vision-based methods for classification and detection techniques

A Response to: Human Fall Detection Using Passive Infrared Sensors with Low Resolution: A Systematic Review [Letter

A Response to: Human Fall Detection Using Passive Infrared Sensors with Low Resolution: A Systematic Review [Letter

Improved Archimedes Optimization Algorithm with Deep Learning Empowered Fall Detection System

Human fall detection (FD) acts as an important part in creating sensor based alarm system, enabling physical therapists to minimize the effect of fall events and save human lives. Generally, elderly people suffer from several diseases, and fall action is a common situation which can occur at any time. In this view, this paper presents an Improved Archimedes Optimization Algorithm with Deep Learning Empowered Fall Detection (IAOA-DLFD) model to identify the fall/non-fall events. The proposed IAOA-DLFD technique comprises different levels of pre-processing to improve the input image quality. Besides, the IAOA with Capsule Network based feature extractor is derived to produce an optimal set of feature vectors. In addition, the IAOA uses to significantly boost the overall FD performance by optimal choice of CapsNet hyperparameters. Lastly, radial basis function (RBF) network is applied for determining the proper class labels of the test images. To showcase the enhanced performance of the IAOA-DLFD technique, a wide range of experiments are executed and the outcomes stated the enhanced detection outcome of the IAOA-DLFD approach over the recent methods with the accuracy of 0.997.

Human Fall Detection Using Passive Infrared Sensors with Low Resolution: A Systematic Review.

Systems using passive infrared sensors with a low resolution were recently proposed to answer the dilemma effectiveness–ethical considerations for human fall detection by Information and Communication Technologies (ICTs) in older adults. How effective is this type of system? We performed a systematic review to identify studies that investigated the metrological qualities of passive infrared sensors with a maximum resolution of 16×16 pixels to identify falls. The search was conducted on PubMed, ScienceDirect, SpringerLink, IEEE Xplore Digital Library, and MDPI until November 26–28, 2020. We focused on studies testing only these types of sensor. Thirteen articles were “conference papers”, five were “original articles” and one was a found in arXiv.org (an open access repository of scientific research). Since four authors “duplicated” their study in two different journals, our review finally analyzed 15 studies. The studies were very heterogeneous with regard to experimental procedures and detection methods, which made it difficult to draw formal conclusions. All studies tested their systems in controlled conditions, mostly in empty rooms. Except for two studies, the overall performance reported for the detection of falls exceeded 85–90% of accuracy, precision, sensitivity or specificity. Systems using two or more sensors and particular detection methods (eg, 3D CNN, CNN with 10-fold cross-validation, LSTM with CNN, LSTM and Voting algorithms) seemed to give the highest levels of performance (> 90%). Future studies should test more this type of system in real-life conditions.

Visual Surveillance for Human Fall Detection in Healthcare IoT

This article designs a visual surveillance framework for human fall detection. In order to solve the conventional issues in fall detection, such as unsatisfactory feature generalization, low recall rates, and large computational time, we design a model that incorporates the deep convolutional neural network and the aggregated heuristic visual features in detecting the occurrence of falls. First, the convolutional neural network (Openpose model) is utilized to extract human skeleton in the image. Second, the hand-crafted spatial features, such as the angle of human shank inclination, are aggregated to determine the fall presence. It should be noticed that our fall detection method has been integrated to healthcare Internet of Things (IoT) video surveillance architecture, which has multiple graphic processing unit groups to perform real-time monitoring and alarming for the elderly in need. The experimental results prove that our method is able to accurately distinguish fall and nonfall activities with a competitive false-alarm rate.

Machine learning based wearable sensor module for human fall detection - a fully functional solution

Machine learning based wearable sensor module for human fall detection - a fully functional solution

Vision Based Real Time Monitoring System for Elderly Fall Event Detection Using Deep Learning

Human fall detection plays a vital part in the design of sensor based alarming system, aid physical therapists not only to lessen after fall effect and also to save human life. Accurate and timely identification can offer quick medical services to the injured people and prevent from serious consequences. Several vision-based approaches have been developed by the placement of cameras in diverse everyday environments. At present times, deep learning (DL) models particularly convolutional neural networks (CNNs) have gained much importance in the fall detection tasks. With this motivation, this paper presents a new vision based elderly fall event detection using deep learning (VEFED-DL) model. The proposed VEFED-DL model involves different stages of operations namely preprocessing, feature extraction, classification, and parameter optimization. Primarily, the digital video camera is used to capture the RGB color images and the video is extracted into a set of frames. For improving the image quality and eliminate noise, the frames are processed in three levels namely resizing, augmentation, and min–max based normalization. Besides, MobileNet model is applied as a feature extractor to derive the spatial features that exist in the preprocessed frames. In addition, the extracted spatial features are then fed into the gated recurrent unit (GRU) to extract the temporal dependencies of the human movements. Finally, a group teaching optimization algorithm (GTOA) with stacked autoencoder (SAE) is used as a binary classification model to determine the existence of fall or non-fall events. The GTOA is employed for the parameter optimization of the SAE model in such a way that the detection performance can be enhanced. In order to assess the fall detection performance of the presented VEFED-DL model, a set of simulations take place on the UR fall detection dataset and multiple cameras fall dataset. The experimental outcomes highlighted the superior performance of the presented method over the recent methods.

Producing Synthetic Dataset for Human Fall Detection in AR/VR Environments

Human poses and the behaviour estimation for different activities in (virtual reality/augmented reality) VR/AR could have numerous beneficial applications. Human fall monitoring is especially important for elderly people and for non-typical activities with VR/AR applications. There are a lot of different approaches to improving the fidelity of fall monitoring systems through the use of novel sensors and deep learning architectures; however, there is still a lack of detail and diverse datasets for training deep learning fall detectors using monocular images. The issues with synthetic data generation based on digital human simulation were implemented and examined using the Unreal Engine. The proposed pipeline provides automatic “playback” of various scenarios for digital human behaviour simulation, and the result of a proposed modular pipeline for synthetic data generation of digital human interaction with the 3D environments is demonstrated in this paper. We used the generated synthetic data to train the Mask R-CNN-based segmentation of the falling person interaction area. It is shown that, by training the model with simulation data, it is possible to recognize a falling person with an accuracy of 97.6% and classify the type of person’s interaction impact. The proposed approach also allows for covering a variety of scenarios that can have a positive effect at a deep learning training stage in other human action estimation tasks in an VR/AR environment.

Multi-oriented run length based static and dynamic features fused with Choquet fuzzy integral for human fall detection in videos

Since a huge part of elderly people are living alone, assisted-living tools have become an essential in-home telemonitoring device. Hence, this paper proposes an automatic human fall detection in videos. In order to improve the system reliability, a new shape descriptor called multi-oriented run length (MORL) is proposed. This descriptor is exploited in a proposed scheme to generate static and dynamic features to represent human falls with complementary information. The generated static and dynamic features are fused through the Choquet fuzzy integral. Experimental results conducted on three well-known datasets containing almost 1300 video segments show an interesting adaptation of the proposed approaches. More precisely, the proposed MORL descriptor shows its superiority against known descriptors such as LBP and HOG. Moreover, Choquet fuzzy integral significantly improves the results versus standard combiners. In general, the obtained results highlight the reliability of the proposed system versus recent studies for human fall detection.

Enabling automation and edge intelligence over resource constraint IoT devices for smart home

Smart home applications are pervasive and have gained popularity due to the overwhelming use of Internet of Things (IoT). The revolution in IoT technologies made homes more convenient, efficient and perhaps more secure. The need to advance smart home technology is necessary at this stage as IoT is abundantly used in automation industry. However, most of the proposed solutions are lacking in certain key areas of the system i.e., high interoperability, data independence, privacy, and optimization in general. The use of machine learning algorithms requires high-end hardware and are usually deployed on servers, where computation is convenient, but at the cost of bandwidth. However, more recently edge AI enabled systems are being proposed to shift the computation burden from the server side to the client side enabling smart devices. In this paper, we take advantage of the edge AI enabled technology to propose a fully featured cohesive system for smart home based on IoT and edge computing. The proposed system makes use of industry standards adopted for fog computing as well as providing robust responses from connected IoT sensors in a typical smart home. The proposed system employs edge devices as a computational platform in terms of reducing energy costs and provides security, while remotely controlling all appliances behind a secure gateway. A case study of human fall detection is evaluated by a custom lightweight deep neural network architecture implemented over the edge device of the proposed framework. The case study was validated using the Le2i dataset. During the training, the early stopping threshold was achieved with 98% accuracy for training set and 94% for validation set. The model size of the network was 6.4 MB which is significantly lower than other networks with similar performance.

Human Activity Recognition Using CSI Information with Nexmon

Using Wi-Fi IEEE 802.11 standard, radio frequency waves are mainly used for communication on various devices such as mobile phones, laptops, and smart televisions. Apart from communication applications, the recent research in wireless technology has turned Wi-Fi into other exploration possibilities such as human activity recognition (HAR). HAR is a field of study that aims to predict motion and movement made by a person or even several people. There are numerous possibilities to use the Wi-Fi-based HAR solution for human-centric applications in intelligent surveillance, such as human fall detection in the health care sector or for elderly people nursing homes, smart homes for temperature control, a light control application, and motion detection applications. This paper’s focal point is to classify human activities such as EMPTY, LYING, SIT, SIT-DOWN, STAND, STAND-UP, WALK, and FALL with deep neural networks, such as long-term short memory (LSTM) and support vector machines (SVM). Special care was taken to address practical issues such as using available commodity hardware. Therefore, the open-source tool Nexmon was used for the channel state information (CSI) extraction on inexpensive hardware (Raspberry Pi 3B+, Pi 4B, and Asus RT-AC86U routers). We conducted three different types of experiments using different algorithms, which all demonstrated a similar accuracy in prediction for HAR with an accuracy between 97% and 99.7% (Raspberry Pi) and 96.2% and 100% (Asus RT-AC86U), for the best models, which is superior to previously published results. We also provide the acquired datasets and disclose details about the experimental setups.

Human Fall Detection Method Using Millimeter-wave Radar Based on RDSNet

With the advent of the aging population, fall detection has gradually become a research hotspot. Aiming at the detection of human fall using millimeter-wave radar, a Range-Doppler heat map Sequence detection Network (RDSNet) model that combines the convolutional neural network and long short-term memory network is proposed in this study. First, feature extraction is performed using the convolutional neural network. After obtaining the feature vector, the feature vector corresponding to the dynamic sequence is inputted to the long short-term memory network. Subsequently, the time correlation information of the heat map sequence is learned. Finally, the detection results are obtained using the classifier. Moreover, diverse human movement information of different objects is collected using millimeter-wave radar, and a range-Doppler heat map dataset is built in this work. Comparative experiments show that the proposed RDSNet model can reach an accuracy of 96.67% and the calculation delay is not higher than 50 ms. The proposed RDSNet model has good generalization capabilities and provides new technical ideas for human fall detection and human posture recognition.

A human fall detection framework based on multi-camera fusion

ABSTRACT A sudden fall accident is the main concern for the elderly and disabled people. Automatic detection of the falls from video sequences is an assistive technology for surveillance systems. In this study, a three-stage framework was presented and implemented based on the combination of the data from multiple cameras to address the challenges of occlusion and visibility. In the first stage, the number of used cameras was specified. In the second stage, each camera was decided locally based on its data about the fall incident. In the third and final stage, the aggregation function was used to combine the single camera’s decision considering the coverage rate coefficient of the used cameras. Experiments on the multiple-camera fall dataset demonstrated that our method is comparable to other state-of-the-art methods.

Outlier based Human Fall Detection using One-Class Classification

Objective: This work aims to develop a human fall detection method that is trained using data of routine movement of people only collected from accelerometer sensor to stay away from irregular fall detection model. This work also aims to analyze the effect of calculated features on the fall detection model. Methodology: In the proposed method, The fall detection model is built using one-class classification. At first, data of accelerometer sensor in three directions has been used to detect the fall events. Five feature vectors i.e. resultant, variance, standard deviation, Root Mean square, and Euclidean Norm have been calculated. These four features along with one class SVM have been used to build fall detection model in ways (1) Using only resultant features only (2) Using all calculated features. This model was trained using only activities of daily living (ADL) and tested on both daily living activities and fall activities. Findings: It is found that when the model was built using all calculated features, the sensitivity was 100% and specificity was 94.92% when mobile is in the pocket and; sensitivity was 100% and specificity was 93.61% when mobile is in handbag which is better than when the model was built using resultant features only. We have also studied the effect of individual features on this fall detection model and it is found that variance played a very important role to classify fall activities and ADL activities. Novelty - The proposed fall detection method is built using one-class classification so that the proposed model will be reliable to detect falls in real life. In the proposed work, the effect of features on the fall detection model is also analyzed. Keywords: One class classification; accelerometer; outlier detection; fall detection; Bagging classifier

Saliency based human fall detection in smart home environments using posture recognition.

The implementation of people monitoring system is an evolving research theme. This paper introduces an elderly monitoring system that recognizes human posture from overlapping cameras for people fall detection in a smart home environment. In these environments, the zone of movement is limited. Our approach used this characteristic to recognize human posture fastly by proposing a region-wise modelling approach. It classifies persons pose in four groups: standing, crouching, sitting and lying on the floor. These postures are obtained by calculating an estimation of the human bounding volume. This volume is estimated by obtaining the height of the person and its surface that is in contact with the ground according to the foreground information of each camera. Using them, we distinguish each postures and differentiate lying on floor posture, which can be considered as the falling posture from other postures. The global multiview information of the scene is obtaining by using homographic projection. We test our proposed algorithm on multiple cameras based fall detection public dataset and the results prove the efficiency of our method.

Machine Learning based Human Fall Detection System

Falls have become one of the reasons for death. It is common among the elderly. According to World Health Organization (WHO), 3 out of 10 living alone elderly people of age 65 and more tend to fall. This rate may get higher in the upcoming years. In recent years, the safety of elderly residents alone has received increased attention in a number of countries. The fall detection system based on the wearable sensors has made its debut in response to the early indicator of detecting the fall and the usage of the IoT technology, but it has some drawbacks, including high infiltration, low accuracy, poor reliability. This work describes a fall detection that does not reliant on wearable sensors and is related on machine learning and image analysing in Python. The camera's high-frequency pictures are sent to the network, which uses the Convolutional Neural Network technique to identify the main points of the human. The Support Vector Machine technique uses the data output from the feature extraction to classify the fall. Relatives will be notified via mobile message. Rather than modelling individual activities, we use both motion and context information to recognize activities in a scene. This is based on the notion that actions that are spatially and temporally connected rarely occur alone and might serve as background for one another. We propose a hierarchical representation of action segments and activities using a two-layer random field model. The model allows for the simultaneous integration of motion and a variety of context features at multiple levels, as well as the automatic learning of statistics that represent the patterns of the features.