Smartphone-Based Human Activity and Fall Recognition Using Deep Feature Extraction and Machine-Learning Classifiers

Abstract

Human activity recognition (HAR) and fall detection using smartphone sensors are currently popular because they can be extended to many useful applications especially when a person needs an urgent treatment such as a fall. Several methods based on machine learning (ML) and deep learning (DL) have been proposed to improve classification performances. In this work, we propose hybrid models of convolutional neural network (CNN) models and ML algorithms to classify human activities and falls using smartphone-sensor data. The CNN model will be used as feature extraction to extract a set of features. Thereafter, the ML algorithm will apply this set of features to predict the corresponding activity and fall. Several combinations of CNN models and ML algorithms are investigated on two public datasets: UniMiB SHAR and UMAFall. Their accuracy scores are compared in order to determine the best hybrid model. On the UniMiB SHAR dataset, the hybrid model based on the AlexN et model and the extra trees algorithm achieves the highest accuracy score of 95.27%. On the UMAFall dataset, the hybrid model based on the Xception model and the support vector machine/k-nearest neighbors/extra trees algorithms offer the highest accuracy score of 82.24 %.