Human Activity Recognition Using Self-Powered Sensors Based on Multilayer Bidirectional Long Short-Term Memory Networks

Abstract

Sensor-based Human Activity Recognition (HAR) requires the acquisition of Channel State Information(CSI) data with time series based on sensors to predict human behavior. Many existing approaches are based on wearable sensors and cameras, which increase the burden and privacy issues for patients. Self-powered sensors are capable of non-contact collection of time series data generated by human activity while ensuring their own stable operation. In this paper, we propose a deep learning-based framework for contactless real-time activity detection of humans using self-powered sensors, which is called Multilayer Bi-directional Long Short-Term Memory (MBLSTM). The collected WIFI CSI data are fed into our proposed network model, which is then used to learn representative features of both sides from the original continuous CSI measurements. And the attention model is used to assign different weights to the learned features, and finally activity recognition is performed. Experimental results show that our proposed method achieves an accuracy of more than 96% for the recognition of six activities in multiple rounds of testing, outperforming other benchmark methods used for comparison.