Temporal-Frequency Attention-Based Human Activity Recognition Using Commercial WiFi Devices

Xiaolong Yang,Ruoyu Cao,Liangbo Xie,Mu Zhou

doi:10.1109/access.2020.3012021

Abstract

Human activity recognition has been growing for decades in a variety of technological disciplines. However, in the existing WiFi-based human activity recognition systems, there are the following problems: Firstly, in the processing of channel state information (CSI) data, mainly for the removal of noise in the superimposed signal, there is no effective removal of useless multipath signals; Secondly, the data segmentation algorithm based on the empirical threshold requires manual adjustment of the threshold in different environments, resulting in poor robustness and unstable segmentation; Thirdly, simple learning classification is applied without specific design for CSI data structure and sufficiently abstracting information features. In this paper, a device-free human activity recognition system with a temporal-frequency attention mechanism is proposed, which can be deployed on commercial WiFi devices to identify human's daily activities. Firstly, the multipath signal affected by the channel change is extracted by using the difference of the propagation delay of different multipath, thereby eliminating the delay and invalid multipath signals that have undergone multiple reflections and refractions. Secondly, a neural network model based on attention mechanism is proposed, which assigns different weights to different characteristics and sequences by imitating the human brain to dedicate more attention to important information. Then, the long short-term memory (LSTM) model is used to learn the correlation features of different dimensions to realize human activity recognition. Finally, the system performance is evaluated in different environments, and the experimental results show that our syetem holds a better performance in both line-of-sight (LOS) and non-line-of-sight (NLOS) than the existing human activity recognition systems.

Highlights

Human activity recognition is one of the most potential technologies at present, and plays an important role in human-computer interaction [1]–[7]
Researchers have proposed a variety of human activity recognition systems that use different technologies, such as, methods based on wearable sensors [8], [9], methods based
In order to get the data dt,i affected by human activities i=1 in channel state information (CSI), we propose a multipath selection algorithm to get the effective information related to human activity in CSI as efficiently and completely as possible

Summary

Introduction

Human activity recognition is one of the most potential technologies at present, and plays an important role in human-computer interaction [1]–[7]. Such as smart home, security monitoring, medical assistance, etc. Special equipment needs to be deployed in the detection area to realize human activity recognition. As WiFi devices have entered thousands of households, in recent years, WiFi-based human activity recognition technology has attracted the attention of researchers.

Methods

Results

Conclusion