A Convolutional Neural Network for Human Motion Recognition and Classification Using a Millimeter-Wave Doppler Radar

Abstract

Human movement detection based on millimeter-wave radar sensors is a technology of interest in various areas such as for smart surveillance, security, behavioral biometrics, biomedical systems, robotics, etc. This paper shows the feasibility and effectiveness of using a compact 24 GHz Doppler radar with a built-in low-noise microwave amplifier (LNA) for detecting and extracting signals coming from human motion. Reliability and accuracy is assessed based on a comprehensive theoretical analysis, and on simulation results followed by experimental investigations. A continuous wavelet transform (CWT) is used to decompose in-phase and quadrature ( <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">${I/Q}$ </tex-math></inline-formula> ) baseband signals to extract information about the dynamics of the system. The dataset consists of 1000 recordings in 8 motion classes (standing, walking, sitting, etc.). We propose to apply a two-channel convolutional neural network (CNN), which is composed of two CNN channels, for learning high-level features from time-domain signals and CWT spectrograms. One channel has four one-dimensional (1D) convolutional and pooling layers, and the other channel is made of three two-dimensional (2D) convolutional and pooling layers. In addition, the <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">${I/Q}$ </tex-math></inline-formula> signals are denoised by using Savitzky-Golay filtering, and both noisy and denoised signals are used as input signals for deep learning data augmentation purpose. We achieved an overall classification accuracy rate of 98.85% in motion classification for a two-branch CNN architecture, and an accuracy rate of 95.3% for a one-branch 2D-CNN. Our results show that a dual-channel CNN model can greatly increase the classification capabilities of human motion recognition and classification, and the proposed method can be effectively used with various radar signal classifications.