Classification of micro-Doppler signatures of human aquatic activity through simulation and measurement using transferred learning

Abstract

Remote detection of human aquatic activity can be applied not only to ocean surveillance but also to rescue operations. When a human is illuminated by electromagnetic waves, a Doppler signal is generated from his or her moving parts. Indeed, bodily movements are what make humans’ micro-Doppler signatures unique, offering a chance to classify human motions. Certain studies have analyzed and attempted to recognize human aquatic activity, but the topic has yet to be extensively studied. In the present research, we simulate the micro-Doppler signatures of a swimming person in an attempt to investigate those signatures’ characteristics. We model human arms as point scatterers while assuming a simple arm motion. By means of such a simulation, we can obtain spectrograms from a swimming person, then extend our measurement to multiple participants. Measurements are taken from five aquatic activities featuring five participants, comprising freestyle, backstroke, and breaststroke, pulling a boat, and rowing. As suggested by the simulation study, the spectrograms for the five activities show different micro-Doppler signatures; hence, we propose to classify them using a deep convolutional neural network (DCNN). In particular, we suggest the use of a transfer-learned DCNN, which is based on a DCNN pretrained by a large-scale RGB image dataset that is, ImageNet. The classification accuracy is calculated using fivefold cross-validation on our dataset. We find that a DCNN trained through transfer learning achieves the highest accuracy while also providing a significant performance boost over the conventional classification method.