Human Locomotion Activity Recognition using Spectral Analysis and Convolutional Neural Networks

Abstract

To enable a collaborative robot or exoskeleton robot to better support humans more safely and efficiently, understanding human behaviours is an essential enabling technology for the machines to make decisions on optimal control strategies. This work introduces an algorithm for classification of human locomotion activities using inertial data captured with Inertial Measurement Unit (IMU) to support the control of robots, exoskeletons and many other applications. The proposed approach, to recognise human locomotion activities and gait events, includes two main steps: 1) applying spectral analysis on the inertial signals to transform the data into time-frequency representation; and 2) classify the time-frequency data of an image to be recognised using Convolutional Neural Networks (CNN). There are six activities considered in the work. The highest accuracy in classification with a sub-set of 3 classes is 99% demonstrating the promising result in being applicable for real applications.