Recognizing human motions through mixture modeling of inertial data

Abstract

Systems that recognize patterns in human motion are central to improvements in automation and human computer interaction. This work addresses challenges which arise in the context of recognizing arbitrary human actions from body-worn sensors. Chiefly the invariance to temporal scaling of events, coping with unlabeled data and estimating an appropriate model complexity. In order to deal with the severe case of unlabeled data, a method is proposed based on dynamic time alignment of Gaussian mixture model clusters for matching actions in an unsupervised temporal segmentation. In facilitation of this, an extensive corpus of continuous motion sequences composed of everyday tasks was recorded as analysis scenarios. The technique achieved an average accuracy of 72% for correctly merging actions performed by different participants. With labeled data and recognition models designed for particular classes, an accuracy of 89% was achieved in classifying the motion of participants left out of the modeling process. These results are contrasted with benchmark methods for recognition in a systematic validation revealing, in particular, an improved performance for mixture model prediction utilizing segments.