Adaptive 3D shape context representation for motion trajectory classification

Abstract

The measurement of similarity between two motion trajectories is one of the fundamental task for motion analysis, perception and recognition. Previous research focus on 2D trajectory similarity measurement. With the advent of 3D sensors, it is possible to collect large amounts of 3D trajectory data for more precise motion representation. As trajectories in 3D space may often exhibit a similar motion pattern but may differ in location, orientation, scale, and appearance variations, the trajectory descriptor must be invariant to these degrees of freedom. Shape context is one of the rich local shape descriptors can be used to represent the trajectory in 2D space, however, rarely applied in the 3D motion trajectory recognition field. To handle 3D data, in this paper, we first naturally extend the shape context into the spatiotemporal domain by adopting a spherical neighborhood, and named it 3D Shape Context(3DSC). To achieve better global invariant on trajectories classification, the adaptive outer radius of 3DSC for extracting 3D Shape Context feature is proposed. The advantages of our proposed 3D shape context are: (1) It is invariant to motion trajectories translation and scale in the spatiotemporal domain; (2) It contains the whole trajectory points in the 3DSC ball volume, thus can achieve global information representation and is good for solving sub-trajectories problem; (3) It is insensitive to the appearance variations in the identical meaning trajectories, meanwhile, can greatly discriminate the distinct meaning trajectories. In trajectory recognition phase, we consider a feature-to-feature alignment between motion trajectories based on dynamic time warping and then use the one nearest neighbor (1NN) classifier for final accuracy evaluation. We test the performance of proposed 3D SC-DTW on UCI ASL large dataset, Digital hand dataset and the experimental results demonstrate the effectiveness of our method.