Generalized symmetric pair model for action classification in still images

Abstract

In many visual classification tasks finding semantically meaningful regions has been confirmed as an effective solution. This paper aims to improve the performance of action classification in still images by introducing a discriminative region selection method. We observed that humans have certain periodic or symmetric pairs and they are critical for recognition. We also demonstrate that in action classification semantically meaningful regions are close to their periodic or symmetric parts and propose a model called a Generalized Symmetric Pair Model. By learning a max margin classifier, this method could identify regions around periodic or symmetric pairs without detection techniques. The method utilizes both the characteristics of actions and knowledge regarding periodism and symmetry to improve the popular bag-of-words (BoW) framework. We evaluate our method on five challenging action classification datasets. Experiments show that our method outperforms the state-of-the-art on four datasets. Qualitative visualization also demonstrate that the proposed method indeed identify semantically meaningful regions.