Human action recognition using Meta-Cognitive Neuro-Fuzzy Inference System

Abstract

In this paper, we propose a Meta-Cognitive Neuro-Fuzzy Inference System (McFIS) for accurate detection of human actions from video sequences. In this paper, we employ optical flow based features as they can represent information from local pixel level to global object level between two consecutive image planes. The functional relationship between these optical flow based features and action classes is approximated using McFIS classifier. The sequential learning algorithm is developed based on the principles of self-regulation observed in human meta-cognition. McFIS decides on what-to-learn, when-to-learn and how-to-learn based on the knowledge stored in the classifier and the information contained in the new training sample. The sequential learning algorithm of McFIS is controlled and monitored by the meta-cognitive components which uses class-specific and knowledge based criteria along with self-regulatory thresholds to decide on one of the following strategies: a) sample deletion b) sample learning and c) sample reserve. Performance of proposed McFIS based human action recognition system is evaluated using benchmark Weizmann and KTH video sequences. The simulation results are compared with well known support vector machine classifier and also with state-of-the-art action recognition results reported in the literature. The results clearly indicates McFIS action recognition system achieves better performances with minimal computational effort.