Indexing of NFL Video using MPEG-7 Descriptors and MFCC features

Abstract

In this paper, we propose an application system to classify American football (NFL) video shots into 4 categories, namely: pass plays, run plays, field goal/extra point plays (FG/XP) and kickoff/punt plays (K/P). The proposed system consists of two stages. The first stage is responsible for play event localization and the latter stage is responsible for feature mapping and classification. For play event localization we have proposed an algorithm that uses MPEG-7 motion activity descriptor and mean of the magnitudes of motion vectors, in a collaborative manner to detect the starting point of a play event within a video shot with 83% accuracy. The indexing and classification stage uses MPEG-7 motion and audio descriptors along with Mel Frequency Cepstrum Coefficients (MFCC) features to classify the events into 4 categories using Fisher's LDA. We obtain indexing accuracy of 92.5% by using a leave-one-out classification technique on a database of 200 video shots taken from 4 different games obtained from 4 different networks.