Video Summarization using Deep Convolutional Neural Networks and Mutual Probability-based K-Nearest Neighbour

Abstract

ABSTRACT The video summarisation is an advanced mechanism for enabling users to handle and browse large videos in an effective manner. Various video summarisation methods are developed in recent days, in which handling of synchronisation and timing issues remain as the important challenge. The proposed video summarisation technique produces a short summary from the huge video stream. Initially, from an input database, the cricket videos containing number of frames are fed to keyframe extraction unit. Here, the keyframe extraction is done by the Euclidean distance and discrete cosine transform, and the best keyframes are selected based on the Euclidean distance. The residual frame is obtained by passing the input frames through deep convolutional neural network. Then, the similarity is calculated by Bhattacharyya distance. For video summarisation process, the optimal frameset is evaluated by matching residual keyframe with obtained keyframes. Here, input queries consisting of face object are subjected to object matching process, which is performed using the proposed mutual probability-based k-nearest neighbour (MP-KNN) to obtain relevant frames based on texture features. The performance of the proposed MP-KNN is superior based on precision, recall, and F-measure with values 0.963, 0.960, and 0.909, respectively.