A Stochastic ARG Matching Based Video Scene Search System with a Sketch Query Interface

Abstract

This paper proposes a video scene search system with a sketch query interface, whose search algorithm is based on a stochastic ARG (Attributed Relational Graph) matching. In this system, using the sketch query interface, the user can enter a sketch image as his/her query intuitively for searching scenes of a video. As its preprocessing, the system divides a video into several different scenes by extracting scene-change (cut-change) frames using a kind of chi-square test between color distributions of two adjoining frame images of the video. For searching the user's required scenes similar to his/her entered sketch query image, the system decomposes each of the scene-change frame images into some layers and an ARG is constructed from the layers. The ARG is used as the feature of the scene for the similarity search. Each sketch image entered as a query is also decomposed into layers and represented as an ARG. Hence, the system finds scenes of the video similar to the user's sketch image entered as his/her query by a stochastic ARG matching algorithm.