Novel approach to determining tempo and dramatic story sections in motion pictures

Abstract

This paper presents an original computational approach for the extraction of movie tempo for deriving story sections and events that convey high level semantics of stories portrayed in motion pictures, thus enabling better video annotation and interpretation systems. This approach, inspired by the existing cinematic conventions known as film grammar, uses the attributes of motion and shot length to define and compute a novel continuous measure of the tempo of a movie. Tempo flow plots are derived for several full-length motion pictures and edge detection is performed to extract dramatic story sections and events occurring in the movie, underlined by their unique tempo. The results confirm the reliable detection of actual distinct tempo changes and serve as a useful index for the dramatic development and narration of the story in motion pictures.