Classification of audio signals using generalized spatial fuzzy clustering.

Abstract

With the increasing use of multimedia data, the need for automatic classification and retrieval of certain kinds of audio data has become an important issue. In this paper, we propose an efficient method of audio signal segmentation and classification from audiovisual database. While conventional methods apply thresholding to audio features such as energy and zero‐crossing rate to detect the boundaries, causing misclassification for audio signals which contain certain audio effects such as fade‐in, fade‐out, and cross‐fade, the proposed algorithm, called general spatial fuzzy c‐means algorithm (GSFCM), solves the problem by taking into account the local spatial information which is weighted correspondingly to neighbor elements based on their distance attributes. GSFCM detects the boundaries between two different audio signals, classifies segments, and then extracts unique feature vectors. This results in the accurate detection and classification. Experiment results for the audio signal from TV news program at 44.1 kHz with 30‐min long confirm that the proposed method outperforms conventional methods in terms of accuracy of the audio signal classification. These results demonstrate that the proposed method is a suitable candidate for audio‐video indexing which is compressed by MPEG. [Work supported by the MKE, Korea, under the ITRC supervised by IITA (IITA‐2008‐(C1090‐0801‐0039)).]