Abstract

This chapter addresses the topic of classification and separation of audio and music signals. It is a very important and a challenging research area. The importance of classification process of a stream of sounds come up for the sake of building two different libraries: speech library and music library. However, the separation process is needed sometimes in a cocktail-party problem to separate speech from music and remove the undesired one. In this chapter, some existed algorithms for the classification process and the separation process are presented and discussed thoroughly. The classification algorithms will be divided into three categories. The first category includes most of the real time approaches. The second category includes most of the frequency domain approaches. However, the third category introduces some of the approaches in the time-frequency distribution. The approaches of time domain discussed in this chapter are the short-time energy (STE), the zero-crossing rate (ZCR), modified version of the ZCR and the STE with positive derivative, the neural networks, and the roll-off variance. The approaches of the frequency spectrum are specifically the roll-off of the spectrum, the spectral centroid and the variance of the spectral centroid, the spectral flux and the variance of the spectral flux, the cepstral residual, and the delta pitch. The time-frequency domain approaches have not been yet tested thoroughly in the process of classification and separation of audio and music signals. Therefore, the spectrogram and the evolutionary spectrum will be introduced and discussed. In addition, some algorithms for separation and segregation of music and audio signals, like the independent Component Analysis, the pitch cancelation and the artificial neural networks will be introduced.

Highlights

  • Audio signal processing is an important subfield of signal processing that is concerned with the electronic manipulation of audio signals [1–6]

  • The problem of discriminating music from audio has increasingly become very important as automatic audio signal recognition (ASR) systems and it has been increasingly applied in the domain of real-world multimedia [7]

  • A general review of the common classification and separation algorithms used for speech and music was presented and some were introduced and discussed thoroughly

Read more

Summary

Introduction

Audio signal processing is an important subfield of signal processing that is concerned with the electronic manipulation of audio signals [1–6]. Audio signal changes randomly and continuously through time. The maximum frequency fmax varies according to type of audio signal, where, in the telephone transmission fmax is equal to 4 kHz, 5 kHz in mono-loudspeaker recording, 6 KHz in multi-loudspeaker recording or stereo, 11 kHz in FM broadcasting, it equals to 22 KHz in the CD recording. 3. Mixture of background music and single talker audio. 6. Complex sound mixture like multi-singers or multi-speakers with multi-music sources. 7. Non-music and non-audio signals: like fan, motor, car, jet sounds, etc. 8. Audio signal that is a mixture of more than one speakers talking simultaneously at the same time [8]. Abnormal music can be single word cadence, human whistle sound, or opposite reverberation [4, 34–38]

Representation of audio signal
Production of audio signal
Representation of music signal
Production of music signal
Audio and music signals classification
The ZCR algorithm
The Principle of Dominant Frequency
The Highest frequency
The Lowest frequency
The STE algorithm
The effect of positive derivation
Artificial neural network (ANN) approach
Spectral flux mean and variance
The mean and variance of the spectral centroid
Energy at 4 Hz modulation
Roll-off point
Cepstrum
Summary
Spectrogram (or sonogram)
Evolutionary spectrum (ES)
Separation of audio and music signals
ICA with ANN separation approach
The pitch cancelation
Findings
Conclusions
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call