Study on a CNN-HMM Approach for Audio-Based Musical Chord Recognition

Abstract

Convolutional Neural Network (CNN) has shown its strength in image processing task, and Hidden Markov model (HMM) is a powerful tool for modeling sequential data. This paper presents a new architecture for audio-based chord recognition using a CNN-HMM mixture model. This architecture replaces the Gaussian mixture model (GMM) and Deep Neural Network (DNN) layers of GMM-HMM and DNN-HMM models with CNN. The model performance is evaluated through a dataset using different combinations of chroma vectors (STFT, CQT, CENS) as features, based on that, a scale recognition sub-model is tested.