Multi-distributed Speech Emotion Recognition Based on Mel Frequency Cepstogram and Parameter Transfer

Abstract

Speech emotion recognition (SER) is the use of speech signals to estimate the state of emotion. At present, machine learning is one of the main research methods of SER, the test and training dataS of traditional machine learning all have the same distribution and feature space, but the data of speech is accessed from different environments and devices, with different distribution characteristics in real life. Thus, the traditional machine learning method is applied to the poor performance of SER. This paper proposes a multi-distributed SER method based on Mel frequency cepstogram (MFCC) and parameter transfer. The method is based on single-layer Long short-term memory (LSTM), pre-trained inception-v3 network and multi-distribution corpus. The speech pre-processed MFCC is taken as the input of single-layer LSTM, and input to the pre-trained inception-v3 network. the features are extracted through the pre-trained inception-v3 model. Then the features are sent to the newly defined the fully connected layer and classification layer, let the parameters of the fully connected layer be fine-tuned, finally get the classification result. The experiment proves that the method can effectively complete the classification of multi-distribution speech emotions and is more effective than the traditional machine learning framework of SER.