Mel Frequency Cepstral Coefficients Features Research Articles

Mutual Information-based Feature Selection Strategy for Speech Emotion Recognition using Machine Learning Algorithms Combined with the Voting Rules Method

This study proposes a new approach to Speech Emotion Recognition (SER) that combines a Mutual Information (MI)-based feature selection strategy with simple machine learning classifiers such as K-Nearest Neighbor (KNN), Gaussian Mixture Model (GMM), and Support Vector Machine (SVM), along with a voting rule method. The main contributions of this approach are twofold. First, it significantly reduces the complexity of the SER system by addressing the curse of dimensionality by integrating a focused feature selection process, resulting in considerable savings in both computational time and memory usage. Second, it enhances classification accuracy by using selected features, demonstrating their effectiveness in improving the overall performance of the SER system. Experiments carried out on the EMODB dataset, using various feature descriptors, including Mel-frequency Cepstral Coefficients (MFCC), Perceptual Linear Prediction (PLP), and Linear Prediction Cepstral Coefficients (LPCC), showed that the best performance was achieved by GMM, with an accuracy of 85.27% using 39 MFCC features, compared to an accuracy of 82.55% using a high-dimensional vector with 111 features. Furthermore, applying the Joint Mutual Information (JMI) selection technique to extracted MFCC features reduces the vector size by 23.07% while improving the accuracy to 86.82%. These results highlight the effectiveness of combining the feature selection process with machine learning algorithms and the voting rules method for the SER task.

Comparative Analysis of CNN Architectures for English and Gujarati Speech Recognition Using MFCC Features

The paper investigates the efficiency of Convolutional Neural Network (CNN) architectures for speech recognition, focusing on the English and Gujarati languages. The study explores the impact of different CNN layer depths, utilizing 2, 3, and 4-layer configurations. Mel-Frequency Cepstral Coefficients (MFCC) is employed for feature extraction before feeding the data into the CNN models. The activation functions Rectified Linear Unit (ReLU) and hyperbolic tangent (tanh) are examined across all architectures. The research uses the Speech Commands dataset for English and a Gujarati digits dataset for analysis. After preprocessing and MFCC feature extraction, CNNs with varying depths and ReLU activation are employed. Training encompasses both languages, exploring parameters for balanced performance and efficiency, emphasizing tailored solutions for diverse linguistic contexts. The results reveal that the ReLU consistently yields superior performance on both the English and Gujarati datasets. In addition, the study found that increasing the depth of the CNN layers does not necessarily lead to improved recognition accuracy. The findings underscore the importance of selecting appropriate activation functions, highlight the nuanced relationship between CNN depth and recognition performance, and contribute to the understanding of CNN architecture optimization for speech recognition tasks in diverse linguistic contexts. The insights gained can inform the design of more effective speech recognition systems for globally recognized languages, such as English, and vernacular languages like Gujarati.

Analysis of the Style Characteristics of Regional Folk Songs and Music Classification Algorithms

Regional folk songs have a rich history and are filled with cultural values. In this paper, first, the style characteristics of regional folk songs are briefly introduced. Using four regional folk songs from the northwest, northeast, southwest, and Hakka as examples, time domain, frequency domain, and mel-frequency cepstral coefficient (MFCC) features were extracted. Finally, the bidirectional long short-term memory (BiLSTM)-based music classification algorithm is used to realize the classification of folk songs from different regions. It was found that using the time-frequency domain + MFCC as features produced better results in music classification than using only the time-frequency domain or only MFCC features. The BiLSTM algorithm achieved an accuracy of 0.8339 and an F1 value of 0.8201 for the 10 s fragment set, both of which were better than those of the K-nearest neighbor, support vector machine, and other classification algorithms. The results show that the approach used in this study to categorize regional folk songs is reliable and that it can be applied to real folk songs.

Optimized Music Classification with a Hybrid VGG16-RNN Using Mel-Spectrogram and MFCC Features

Music classification using deep neural networks has gained a lot of attention in recent years. This is due to the difficult task of capturing every essential aspect of music in features and interpretability of classifiers. There is limited research on the integration of VGG16 and RNNs, but the researchers found that few classifiers accurately capture intrinsic musical characteristics. Previous work in this field has primarily focused on spectral features, which has constrained overall performance. To address this issue, we proposed a novel hybrid neural architecture based on Visual Geometry Group 16 (VGG16), which is highly effective in extracting important features from musical variations. We combined VGG16 with several recurrent neural network (RNN) variants, including Gated Recurrent Unit (GRU), Bidirectional GRU (BiGRU), Long Short-Term Memory (LSTM), and Bidirectional LSTM (BiLSTM). Additionally, we compared their performance for the GTZAN dataset using both Mel-Spectrogram and Mel-Frequency Cepstral Coefficients (MFCC) features. Our results indicate that the VGG16+GRU model achieved the highest accuracy of 89. 60% with Mel spectrograms and 82. 70% with MFCC features. These findings demonstrate the effectiveness of combining advanced feature extraction techniques with deep learning models for music genre classification.

Music Genre Classification Using Mel Frequency Cepstral Coefficients and Artificial Neural Networks: A Novel Approach

Purpose: Music is an artistic expression with many categories in various genres and styles, characterized by its melodic and harmonic compositions. Music genre classification is crucial because genres serve as descriptors commonly used to organize large music collections, especially on the internet and in widely used applications like JOOX and Spotify. The aim of this research is to implement the Mel Frequency Cepstral Coefficients (MFCC) feature extraction method to generate numerical features from a set of specific music tracks. This collection of information will then be classified using machine learning. Methods: The method used in this study begins with combining the "GTZAN Dataset - Music Genre Classification" with additional data from TikTok and YouTube. The total dataset consists of 1,200 audio files, divided into 12 classes. The MFCC extraction process generates numerical representations of acoustic characteristics, which are then processed using Artificial Neural Networks. Result: The experiments demonstrate that increasing the amount of data is crucial, as it can enhance both variation and accuracy. The average accuracy achieved in this study is 91.42%, while the highest accuracy reaches 92.16%. These findings indicate that this study outperforms previous studies. Novelty: The novelty of this research lies in the integration of dynamic social media data (TikTok and YouTube) to enrich the standard GTZAN dataset, the repetition of the MFCC feature extraction process, and the combination of MFCC with Artificial Neural Networks (ANN).

A multi modal fusion coal gangue recognition method based on IBWO-CNN-LSTM

Accurate identification of coal and gangue is a crucial guarantee for efficient and safe mining of top coal caving face. This article proposes a coal-gangue recognition method based on an improved beluga whale optimization algorithm (IBWO), convolutional neural network, and long short-term memory network (CNN-LSTM) multi-modal fusion model. First, the mutation and memory library mechanisms are introduced into the beluga whale optimization to explore the solution space fully, prevent falling into local optimum, and accelerate the convergence process. Subsequently, the image mapping of the audio signal and vibration signal is performed to extract Mel-Frequency Cepstral Coefficients (MFCC) features, generating rich sample data for CNN-LSTM. Then the multi-head attention mechanism is introduced into CNN-LSTM to speed up the training speed and improve the classification accuracy. Finally, the IBWO-CNN-LSTM coal-gangue recognition model is constructed by the optimal hyperparameter combination obtained by IBWO to realize the automatic recognition of coal-gangue. The benchmark function proves that IBWO is superior to other optimization algorithms. By building an experimental platform for the impact of coal and gangue falling on the tail beam of hydraulic support, multiple experimental data collection is carried out. The experimental results show that the proposed coal-gangue recognition model has better performance than other recognition models, and the accuracy rate reaches 95.238%. The multi-modal fusion strategy helps to improve the accuracy and robustness of coal-gangue recognition.

The Intelligent Diagnosis of a Hydraulic Plunger Pump Based on the MIGLCC-DLSTM Method Using Sound Signals

To fully exploit the rich state and fault information embedded in the acoustic signals of a hydraulic plunger pump, this paper proposes an intelligent diagnostic method based on sound signal analysis. First, acoustic signals were collected under normal and various fault conditions. Then, four distinct acoustic features—Mel Frequency Cepstral Coefficients (MFCCs), Inverse Mel Frequency Cepstral Coefficients (IMFCCs), Gammatone Frequency Cepstral Coefficients (GFCCs), and Linear Prediction Cepstral Coefficients (LPCCs)—were extracted and integrated into a novel hybrid cepstral feature called MIGLCCs. This fusion enhances the model’s ability to distinguish both high- and low-frequency characteristics, resist noise interference, and capture resonance peaks, achieving a complementary advantage. Finally, the MIGLCC feature set was input into a double layer long short-term memory (DLSTM) network to enable intelligent recognition of the hydraulic plunger pump’s operational states. The results indicate that the MIGLCC-DLSTM method achieved a diagnostic accuracy of 99.41% under test conditions. Validation on the CWRU bearing dataset and operational data from a high-pressure servo motor in a turbine system yielded overall recognition accuracies of 99.64% and 98.07%, respectively, demonstrating the robustness and broad application potential of the MIGLCC-DLSTM method.

Emotion Recognition in Kurdish Speech from the Sorani Dialect Corpus

Given the increasing need for interactive human-computer applications, the field of employing machine learning algorithms to discern emotions from speech has seen a substantial surge in interest. While emotion recognition systems have made substantial progress in languages like German, English, Spanish, Dutch, and Danish, the availability of comprehensive datasets for the Kurdish language remains notably limited. This paper addresses this gap by focusing on emotion recognition in Sorani Kurdish dialect speech data, which was carefully gathered from openly available videos from the YouTube platform and categorized into four clear supposed emotions: neutral, sadness, happiness, and anger. The study applied both natural Mel Spectrogram and Mel-Frequency Cepstral Coefficient (MFCC) features for various spectrals, followed by the classification models K-Nearest Neighbor (KNN), Multi-Layer Perceptron (MLP), and Support Vector Machine (SVM) to evaluate the results. By closely examining and contrasting the results of using several methods for feature extraction, it was found that SVM obtained a higher accuracy, reaching as much as 85.57%. This is so much more than the first Kurdish emotion classification technique for the recognition of the emotion of the words.

Sound Quality Prediction Method of Dual-Phase Hy-Vo Chain Transmission System Based on MFCC-CNN and Fuzzy Generation

redict the sound quality of dual-phase Hy-Vo chain transmission system noise using a small sample size. Noise acquisition tests are conducted under various working conditions, followed by subjective evaluations using the equal interval direct one-dimensional method. Objective evaluations are performed using the Mel-frequency cepstral coefficient (MFCC). To understand the impact of the MFCC order and the frame number on prediction accuracy, MFCC feature maps of different specifications are analyzed. The dataset is expanded threefold using fuzzy generation with an appropriate membership degree. The convolutional neural network (CNN) is developed, utilizing MFCC feature maps as inputs and evaluation scores as outputs. Results indicate a positive correlation between the frame number and prediction accuracy, whereas higher MFCC orders introduce redundancy, reducing accuracy. The proposed CNN method outperforms three traditional machine learning approaches, demonstrating superior accuracy and resistance to overfitting.

A speech-based convolutional neural network for human body posture classification

Abstract Problem In recent years, computing and sensing advances have helped to develop efficient human posture classification systems, which assist in creating health systems that contribute to enhancing elder’s and disable’s life quality in context-aware and ambient assistive living applications. Other applications of body posture classification include the simulation of human bodies into virtual characters, security applications such as kidnapping and the body position of the kidnapper or victim, which can provide useful information to the negotiator or the rescue team, and other sports applications. Aim This work aims to propose a body posture classification system based on speech using deep learning techniques. Methods All samples pass through the preprocessing phase. The Mel-frequency cepstral coefficient (MFCC) with 12 coefficients was used as features, and the best features were selected by the correlation-based feature selection method. Two supervised learning techniques called artificial hydrocarbon networks (AHN) and convolutional neural networks (CNN) were deployed to efficiently classify body postures and movements. This research aims to detect six human positions through speech, which include walking downstairs, sitting, walking upstairs, running, laying, and walking. The dataset used in this work was prepared by the authors, named the human activity speech dataset. Results The best performance gained was with the AHN classifier of 68.9% accuracy and 67.1% accuracy with the CNN. Conclusion It was concluded that the MFCC features are the most powerful features in body position classification, and the deep learning methods are powerful in classifying body positions.

Classification of Infant Crying Sounds Using SE-ResNet-Transformer

Recently, emotion analysis has played an important role in the field of artificial intelligence, particularly in the study of speech emotion analysis, which can help understand one of the most direct ways of human emotional communication—speech. This study focuses on the emotion analysis of infant crying. Within cries lies a variety of information, including hunger, pain, and discomfort. This paper proposes an improved classification model using ResNet and transformer. It utilizes modified Mel-frequency cepstral coefficient Mel-frequency cepstral coefficient (MFCC) features obtained through feature engineering from infant cries and integrates SE attention mechanism modules into residual blocks to enhance the model’s ability to adjust channel weights. The proposed method achieved 93% accuracy rate in experiments, offering advantages of shorter training time and higher accuracy compared to other traditional models. It provides an efficient and stable solution for infant cry classification.

Data augmentation using a 1D-CNN model with MFCC/MFMC features for speech emotion recognition

Speech emotion recognition (SER) is attractive in several domains, such as automated translation, call centres, intelligent healthcare, and human–computer interaction. Deep learning models for emotion identification need considerable labelled data, which is only sometimes available in the SER industry. A database needs enough speech samples, good features, and a better classifier to identify emotions efficiently. This study uses data augmentation to enhance the amount of input voice samples and address the data shortage issue. The database capacity increases by adding white noise to the speech signals by data augmentation. In this work, the Mel-frequency Cepstral Coefficient (MFCC) and Mel-frequency Magnitude Coefficient (MFMC) features, along with a one-dimensional convolutional neural network (1D-CNN), are used to classify speech emotions. The datasets utilized to estimate the model's enactment were AESDD, CAFE, EmoDB, IEMOCAP, and MESD. The data augmentation with the 1D-CNN (MFMC) model performed best, with an average accuracy of 99.2% for AESDD, 99.5% for CAFE, 97.5% for EmoDB, 92.4% for IEMOCAP and 96.9% for the MESD database. The proposed 1D-CNN (MFMC) with data augmentation outperforms the 1D-CNN (MFCC) without data augmentation in emotion recognition.

Audio Signal Recognition in Complex Environments Using Sparse Representation

Recognizing audio signals in complex environments is crucial for acquiring adequate information. This paper integrates the sparse expression algorithm with Mel-frequency cepstral coefficient (MFCC) features. The combined approach was applied in convolutional neural network classifiers to recognize acoustic scenes in audio signals within complex environments. The algorithm was then simulated and tested using the TUT Sound Events 2016 and TUT Acoustic Scenes 2016 datasets. In the experiments, the efficacy of the developed sparse feature extraction method was validated. Then, the appropriate sparse dictionary size was determined. The algorithm was subsequently compared with two recognition algorithms based on sparse and MFCC features, respectively. It was found that the extraction approach proposed in this paper had a higher signal-to-noise ratio. The results revealed variations in the required sparse dictionary size for different datasets: 75 for TUT Sound Events 2016 and 150 for TUT Acoustic Scenes 2016. The MFCC-combined recognition algorithm demonstrated the fastest convergence during training among the three audio scene recognition algorithms. For both the TUT Sound Events 2016 and TUT Acoustic Scenes 2016 datasets, the MFCC-combined recognition algorithm achieved the highest classification accuracy, and the recognition accuracy for the former dataset was higher.

A Multi-Feature Fusion Approach for Dialect Identification using 1D CNN

The phonological variety of Kurdish, a language with several dialects, poses a distinct problem in automatically identifying dialects. This study examines and evaluates several sound criteria for identifying Kurdish dialects: Badini, Hawrami, and Sorani. We deployed a dataset including 6,000 samples and utilized a mix of 1D convolutional neural networks (CNN) and fully connected layers to conduct the identification job. Our study aimed to assess the efficacy of different sound characteristics in accurately identifying dialects. We employed the Mel-frequency Cepstral Coefficients (MFCC) and other features such as the Mel spectrogram, spectral contrast, and polynomial features to extract the sound characteristics. We conducted training and testing of our models utilizing both individual characteristics and a composite of all features. Our analysis revealed that the identification task achieved excellent accuracy rates, suggesting a promising potential for success. We achieved 95.75% accuracy using MFCC combined with a Mel spectrogram. The accuracy improved by including contrast in the MFCC feature extraction process to 91.42%. Similarly, using poly_features resulted in an accuracy of 90.83%. Remarkably, accuracy reached a maximum of 96.5% when all the attributes were combined.

A multi-modal Parkinson’s disease diagnosis system from EEG signals and online handwritten tasks using grey wolf optimization based deep learning model

Parkinson’s disease (PD) is a neurodegenerative disorder characterized by the gradual deterioration of motor function, affecting speech, writing, muscle control, and mobility. The existing studies have not utilized both the electroencephalography (EEG) signals and online handwritten tasks together to diagnose PD. The studies have also not explored the EEG signals collected from specific brain regions like the substansia niagra (SN) and ventral tegmental area (VTA), crucial for dopamine production linked to PD. This article proposes a multi-modal PD diagnosis system from EEG signals (collected from SN and VTA regions of the brain), collected during performing online handwritten tasks, using grey wolf optimization (GWO) algorithm. Mel-frequency cepstral coefficients (MFCC) features have been generated from the EEG signals and optimized by the GWO algorithm. The classification (diagnosis) experiments on the optimal number of feature values, obtained from GWO algorithm, have been carried out using bidirectional long short-term memory (BLSTM) variant of recurrent neural network (RNN). The classification experiments have also been conducted using support vector machine (SVM), bagged random forest (BRF), and long short-term memory (LSTM) variant of RNN classifier to have a performance comparison with the proposed method. The effectiveness of the introduced PD diagnosis system has been analyzed on a self-generated dataset named EEG signal based on online handwriting (ESOH). A maximum classification accuracy of 99.30% has been achieved from the proposed PD diagnosis system. The experimental outcomes illustrate that the introduced PD diagnosis system outperforms the state-of-the-art PD diagnosis systems relying on the EEG signals for diagnosing the PD.

Application of Deep Learning for Voice Command Classification in Turkish Language

In this study, a deep learning model was developed for the recognition and classification of voice commands using the Turkish Speech Command Dataset. The division of training, validation, and test sets was carried out on an individual basis. This approach aims to prevent the model from memorizing and to enhance its generalization capability. The model was trained using Mel-Frequency Cepstral Coefficients (MFCC) features extracted from voice files, and its classification performance was evaluated in detail. The findings indicate that the model successfully classifies voice commands with a high accuracy rate, achieving an overall accuracy of 92.3% on the test set, highlighting the potential of deep learning approaches in voice recognition technologies

Feature analysis and recognition of fiber breakage AE signals after propagation

Acoustic emission (AE) is a non-destructive testing technique, and establishing correlations between AE signals and material damage modes is one of its primary challenges. However, it is difficult to identify damage modes in ceramic matrix composites (CMCs) due to AE signal attenuation occurring after propagation and complex damage modes. In this study, AE signals generated by the breakage of C and SiC fibers were monitored at different distances and angles on the C/SiC plate. The attenuation of energy and the frequency spectra were analyzed. The Mel-frequency cepstral coefficient (MFCC) method was used to analyze the waveform data of AE signals and extract MFCC features. To identify the damage caused by C and SiC fiber breakage, AE parameter features and MFCC features were selected as inputs, and a fully connected neural network was constructed to train a supervised pattern recognition model. The results show that the MFCC feature has higher recognition accuracy than the traditional feature when AE is used for damage identification.

Implementation of Data Mining for Speech Recognition Classification of Sundanese Dialect Using KNN Method with MFCC Feature Extraction

The importance of preservation and development of speech recognition technology for regional languages such as Sundanese, which have unique phonetic characteristics. Regional language speech recognition can assist in the development of local, educational, and cultural preservation applications to implement and evaluate the effectiveness of the combination of MFCC and KNN methods in classifying Sundanese dialect speech recognition. Methods used include trait extraction with MFCC, which converts voice data into numerical representations based on frequency characteristics, and classification with KNN, which groups data based on similarity to train data. The Dataset used consisted of speech recordings of Western and Southern Sundanese dialects. The results showed that the k-Nearest Neighbors (KNN) method can classify Sundanese dialect speech recognition with an accuracy of 80.00%, showing good ability in distinguishing "Western" and "southern" dialects. Mel-Frequency Cepstral Coefficients (MFCC) proved to be very effective in extracting sound features, helping KNN achieve low error rates. The combination of MFCC and KNN proved effective for speech recognition classification of Sundanese dialects, providing satisfactory results with high accuracy.

DCNN for Pig Vocalization and Non-Vocalization Classification: Evaluate Model Robustness with New Data.

Since pig vocalization is an important indicator of monitoring pig conditions, pig vocalization detection and recognition using deep learning play a crucial role in the management and welfare of modern pig livestock farming. However, collecting pig sound data for deep learning model training takes time and effort. Acknowledging the challenges of collecting pig sound data for model training, this study introduces a deep convolutional neural network (DCNN) architecture for pig vocalization and non-vocalization classification with a real pig farm dataset. Various audio feature extraction methods were evaluated individually to compare the performance differences, including Mel-frequency cepstral coefficients (MFCC), Mel-spectrogram, Chroma, and Tonnetz. This study proposes a novel feature extraction method called Mixed-MMCT to improve the classification accuracy by integrating MFCC, Mel-spectrogram, Chroma, and Tonnetz features. These feature extraction methods were applied to extract relevant features from the pig sound dataset for input into a deep learning network. For the experiment, three datasets were collected from three actual pig farms: Nias, Gimje, and Jeongeup. Each dataset consists of 4000 WAV files (2000 pig vocalization and 2000 pig non-vocalization) with a duration of three seconds. Various audio data augmentation techniques are utilized in the training set to improve the model performance and generalization, including pitch-shifting, time-shifting, time-stretching, and background-noising. In this study, the performance of the predictive deep learning model was assessed using the k-fold cross-validation (k = 5) technique on each dataset. By conducting rigorous experiments, Mixed-MMCT showed superior accuracy on Nias, Gimje, and Jeongeup, with rates of 99.50%, 99.56%, and 99.67%, respectively. Robustness experiments were performed to prove the effectiveness of the model by using two farm datasets as a training set and a farm as a testing set. The average performance of the Mixed-MMCT in terms of accuracy, precision, recall, and F1-score reached rates of 95.67%, 96.25%, 95.68%, and 95.96%, respectively. All results demonstrate that the proposed Mixed-MMCT feature extraction method outperforms other methods regarding pig vocalization and non-vocalization classification in real pig livestock farming.

A lightweight and privacy preserved federated learning ecosystem for analyzing verbal communication emotions in identical and non-identical databases

The lack of vocal emotional expression is a major deficit in social communication disorders. The current scenario of artificial intelligence focuses on collaborative training of deep learning models without losing data privacy. The primary objective of this paper is to propose a federated learning-based classification model to identify and analyze the emotional capabilities of individuals with vocal emotion deficits. The methodology has developed a collaborative and privacy-preserved approach using federated learning for training the deep learning models. The proposed methodology utilizes Mel-frequency Cepstral Coefficients (MFCC) to preprocess audio recordings. The four datasets (RAVDESS, CREMA, TESS, SAVEE) including emotion-based classified audio recordings were collected from open sources. The collected audio recordings are 3 s each and the total data set has 668376 audio files with happy - 175119 files, sad – 172611 files, angry – 176346 files, and normal - 144300 files. Further, the input audio was pre-processed to generate MFCC features. The study began with extracting features from multiple pre-trained DL models as its base model. Then, the performance of the federated learning (FL) model was tested on independent and identically distributed (IID) and non-IID data. Further, this paper presents a federated deep learning-based multimodal system for verbal communication emotions classification that uses audio datasets to meet data privacy requirements by DL on the FL ecosystem. As per the findings, the federated learning trained model provides nearly similar parametric results in comparison to base model training. For IID data, the model had 99.71 % validation accuracy, precision (99.73 %), recall (99.69 %), and validation loss (0.01). The FL architecture with non-IID data outperformed these measures with validation accuracy (99.97 %), precision (99.97 %), recall (99.97 %), and least loss (0). Hence the acquired results support the utilization of federated learning ecosystem-based trained models with identically and non-identically distributed audio features from emotion identification without losing parametric results. In conclusion, the proposed techniques could be applied to identify verbal emotional deficits in individuals and could support developing emerging technological interventions for their well-being.