Combined Feature Extraction Method Research Articles

Emotion Modeling in Speech Signals: Discrete Wavelet Transform and Machine Learning Tools for Emotion Recognition System

Speech emotion recognition (SER) is a challenging task due to the complex and subtle nature of emotions. This study proposes a novel approach for emotion modeling using speech signals by combining discrete wavelet transform (DWT) with linear prediction coding (LPC). The performance of various classifiers, including support vector machine (SVM), K-Nearest Neighbors (KNN), Efficient Logistic Regression, Naive Bayes, Ensemble, and Neural Network, was evaluated for emotion classification using the EMO-DB dataset. Evaluation metrics such as area under the curve (AUC), average prediction accuracy, and cross-validation techniques were employed. The results indicate that KNN and SVM classifiers exhibited high accuracy in distinguishing sadness from other emotions. Ensemble methods and Neural Networks also demonstrated strong performance in sadness classification. While Efficient Logistic Regression and Naive Bayes classifiers showed competitive performance, they were slightly less accurate compared to other classifiers. Furthermore, the proposed feature extraction method yielded the highest average accuracy, and its combination with formants or wavelet entropy further improved classification accuracy. On the other hand, Efficient Logistic Regression exhibited the lowest accuracies among the classifiers. The uniqueness of this study was that it investigated a combined feature extraction method and integrated them to compare with various forms of combinations. However, the purposes of the investigation include improved performance of the classifiers, high effectiveness of the system, and the potential for emotion classification tasks. These findings can guide the selection of appropriate classifiers and feature extraction methods in future research and real-world applications. Further investigations can focus on refining classifiers and exploring additional feature extraction techniques to enhance emotion classification accuracy.

An efficient feature selection method for arabic and english speech emotion recognition using Grey Wolf Optimizer

Nowadays, analyzing and interpreting emotions through human speech communication have drawn a great attention in the field of human-computer interaction. Therefore, many speech recognition systems have been suggested to recognize the emotional states of the speaker utilizing the speech recordings of their spoken utterances. Feature extraction is an important step in building an emotion recognition system in which it is used to extract emotional features from speech data. However, not all extracted features are relevant to classify the emotion states of the speaker. The existence of irrelevant and redundant features generates unmeaningful patterns that lead to inaccurate and undesirable emotion classification performance. Therefore, this study proposes an intelligent feature selection method based on a novel bio-inspired optimization algorithm that mimics the hunting mechanism of wolves in the nature, called Grey Wolf Optimizer (GWO) and K-nearest neighbor (KNN) classifier, to find the most relevant subset of features to enhance the classification performance of an emotion recognition systems. The proposed method is called GWO-KNN. Emotion classification is performed on three distinct databases including Arabic Emirati-accented speech database, Ryerson Audio-Visual Database of Emotional Speech and Song dataset (RAVDESS), and Surrey Audio-Visual Expressed Emotion dataset (SAVEE). A combined or single feature extraction method is applied to extract the features from each dataset. The proposed method provides better classification performance for speech emotion recognition system compared to classical methods such as bat algorithm (BAT), cuckoo search (CS), White Shark Optimizer (WSH), and arithmetic optimization algorithm (AOA). Our proposed method also surpasses several state-of-the-art recent approaches that use the same datasets.

An ensemble learning prognostic method for capacity estimation of lithium-ion batteries based on the V-IOWGA operator

Capacity estimation is crucial for assessing the health statuses of lithium-ion batteries to develop better battery usage and maintenance strategies. However, it is difficult to satisfy multiple application situations in which each individual prognostic method has its own particular preconditions and application limitations. Thus, in this paper, an ensemble prognostic framework is proposed to integrate several individual prognostic methods to achieve better capacity estimation accuracy. In the proposed framework, a measurement- and calculation-based combined feature extraction method is first applied to the battery charging phase to better capture the extracted features that are related to the health statuses of lithium-ion batteries. Then, a novel validation dataset-based induced ordered weighted geometric averaging (V-IOWGA) operator is proposed to realize the time-varying weight allocation of each individual prognostic method to solve issue by which the performances of different prognostic algorithms vary in different phases. The advantages of the proposed ensemble model are verified on lithium-ion battery datasets from NASA PCoE and the University of Maryland CALCE Laboratory, and its prediction accuracy is better than that of other individual prognostic models. In addition, comparison experiments involving three types of ensemble models validate the superiority of the proposed model.

Improved Brain-Computer Interface Signal Recognition Algorithm Based on Few-Channel Motor Imagery.

Common spatial pattern (CSP) is an effective algorithm for extracting electroencephalogram (EEG) features of motor imagery (MI); however, CSP mainly aims at multichannel EEG signals, and its effect in extracting EEG features with fewer channels is poor—even worse than before using CSP. To solve the above problem, a new combined feature extraction method has been proposed in this study. For EEG signals from fewer channels (three channels), wavelet packet transform, fast ensemble empirical mode decomposition, and local mean decomposition were used to decompose the band-pass filtered EEG into multiple time–frequency components, and the corresponding components were selected according to the frequency characteristics of MI or the correlation coefficient between its time–frequency components and the original EEG signal. Furthermore, phase space reconstruction (PSR) was performed on the selected components after the three time-frequency decompositions, the maximum Lyapunov index was calculated, and the features were reconstructed; then, CSP projection mapping was used for the reconstructed features. The support vector machine probability output model was trained by the obtained three mappings. Probability outputs by three different support vector machines were then obtained. Finally, the classification of test samples was determined by the fusion of the Dempster–Shafer evidence theory at the decision level. The results showed that the accuracy of the proposed method was 95.71% on data set III of BCI competition II (left- and right-hand MI), which was 2.88% higher than the existing methods. On data set IIb of BCI competition IV, the average accuracy was 86.60%, which was 2.3% higher than the existing methods. This study verified the effectiveness of the proposed method and provided an approach for the research and development of the MI-BCI system based on fewer channels.

Prediction of diabetic protein markers based on an ensemble method

Introduction: A diabetic protein marker is a type of protein that is closely related to diabetes. This kind of protein plays an important role in the prevention and diagnosis of diabetes. Therefore, it is necessary to identify an effective method for predicting diabetic protein markers. In this study, we propose using ensemble methods to predict diabetic protein markers. Methodological issues: The ensemble method consists of two aspects. First, we combine a feature extraction method to obtain mixed features. Next, we classify the protein using ensemble classifiers. We use three feature extraction methods in the ensemble method, including composition and physicochemical features (abbreviated as 188D), adaptive skip gram features (abbreviated as 400D) and g-gap (abbreviated as 670D). There are six traditional classifiers in this study: decision tree, Naive Bayes, logistic regression, part, k-nearest neighbor, and kernel logistic regression. The ensemble classifiers are random forest and vote. First, we used feature extraction methods and traditional classifiers to classify protein sequences. Then, we compared the combined feature extraction methods with single methods. Next, we compared ensemble classifiers to traditional classifiers. Finally, we used ensemble classifiers and combined feature extraction methods to predict samples. Results: The results indicated that ensemble methods outperform single methods with respect to either ensemble classifiers or combined feature extraction methods. When the classifier is a random forest and the feature extraction method is 588D (combined 188D and 400D), the performance is best among all methods. The second best ensemble feature extraction method is 1285D (combining the three methods) with random forest. The best single feature extraction method is 188D, and the worst one is g-gap. Conclusion: According to the results, the ensemble method, either the combined feature extraction method or the ensemble classifier, was better than the single method. We anticipate that ensemble methods will be a useful tool for identifying diabetic protein markers in a cost-effective manner.

Effect of image partitioning on content-based image retrieval using colour and texture

The current application of content-based image retrieval (CBIR) was urgently needed to process image retrieval in large image databases. Previous research had succeeded in combining feature extraction methods using texture and colour. Combining the two methods of Gray Level Co-Occurrence matrix with Colour moment produces a higher level of precision than that produced when method is applied individually. This research examined more deeply about the effect of image partitioning using the grid partitioning method. The results of precision and recall on the CBIR method would be compared with no partitions, two partitions and three image partitions. The results obtained indicated that the addition of image partitions did not affect the precision value. Thus, it can be concluded that increasing the image partition increases the recall value of the overall CBIR performance.

Evaluating the performance metrics of different machine learning classifiers by combined feature extraction method in Alzheimer's disease detection

Evaluating the performance metrics of different machine learning classifiers by combined feature extraction method in Alzheimer's disease detection

Content-based image retrieval using combined texture and color features based on multi-resolution multi-direction filtering and color autocorrelogram

This paper proposes content-based image retrieval using combined feature extraction method by local energy, rotation-invariant uniform local binary patterns (RULBP) and color autocorrelogram. In this paper, features of local energy and RULBP are extracted in a high frequency domain of a gray image, using multi-resolution multi-direction (MRMD) filtering. Autocorrelogram is used in a two-dimensional histogram of hue and saturation color spaces. The Mahalanobis distance is used in measuring the degree of similarity of features. Evaluation of the experimental result of the image retrieval is based on precision and recall. The tested DBs (databases) are Corel and VisTex; Corel_MR and VisTex_MR of resolution variants; and Corel_MD and VisTex_MD of direction variants of first two DBs, respectively. The result of the experiment shows that the proposed method is superior to compared methods in the aspect of retrieval performance to retrieve MRMD images.

Iris recognition system based on a new combined feature extraction method

Iris recognition system based on a new combined feature extraction method

Iris recognition system based on a new combined feature extraction method

Recent science studies are interested in automatic systems without human intervention. The security field is in a great need of automatic identification system based on biometric properties. The uniqueness of the texture present in the human iris is a natural password. In this paper, we propose a novel iris recognition approach based on a combination of two systems. The first system extracts the local variation of the mean and the variance. The second system is based on the rotation invariant neighbourhoodbased binary pattern method (Hamouchene and Aouat, 2014a). Two sets of support vector machines (SVM) are used to train each system. Dempster-Shafer theory is used to distribute unitary mass over the two output sets of SVMs. Finally, the combined belief measures are transformed to a probability by applying the Dezert-Smarandache theory. In the experiments, the proposed system is compared to famous iris recognition systems and obtained better recognition rates.

A New Combined Feature Extraction Method for Persian Handwritten Digit Recognition

Feature extraction is one of the most important steps in Optical Character Recognition (OCR) systems, that is effective in recognition accuracy. In this paper, a suitable combination of different features such as zoning, hole size, crossing counts, etc. for Persian handwritten digits recognition is proposed. Due to high number of features, feature vector dimensions will be high that increases training time exponentially. In this paper, to solve this problem, Principal Component Analysis (PCA) method is employed for reducing the feature vector dimensions. Finally, data are classified by Support Vector Machine (SVM) classification method. The proposed method has been executed on HODA dataset which is one of the largest standard datasets of Persian handwritten digits that includes 60[Formula: see text]000 training and 20[Formula: see text]000 test samples. The proposed method reaches to 99.07% of accuracy in this dataset, and the experimental results show significant improvement in accuracy of Persian handwritten OCR compared to the previous methods.

An approach to EEG-based emotion recognition using combined feature extraction method

EEG signal has been widely used in emotion recognition. However, too many channels and extracted features are used in the current EEG-based emotion recognition methods, which lead to the complexity of these methods This paper studies on feature extraction on EEG-based emotion recognition model to overcome those disadvantages, and proposes an emotion recognition method based on empirical mode decomposition (EMD) and sample entropy. The proposed method first employs EMD strategy to decompose EEG signals only containing two channels into a series of intrinsic mode functions (IMFs). The first 4 IMFs are selected to calculate corresponding sample entropies and then to form feature vectors. These vectors are fed into support vector machine classifier for training and testing. The average accuracy of the proposed method is 94.98% for binary-class tasks and the best accuracy achieves 93.20% for the multi-class task on DEAP database, respectively. The results indicate that the proposed method is more suitable for emotion recognition than several methods of comparison.

Combining Feature Extraction Methods to Assist the Diagnosis of Alzheimer's Disease.

Neuroimaging data as (18)F-FDG PET is widely used to assist the diagnosis of Alzheimer's disease (AD). Looking for regions with hypoperfusion/ hypometabolism, clinicians may predict or corroborate the diagnosis of the patients. Modern computer aided diagnosis (CAD) systems based on the statistical analysis of whole neuroimages are more accurate than classical systems based on quantifying the uptake of some predefined regions of interests (ROIs). In addition, these new systems allow determining new ROIs and take advantage of the huge amount of information comprised in neuroimaging data. A major branch of modern CAD systems for AD is based on multivariate techniques, which analyse a neuroimage as a whole, considering not only the voxel intensities but also the relations among them. In order to deal with the vast dimensionality of the data, a number of feature extraction methods have been successfully applied. In this work, we propose a CAD system based on the combination of several feature extraction techniques. First, some commonly used feature extraction methods based on the analysis of the variance (as principal component analysis), on the factorization of the data (as non-negative matrix factorization) and on classical magnitudes (as Haralick features) were simultaneously applied to the original data. These feature sets were then combined by means of two different combination approaches: i) using a single classifier and a multiple kernel learning approach and ii) using an ensemble of classifier and selecting the final decision by majority voting. The proposed approach was evaluated using a labelled neuroimaging database along with a cross validation scheme. As conclusion, the proposed CAD system performed better than approaches using only one feature extraction technique. We also provide a fair comparison (using the same database) of the selected feature extraction methods.

Combined feature extraction method for classification of EEG signals

Classification of electroencephalogram (EEG) signals is an important task in brain---computer interfaces applications. This paper combines autoregressive (AR) model and sample entropy and presents ...

Hand movements classification for myoelectric control system using adaptive resonance theory.

This research proposes an exploratory study of a simple, accurate, and computationally efficient movement classification technique for prosthetic hand application. Surface myoelectric signals were acquired from the four muscles, namely, flexor carpi ulnaris, extensor carpi radialis, biceps brachii, and triceps brachii, of four normal-limb subjects. The signals were segmented, and the features were extracted with a new combined time-domain feature extraction method. Fuzzy C-means clustering method and scatter plot were used to evaluate the performance of the proposed multi-feature versus Hudgins' multi-feature. The movements were classified with a hybrid Adaptive Resonance Theory-based neural network. Comparative results indicate that the proposed hybrid classifier not only has good classification accuracy (89.09%) but also a significantly improved computation time.

Hemodialysis Arteriovenous Shunts Dysfunction Screening with a Fractional-order Feature and Non-cooperative Game Based Decision-making Model

s Early clots and thrombosis to the progress of stenosis leading to arteriovenous shunt dysfunction occurs at the venous anastomsis site or the outflow vein. To prevent vascular access complications, such as inflow or outflow stenosis, this study proposes a computerized decision support system combining feature extraction methods and a non-cooperative game (NCG)-based decision-making model to evaluate arteriovenous shunt stenosis in clinical usages. Feature extraction methods, including the Burg autoregressive (AR) method and the fractional-order self-synchronization error formulation, are used to estimate the characteristic frequencies and to quantify the differences between the reference data and the routine examination data, in terms of the degree of stenosis (DOS). For 42 long-term follow-up patients, a less parameterized NCG model is then used to identify the possible level of stenosis. A novel screening model might be further built on an embedded system, for portable medical screening applications.

Study on hybrid pattern recognition algorithm for modulated signals

A combined feature extraction and recognition method is proposed based on higher-order spectrum, cyclic spectrum and time-frequency characteristics. In the application of this method, α-dimensional features, quadratic spectral characteristics and Fourier transform spectral characteristics of the signal are used to extract three characteristic values including the envelope means (EM) of α plane, the recursive normalized frequency component detection value (RNFCDV) and the quadratic spectrum normalized frequency component detection value (QSNFCDV), which have the merits of less identification parameters, insensitive to noise, less computation, high recognition rate, and multi-species identification. With this method, simulation results show that the recognition rate is more the 98% with the signal to noise rate (SNR) not less than 6 dB. And the performance of this method is better than the common recognition algorithms. There are eight types of signal, such as amplitude modulation (AM), phase modulation (PM), amplitude shift keying (ASK), frequency shift keying (FSK), phase shift keying (PSK), minimum shift keying (MSK), quadrature amplitude modulation (QAM) and direct sequence spread spectrum (DSSS), have been used to validate the feasibility of the method.

Seismic signal recognition using improved BP neural network and combined feature extraction method

Seismic signal is generally employed in moving target monitoring due to its robust characteristic. A recognition method for vehicle and personnel with seismic signal sensing system was proposed based on improved neural network. For analyzing the seismic signal of the moving objects, the seismic signal of person and vehicle was acquisitioned from the seismic sensor, and then feature vectors were extracted with combined methods after filter processing. Finally, these features were put into the improved BP neural network designed for effective signal classification. Compared with previous ways, it is demonstrated that the proposed system presents higher recognition accuracy and validity based on the experimental results. It also shows the effectiveness of the improved BP neural network.

ECG Arrhythmias Classification by Combined Feature Extraction Method and Neural Network

ECG Arrhythmias Classification by Combined Feature Extraction Method and Neural Network

Extraction of Combined Features from Global/Local Statistics of Visual Words Using Relevant Operations

This paper presents a combined feature extraction method to improve the performance of bag-of-features image classification. We apply 10 relevant operations to global/local statistics of visual words. Because the pairwise combination of visual words is large, we apply feature selection methods including fisher discriminant criterion and L1-SVM. The effectiveness of the proposed method is confirmed through the experiment.