Discriminant Analysis Feature Research Articles

Pseudo-set Frequency Refinement architecture for fine-grained few-shot class-incremental learning

Few-shot class-incremental learning was introduced to solve the model adaptation problem for new incremental classes with only a few examples while still remaining effective for old data. Although recent state-of-the-art methods make some progress in improving system robustness on common datasets, they fail to work on fine-grained datasets where inter-class differences are small. The problem is mainly caused by: (1) the overlapping of new data and old data in the feature space during incremental learning, which means old samples can be falsely classified as newly introduced classes and induce catastrophic forgetting phenomena; (2) lacking discriminative feature learning ability to identify fine-grained objects. In this paper, a novel Pseudo-set Frequency Refinement (PFR) architecture is proposed to tackle these problems. We design a pseudo-set training strategy to mimic the incremental learning scenarios so that the model can better adapt to novel data in future incremental sessions. Furthermore, separate adaptation tasks are developed by utilizing frequency-based information to refine the original features and address the above challenging problems. More specifically, the high and low-frequency components of the images are employed to enrich the discriminative feature analysis ability and incremental learning ability of the model respectively. The refined features are used to perform inter-class and inter-set analyses. Extensive experiments show that the proposed method consistently outperforms the state-of-the-art methods on four fine-grained datasets.

A hybrid multimodal machine learning model for Detecting Alzheimer's disease

Alzheimer's disease (AD) diagnosis utilizing single modality neuroimaging data has limitations. Multimodal fusion of complementary biomarkers may improve diagnostic performance. This study proposes a multimodal machine learning framework integrating magnetic resonance imaging (MRI), positron emission tomography (PET) and cerebrospinal fluid (CSF) assays for enhanced AD characterization. The model incorporates a hybrid algorithm combining enhanced Harris Hawks Optimization (HHO) algorithm referred to as ILHHO, with Kernel Extreme Learning Machine (KELM) classifier for simultaneous feature selection and classification. ILHHO enhances HHO's search efficiency by integrating iterative mapping (IM) to improve population diversity and local escaping operator (LEO) to balance exploration-exploitation. Comparative analysis with other improved HHO algorithms, classic meta-heuristic algorithms (MHAs), and state-of-the-art MHAs on IEEE CEC2014 benchmark functions indicates that ILHHO achieves superior optimization performance compared to other comparative algorithms. The synergistic ILHHO-KELM model is evaluated on 202 AD Neuroimaging Initiative (ADNI) subjects. Results demonstrate superior multimodal classification accuracy over single modalities, validating the importance of fusing heterogeneous biomarkers. MRI + PET + CSF achieves 99.2 % accuracy for AD vs. normal control (NC), outperforming conventional and proposed methods. Discriminative feature analysis provides further insights into differential AD-related neurodegeneration patterns detected by MRI and PET. The differential PET and MRI features demonstrate how the two modalities provide complementary biomarkers. The neuroanatomical relevance of selected features supports ILHHO-KELM's potential for extracting sensitive AD imaging signatures. Overall, the study showcases the advantages of capitalizing on complementary multimodal data through advanced feature learning techniques for improving AD diagnosis.

A Stepwise Discriminant Analysis and FBCSP Feature Selection Strategy for EEG MI Recognition

A Stepwise Discriminant Analysis and FBCSP Feature Selection Strategy for EEG MI Recognition

Discriminative feature analysis of dairy products based on machine learning algorithms and Raman spectroscopy

Discriminant analysis of similar food samples is an important aspect of achieving food quality control. The effective combination of Raman spectroscopy and machine learning algorithms has become an extremely attractive approach to develop intelligent discrimination techniques. Feature spectral analysis can help researchers gain a deeper understanding of the data patterns in food quality discrimination. Herein, this work takes the discrimination of three brands of dairy products as an example to investigate the Raman spectral feature based on the support vector machines (SVM), extreme learning machines (ELM) and convolutional neural network (CNN) algorithms. The results show that there are certain differences in the optimal spectral feature interval corresponding to different machine learning algorithms. Selecting the appropriate spectral feature interval can maintain high recognition accuracy and improve the computational efficiency of the algorithm. For example, the SVM algorithm has a recognition accuracy of 100% in the 890-980 cm−1, 1410-1500 cm−1 fusion spectral range, which takes about 200 s. The ELM algorithm also has a recognition accuracy of 100% in the 890-980 cm−1, 1410-1500 cm−1 fusion spectral range, which takes less than 0.3 s. The CNN algorithm has a recognition accuracy of 100% in the 890-980 cm−1, 1050-1180 cm−1, 1410-1500 cm−1 fusion spectral range, which takes about 80 s. In addition, by analyzing the distribution of spectral feature intervals based on Euclidean distance, the distribution of experimental samples based on feature spectra is visually displayed. Through the spectral feature analysis process of similar samples, a set of analysis strategies is provided to deeply reveal the data foundation of classification algorithms, which can provide reference for the analysis of relevant discriminative research patterns.

Efficient Iris Image Recognition System Based on Machine Learning Approach

Iris identification is a well‐known technology used to detect striking biometric identification techniques for recognizing human beings based on physical behavior. The texture of the iris is essential and its anatomy varies from individual to individual. Humans have distinctive physical characteristics that never change. This has resulted in a considerable advancement in the field of iris identification, which inherits the random variation of the data and is often a dependable technological area. This research proposes three algorithms to examine the classifications in machine learning approaches using feature extraction for the iris image. The applied recognition system used many methods to enhance the input images for iris recognition using the Multimedia University (MMU) database. Linear Discriminant Analysis (LDA) feature extraction method is applied as an input of three algorithms of machine learning approaches that are OneR, J48, and JRip classifiers. The result indicates that the OneR classifier with LDA achieves the highest performance with 94.387 % accuracy, while J48 and JRip reached to 90.151% and 86.885% respectively. Index Terms— Iris recognition, LDA, OneR, J48, JRip.

Instant learning based on deep neural network with linear discriminant analysis features extraction for accurate iris recognition system

Instant learning based on deep neural network with linear discriminant analysis features extraction for accurate iris recognition system

Principal component and linear discriminant analyses for the classification of hominoid primate specimens based on bone shape data.

In this study, we tested the hypothesis that machine learning methods can accurately classify extant primates based on triquetrum shape data. We then used this classification tool to observe the affinities between extant primates and fossil hominoids. We assessed the discrimination accuracy for an unsupervised and supervised learning pipeline, i.e. with principal component analysis (PCA) and linear discriminant analysis (LDA) feature extraction, when tasked with the classification of extant primates. The trained algorithm is used to classify a sample of known fossil hominoids. For the visualization, PCA and uniform manifold approximation and projection (UMAP) are used. The results show that the discriminant function correctly classified the extant specimens with an F1-score of 0.90 for both PCA and LDA. In addition, the classification of fossil hominoids reflects taxonomy and locomotor behaviour reported in literature. This classification based on shape data using PCA and LDA is a powerful tool that can discriminate between the triquetrum shape of extant primates with high accuracy and quantitatively compare fossil and extant morphology. It can be used to support taxonomic differentiation and aid the further interpretation of fossil remains. Further testing is necessary by including other bones and more species and specimens per species extinct primates.

Image Classification of Tempe Fermentation Maturity Using Naïve Bayes Based on Linear Discriminant Analysis

One of the foods in Indonesia that has a lot of nutritional content and benefits, one of which is tempeh. Tempe is usually made by fermenting soybeans with mold under special conditions to become tempeh. In the fermentation process, tempeh producers need to monitor the maturity of the tempeh until it is suitable for consumption. To detect this maturity requires a separate effort, so that an image processing approach is proposed in this study with the support of feature selection. An image allows for various features to be taken, such as texture features using GLCM and various color features including RGB, HSV, LAB, CMYK, YUV, HCL, HIS, LCH. With so many features, it is necessary to do a selection so that computation in its classification becomes efficient. This study aims to classify tempeh fermented images using the Naive Bayes method with Linear Discriminant Analysis (LDA)feature selection for GLCM features and eight color features. Tempe fermentation image is divided into three classes, namely raw, ripe and rotten. Based on the experimental results, the average accuracy in the test is 84.06%. In testing the fastest time is 1.87 seconds and the longest is 2.20 seconds. This shows that the classification of fermented tempeh maturity with Naive Bayes with LDA feature selection can work well.

Estimation of Abnormal Cell Growth and MCG-Based Discriminative Feature Analysis of Histopathological Breast Images

The accurate prediction of cancer from microscopic biopsy images has always been a major challenge for medical practitioners and pathologists who manually observe the shape and structure of the cells from tissues under a microscope. Mathematical modelling of cell proliferation helps to predict tumour sizes and optimizes the treatment procedure. This paper introduces a cell growth estimation function that uncovers the growth behaviour of benign and malignant cells. To analyse the cellular level information from tissue images, we propose a minimized cellular graph (MCG) development method. The method extracts cells and produces different features that are useful in classifying benign and malignant tissues. The method’s graphical features enable a precise and timely exploration of huge amounts of data and can help in making predictions and informed decisions. This paper introduces an algorithm for constructing a minimized cellular graph which reduces the computational complexity. A comparative study is performed based on the state-of-the-art classifiers, SVM, decision tree, random forest, nearest neighbor, LDA, Naive Bayes, and ANN. The experimental data are obtained from the BreakHis dataset, which contains 2480 benign and 5429 malignant histopathological images. The proposed technique achieves a 97.7% classification accuracy which is 7% higher than that of the other graph feature-based classification methods. A comparative study reveals a performance improvement for breast cancer classification compared to the state-of-the-art techniques.

Adhesive bond quality classification using machine learning algorithms based on ultrasonic pulse-echo immersion data

In this study, we explored the detection of weak bonds (WBs) due to contamination and faulty curing (FC) using linear ultrasound and machine learning. For this purpose, aluminium single-lap adhesive joints containing three variants of bonding quality were investigated: perfect bond, WB due to release agent (RA) contamination, and WB due to FC. The data, according to the deviation of the bonding protocol, were arranged in two groups, creating two datasets: distinct and complete. Each dataset included all bonding conditions (perfect, RA, and FC), although the distinct dataset contained only marginal cases, which were expected to be well separable, whereas the complete dataset included data with minor deviations from the bonding protocol. Pulse-echo C-scan images were acquired for all prepared samples in the immersion tank, and 45 features were initially extracted from the time traces representing each bonding group. The initial data were analysed via a t-test and pairwise correlation analysis to reveal statistically significant features. Then, we performed dimensionality reduction using tree-based, recursive, sequential, and linear discriminant analysis (LDA) feature selectors to explore feature importance and classification accuracy with different feature subsets. Finally, the important features identified with the different feature selectors were fed to support vector machine (SVM) classifiers, and the classification accuracies were compared amongst the different feature subsets. The classification accuracy using a distinct dataset in some cases demonstrated nearly 99% accuracy, indicating that significant bonding protocol deviations could be easily detected. It was demonstrated that classification accuracy increased with the number of features. However, even in the case of the 2D feature space obtained using linear discriminant analysis, the bonding quality classification accuracy remained higher than 84%. The feature subspace reduction with LDA demonstrated sufficient classification accuracy and an improvement of nearly 40% in training time compared with that for the initial feature set. Thus, the classical ultrasonic pulse-echo C-scan with an LDA feature transformation and SVM classifier could be used to identify the deviations in the bonding protocol in aluminium single-lap adhesive joints.

ECG beat classification based on discriminative multilevel feature analysis and deep learning approach

Extraction of significant features from Electrocardiogram (ECG) signal is the primary concern for accurate diagnosis of cardiac arrhythmia. This work presents a novel approach of multilevel feature analysis and deep learning strategy for efficient ECG beat classification. The multilayer characteristics of ECG signal obtained from Empirical mode decomposition (EMD) are explored to extract discriminative feature vectors. The multilayer similarity coefficients are obtained by applying Dynamic time warping (DTW) metric and Pearson correlation coefficient (PCC) as diagnostic features. Furthermore, discrete orthonormal Stockwell transform (DOST) is employed for time–frequency representation of ECG data in multilayer aspect. The sublet changes in time–frequency spaces due to the presence of cardiac abnormalities are captured by estimating various nonlinear parameters. Interlayer deviations of these nonlinear parameters are estimated as the significant characteristics of arrhythmia detection. In addition, this study shows that the phase synchrony (PS) coefficients are prominent index for quantifying the crucial phase variation between normal and abnormal heart conditions. Hence multilevel PS coefficients are employed as the predictors of arrhythmia detection. Finally, the extracted feature vectors are fed to various classifiers to identify the heart anomalies. The proposed technique attains average accuracy of 98.82% and 98.14% using support vector machine (SVM) and k-nearest neighbors (k-NN) classifier respectively. The improved classification accuracy of 99.05% is obtained with the strategy of combining deep neural network (DNN) with the proposed feature extraction policy. Present work delivers satisfactory and superior performances for arrhythmia classification compare to other existing approaches.

Early Detection of Breast Cancer Tumors using Linear Discriminant Analysis Feature Selection with Different Machine Learning Classification Methods

Globally, the frequency of breast cancer and its morality speak to a critical and developing risk for the developing countries. In Asia, Pakistan has the biggest rate of breast cancer. It is evaluated that every year 83,000 cases were reported in Pakistan and over 40,000 deaths are caused by breast cancer. Patients suffering from this malignancy have a better chance of surviving if they are diagnosed early. Many Early identification of breast cancer can be achieved using data mining techniques, allowing preventative treatments to be done. In this research Wisconsin Breast Cancer Dataset (WBCD) and Duke Breast cancer dataset (DBDS) are used with Linear Discriminant Analysis (LDA) feature selection with Support Vector Machine (SVM), Decision Tree (DT), Neural Network and Random Forest (RF) machine learning classifiers to predict breast cancer tumors. The finding of the proposed model is that feature selections through LDA improve the accuracy of detecting tumors and also reduce time duration of executing model. The best machine learning model with LDA feature selection is Neural Network Model with highest accuracy 1.00 among all classification models and also consume less time.

Early Detection of Breast Cancer Tumors Using Linear Discriminant Analysis Feature Selection with Different Classification Methods

Globally, the frequency of breast cancer and its morality speaks to a critical and developing risk for developing countries. In Asia, Pakistan has the biggest rate of breast cancer. It is evaluated that every year 83,000 cases were reported in Pakistan and over 40,000 deaths are caused by breast cancer. Many Early identifications of breast cancer can be achieved using data mining techniques, allowing preventative treatments to be done. Patients suffering from this malignancy have a better chance of surviving if they are diagnosed early. So, there is a need to develop a system to diagnose breast cancer tumors at an early stage. In this research WBCD and Duke Breast cancer datasets (DBDS) are used with Linear Discriminant Analysis (LDA) feature selection. Support Vector Machine (SVM), Decision Tree (DT), and Random Forest (RF) are classifiers to predict breast cancer tumors.

Evaluating Performance of EEG Data-Driven Machine Learning for Traumatic Brain Injury Classification.

Objectives:Big data analytics can potentially benefit the assessment and management of complex neurological conditions by extracting information that is difficult to identify manually. In this study, we evaluated the performance of commonly used supervised machine learning algorithms in the classification of patients with traumatic brain injury (TBI) history from those with stroke history and/or normal EEG.Methods:Support vector machine (SVM) and K-nearest neighbors (KNN) models were generated with a diverse feature set from Temple EEG Corpus for both two-class classification of patients with TBI history from normal subjects and three-class classification of TBI, stroke and normal subjects.Results:For two-class classification, an accuracy of 0.94 was achieved in 10-fold cross validation (CV), and 0.76 in independent validation (IV). For three-class classification, 0.85 and 0.71 accuracy were reached in CV and IV respectively. Overall, linear discriminant analysis (LDA) feature selection and SVM models consistently performed well in both CV and IV and for both two-class and three-class classification. Compared to normal control, both TBI and stroke patients showed an overall reduction in coherence and relative PSD in delta frequency, and an increase in higher frequency (alpha, mu, beta and gamma) power. But stroke patients showed a greater degree of change and had additional global decrease in theta power.Conclusions:Our study suggests that EEG data-driven machine learning can be a useful tool for TBI classification.Significance:Our study provides preliminary evidence that EEG ML algorithm can potentially provide specificity to separate different neurological conditions.

Dynamic statistical process monitoring based on online dynamic discriminative feature analysis

A novel online discriminative dynamic feature analysis (ODDFA) algorithm is formulated and then employed for dynamic process monitoring. Different from traditional multivariate analytical algorithms which derive representative signature inherited in a dataset given from the normal operating condition, the proposed ODDFA algorithm only seeks for a pair of projecting directions, which could be discriminative to the deviation between the online sampled data and the normal operating dataset. From the standpoint of its formulation, the ODDFA algorithm is activated online with the availability of stacking online time-serial samples into a matrix form, and the latent feature resulted from a two-dimensional projection could be extremely discriminative to the inconsistency inherited in the online time-serial samples. Therefore, the utilization of the ODDFA algorithm in dynamic statistical process monitoring is always a preferable choice in contrast to other counterparts, as demonstrated through comparisons in monitoring two classical dynamic processes.

Maternal Vegetable and Fruit Consumption during Pregnancy and Its Effects on Infant Gut Microbiome.

Maternal nutrition intake during pregnancy may affect the mother-to-child transmission of bacteria, resulting in gut microflora changes in the offspring, with long-term health consequences in later life. Longitudinal human studies are lacking, as only a small amount of studies showing the effect of nutrition intake during pregnancy on the gut microbiome of infants have been performed, and these studies have been mainly conducted on animals. This pilot study explores the effects of high or low fruit and vegetable gestational intake on the infant microbiome. We enrolled pregnant women with a complete 3-day dietary record and received postpartum follow-up. The 16S rRNA gene sequence was used to characterize the infant gut microbiome at 2 months (n = 39). Principal coordinate analysis ordination revealed that the infant gut microbiome clustered differently for high and low maternal fruit and vegetable consumption (p < 0.001). The linear discriminant analysis effect size and feature selection identified 6 and 17 taxa from both the high and low fruit and vegetable consumption groups. Among the 23 abundant taxa, we observed that six maternal intake nutrients were associated with nine taxa (e.g., Erysipelatoclostridium, Isobaculum, Lachnospiraceae, Betaproteobacteria, Burkholderiaceae, Sutterella, Clostridia, Clostridiales, and Lachnoclostridium). The amount of gestational fruit and vegetable consumption is associated with distinct changes in the infant gut microbiome at 2 months of age. Therefore, strategies involving increased fruit and vegetable consumption during pregnancy should be employed for modifying the gut microbiome early in life.

A method for degradation features extraction of diesel engine valve clearance based on modified complete ensemble empirical mode decomposition with adaptive noise and discriminant correlation analysis feature fusion

The health assessment of the valve clearance is a key link to realize the failure prediction and health management of the valve mechanism. To accurately evaluate the state of valve clearance, this article proposes a diesel engine valve clearance degradation feature extraction method based on modified complete ensemble empirical mode decomposition with adaptive noise and discriminant correlation analysis feature fusion algorithm. First, we use modified complete ensemble empirical mode decomposition with adaptive noise to adaptively filter the cylinder head vibration signal. Then, power spectrum entropy and improved hierarchical dispersion entropy are proposed as degenerate feature entropy. To improve the sensitivity of the degraded feature entropy to the degraded state, the discriminant correlation analysis algorithm is used to fuse the two types of feature entropy to obtain fused degraded feature entropy. Finally, the degenerate fusion features are input into the least squares support vector machine to realize the health status assessment of the valve mechanism. Through the verification of test data, the results show that the proposed method can effectively evaluate the health state of the valve clearance of diesel engines.

Automated Atrial Fibrillation Detection Based on Feature Fusion Using Discriminant Canonical Correlation Analysis

Atrial fibrillation (AF) is one of the most common cardiovascular diseases, with a high disability rate and mortality rate. The early detection and treatment of atrial fibrillation have great clinical significance. In this paper, a multiple feature fusion is proposed to screen out AF recordings from single lead short electrocardiogram (ECG) recordings. The proposed method uses discriminant canonical correlation analysis (DCCA) feature fusion. It fully takes intraclass correlation and interclass correlation into consideration and solves the problem of computation and information redundancy with simple series or parallel feature fusion. The DCCA integrates traditional features extracted by expert knowledge and deep learning features extracted by the residual network and gated recurrent unit network to improve the low accuracy of a single feature. Based on the Cardiology Challenge 2017 dataset, the experiments are designed to verify the effectiveness of the proposed algorithm. In the experiments, the F1 index can reach 88%. The accuracy, sensitivity, and specificity are 91.7%, 90.4%, and 93.2%, respectively.

Handwritten MODI Character Recognition Using Transfer Learning with Discriminant Feature Analysis

“MODI lipi” is one of the ancient scripts of Western India. Considerable work has been reported for various other ancient Indian languages except for MODI lipi. Its structural characteristics and non-availability of image database make MODI recognition challenging. The work reported in this paper comprises the creation of an image dataset for MODI handwritten characters and the development of a supervised Transfer Learning (TL)-based classification framework. It makes use of Deep Convolutional Neural Network (DCNN) Alexnet as a pre-trained network to transfer weights to retrain the network. This network is used as a feature extractor to extract features from different layers of the network. A Support Vector Machine (SVM) is trained on activation features to obtain classifier models. These models are investigated further for recognition accuracy and feature analysis. Subjective and objective measures are used to select discriminant deep features. We achieved recognition accuracies of 92.32% and 97.25% for Handwritten MODI character recognition and handwritten Devnagari character recognition, respectively.

Emotion Recognition of EEG Signals Based on the Ensemble Learning Method: AdaBoost

In recent years, with the continuous development of artificial intelligence and brain-computer interface technology, emotion recognition based on physiological signals, especially, electroencephalogram (EEG) signals, has become a popular research topic and attracted wide attention. However, how to extract effective features from EEG signals and accurately recognize them by classifiers have also become an increasingly important task. Therefore, in this paper, we propose an emotion recognition method of EEG signals based on the ensemble learning method, AdaBoost. First, we consider the time domain, time-frequency domain, and nonlinear features related to emotion, extract them from the preprocessed EEG signals, and fuse the features into an eigenvector matrix. Then, the linear discriminant analysis feature selection method is used to reduce the dimensionality of the features. Next, we use the optimized feature sets and train a classifier based on the ensemble learning method, AdaBoost, for binary classification. Finally, the proposed method has been tested in the DEAP data set on four emotional dimensions: valence, arousal, dominance, and liking. The proposed method is proved to be effective in emotion recognition, and the best average accuracy rate can reach up to 88.70% on the dominance dimension. Compared with other existing methods, the performance of the proposed method is significantly improved.