Neighborhood Component Analysis Research Articles

FLP: Factor lattice pattern-based automated detection of Parkinson's disease and specific language impairment using recorded speech

BackgroundTimely detection of neurodevelopmental and neurological conditions is crucial for early intervention. Specific Language Impairment (SLI) in children and Parkinson's disease (PD) manifests in speech disturbances that may be exploited for diagnostic screening using recorded speech signals. We were motivated to develop an accurate yet computationally lightweight model for speech-based detection of SLI and PD, employing novel feature engineering techniques to mimic the adaptable dynamic weight assignment network capability of deep learning architectures. Materials and methodsIn this research, we have introduced an advanced feature engineering model incorporating a novel feature extraction function, the Factor Lattice Pattern (FLP), which is a quantum-inspired method and uses a superposition-like mechanism, making it dynamic in nature. The FLP encompasses eight distinct patterns, from which the most appropriate pattern was discerned based on the data structure. Through the implementation of the FLP, we automatically extracted signal-specific textural features. Additionally, we developed a new feature engineering model to assess the efficacy of the FLP. This model is self-organizing, producing nine potential results and subsequently choosing the optimal one. Our speech classification framework consists of (1) feature extraction using the proposed FLP and a statistical feature extractor; (2) feature selection employing iterative neighborhood component analysis and an intersection-based feature selector; (3) classification via support vector machine and k-nearest neighbors; and (4) outcome determination using combinational majority voting to select the most favorable results. ResultsTo validate the classification capabilities of our proposed feature engineering model, designed to automatically detect PD and SLI, we employed three speech datasets of PD and SLI patients. Our presented FLP-centric model achieved classification accuracy of more than 95% and 99.79% for all PD and SLI datasets, respectively. ConclusionsOur results indicate that the proposed model is an accurate alternative to deep learning models in classifying neurological conditions using speech signals.

Enhancing lane changing trajectory prediction on highways: A heuristic attention-based encoder-decoder model

Accurate prediction of lane changing (LC) trajectories plays a vital role in ensuring safe and efficient traffic flow on highways. This paper proposes a LC trajectory prediction model based on encoder-decoder architecture to address low long-term prediction accuracy problem and to gain insight into the underlying motivations of LC behavior. Three specific enhancements were proposed to improve the performance of encoder-decoder. The first enhancement involves the utilization of Neighborhood Component Analysis (NCA) to identify the most relevant input features from driving environment. The second enhancement involves the introduction of heuristic attention to capture intricate time-dependent and environment-dependent patterns of input data. Finally, a trajectory check module was proposed to supervise and adjust the prediction outputs based on vehicle dynamics constraints. The proposed model was trained and evaluated using the HighD dataset. Experimental results demonstrated that the proposed model outperforms improved encoder-decoder architectures designed by previous studies in terms of prediction accuracy in long-term prediction, which the lateral and longitude MAE were 0.041 m and 1.842 m in 5 s prediction duration, respectively. Additionally, it was observed that preceding vehicles in the current and target lane, and following vehicle in the target lane, exert a significantly influential effect on LC maneuvers, which represents the underlying motivations behind LC behavior. The findings of this study contribute to the advancement of intelligent transportation systems (ITS) and autonomous vehicles (AVs) by providing an effective LC trajectory prediction.

Projector deep feature extraction-based garbage image classification model using underwater images

Marine and ocean pollution is one of the most serious environmental problems in the world. Marine plastics pose a significant threat to the marine ecosystem due to their negative effects. After passing through various processes, plastic waste accumulates on the seafloor and fragments into very small pieces known as microplastics. These microplastics are to blame for the extinction and death of aquatic life. This study obtained a hybrid underwater dataset containing 13,089 images, sized 300 × 300, including garbage and sea animals. In the proposed method, this dataset is used to develop our example projector deep feature generator. In this study, using the Resnet101 network in a sample projector build, the feature generator creates 6,000 features. Using NCA (Neighborhood Component Analysis), the best 1000 features from a pool of 6,000 are selected. The kNN (k-nearest neighbor) algorithm is then used to classify the resulting feature vectors. As validation techniques, both tenfold cross-validations were used. The hybrid dataset's best accuracy was calculated to be 99.35%. Our recommendation is successful based on the comparisons and calculated performance measures.

Feature extraction of small underwater sonar targets using neighborhood discriminant analysis

Linear discriminant analysis (LDA) stands as a widely used supervised feature extraction technique that maps data onto a low-dimensional subspace such that the between-class scatter is maximized while within-class scatter is minimized. Despite its utility, LDA faces many challenges, particularly when the within-class scatter matrix becomes singular due to small sample size. Other dimensionality reduction techniques, such as Neighbourhood Component Analysis (NCA), have been proposed as alternatives to LDA. NCA learns a linear transformation that maximizes the likelihood that datapoints of the same class are clustered together in the lower-dimensional space. However, the optimization of NCA relies on a non-convex cost function, making it prone to local minima. To address the challenges faced by both LDA and NCA, we propose a novel dimensionality reduction method named neighborhood discriminant analysis (NDA). Like NCA, NDA learns a linear transformation that aims to cluster datapoints based on class label. However, NDA is framed as an eigendecomposition problem, eliminating the need for non-convex optimization. We demonstrate the new approach on real small target sonar data. [Work funded by the ONR grant numbers N000142112420 and N000142312503, and DoD Navy (NEEC) Grant No. N001742010016.]

Automatic detection of knee osteoarthritis grading using artificial intelligence‐based methods

AbstractOsteoarthritis (OA) means that the slippery cartilage tissue that covers the bone surfaces in the joints and allows the joint to move easily loses its properties and wears out. Knee OA is the wear and tear of the cartilage in the knee joint. Knee OA is a disease whose incidence increases especially after a certain age. Knee OA is difficult and costly to be detected by specialists using traditional methods and may lead to misdiagnosis. In this study, computer‐aided systems were used to prevent errors in traditional methods of detecting knee OA, shorten the diagnosis time, and accelerate the treatment process. In this study, a hybrid model was developed by using Darknet53, Histogram of Directional Gradients (HOG), Local Binary Model (LBP) methods for feature extraction, and Neighborhood Component Analysis (NCA) for feature selection. Our dataset used in experiments contains 1650 knee joint images and consists of five classes: Normal, Doubtful, Mild, Moderate, and Severe. In the experimental studies performed, the performance of the proposed method was compared with eight different Convolutional Neural Networks (CNN) Models. The developed model achieved better performance metrics than the eight different models used in the study and similar studies in the literature. The accuracy value of the developed model is 83.6%.

Black-white hole pattern: an investigation on the automated chronic neuropathic pain detection using EEG signals

AbstractElectroencephalography (EEG) signals provide information about the brain activities, this study bridges neuroscience and machine learning by introducing an astronomy-inspired feature extraction model. In this work, we developed a novel feature extraction function, black-white hole pattern (BWHPat) which dynamically selects the most suitable pattern from 14 options. We developed BWHPat in a four-phase feature engineering model, involving multileveled feature extraction, feature selection, classification, and cortex map generation. Textural and statistical features are extracted in the first phase, while tunable q-factor wavelet transform (TQWT) aids in multileveled feature extraction. The second phase employs iterative neighborhood component analysis (INCA) for feature selection, and the k-nearest neighbors (kNN) classifier is applied for classification, yielding channel-specific results. A new cortex map generation model highlights the most active channels using median and intersection functions. Our BWHPat-driven model consistently achieved over 99% classification accuracy across three scenarios using the publicly available EEG pain dataset. Furthermore, a semantic cortex map precisely identifies pain-affected brain regions. This study signifies the contribution to EEG signal classification and neuroscience. The BWHPat pattern establishes a unique link between astronomy and feature extraction, enhancing the understanding of brain activities.

MNPDenseNet: Automated Monkeypox Detection Using Multiple Nested Patch Division and Pretrained DenseNet201

BackgroundMonkeypox is a viral disease caused by the monkeypox virus (MPV). A surge in monkeypox infection has been reported since early May 2022, and the outbreak has been classified as a global health emergency as the situation continues to worsen. Early and accurate detection of the disease is required to control its spread. Machine learning methods offer fast and accurate detection of COVID-19 from chest X-rays, and chest computed tomography (CT) images. Likewise, computer vision techniques can automatically detect monkeypoxes from digital images, videos, and other inputs.ObjectivesIn this paper, we propose an automated monkeypox detection model as the first step toward controlling its global spread.Materials and methodA new dataset comprising 910 open-source images classified into five categories (healthy, monkeypox, chickenpox, smallpox, and zoster zona) was created. A new deep feature engineering architecture was proposed, which contained the following components: (i) multiple nested patch division, (ii) deep feature extraction, (iii) multiple feature selection by deploying neighborhood component analysis (NCA), Chi2, and ReliefF selectors, (iv) classification using SVM with 10-fold cross-validation, (v) voted results generation by deploying iterative hard majority voting (IHMV) and (vi) selection of the best vector by a greedy algorithm.ResultsOur proposal attained a 91.87% classification accuracy on the collected dataset. This is the best result of our presented framework, which was automatically selected from 70 generated results.ConclusionsThe computed classification results and findings demonstrated that monkeypox could be successfully detected using our proposed automated model.

Use of psychoacoustic spectrum warping, decision template fusion, and neighborhood component analysis in newborn cry diagnostic systems.

Dealing with newborns' health is a delicate matter since they cannot express needs, and crying does not reflect their condition. Although newborn cries have been studied for various purposes, there is no prior research on distinguishing a certain pathology from other pathologies so far. Here, an unsophisticated framework is proposed for the study of septic newborns amid a collective of other pathologies. The cry was analyzed with music inspired and speech processing inspired features. Furthermore, neighborhood component analysis (NCA) feature selection was employed with two goals: (i) Exploring how the elements of each feature set contributed to classification outcome; (ii) investigating to what extent the feature space could be compacted. The attained results showed success of both experiments introduced in this study, with 88.66% for the decision template fusion (DTF) technique and a consistent enhancement in comparison to all feature sets in terms of accuracy and 86.22% for the NCA feature selection method by drastically downsizing the feature space from 86 elements to only 6 elements. The achieved results showed great potential for identifying a certain pathology from other pathologies that may have similar effects on the cry patterns as well as proving the success of the proposed framework.

Can You Understand Why I Am Crying? A Decision-making System for Classifying Infants’ Cry Languages Based on DeepSVM Model

Scientific and therapeutic advances in perinatology and neonatology have improved the survival prospects of preterm and extremely-low-birth-weight infants. Infants’ cries are a valuable noninvasive tool for monitoring their neurologic health, especially if they are premature. Automatic acoustic analysis and data mining are employed in this study to determine the discriminative features of preterm and full-term infant cries. The use of machine learning for recognizing sounds in a newborn's cry language has received less attention than previous methods for analyzing the sounds. Moreover, to extract appropriate features from infant cries, adequate knowledge and appropriate signal descriptors are required. Accordingly, to analyze infant cry language, we propose an approach that uses fractal descriptors to extract discriminant features from spectrograms of windowed signals, followed by iterative neighborhood component analysis (iNCA) to select appropriate features. Additionally, the improved deep support vector machine (DeepSVM) is used to classify the infants’ crying types and their meanings. The proposed method is verified using a newborn sound dataset. According to the classification of five types of crying perception based on various characteristics, 98.34% of all crying perceptions have been recognized. Although there are many classes examined, the feature extraction method based on the fractal method and our optimal classification have a much higher diagnostic accuracy compared with similar methods for analyzing baby crying language. The proposed method can overcome many problems associated with analyzing babies’ crying sounds and understanding their language, such as uncertainty and unusual errors in classification.

Developing a robust two-step machine learning multiclassification pipeline to predict primary site in head and neck carcinoma from lymph nodes

This study aimed to develop a robust multiclassification pipeline to determine the primary tumor location in patients with head and neck carcinoma of unknown primary using radiomics and machine learning techniques. The dataset included 400 head and neck cancer patients with primary tumor in oropharynx, OPC (n = 162), nasopharynx, NPC (n = 137), oral cavity, OC (n = 63), larynx and hypopharynx, HL (n = 38). Two radiomic-based multiclassification pipelines (P1 and P2) were developed. P1 consisted in a direct identification of the primary sites, whereas P2 was based on a two-step approach: in the first step, the number of classes was reduced by merging the two minority classes which were reclassified in the second step. Diverse correlation thresholds (0.75, 0.80, 0.85), feature selection methods (sequential forwards/backwards selection, sequential floating forward selection, neighborhood component analysis and minimum redundancy maximum relevance), and classification models (neural network, decision tree, naïve Bayes, bagged trees and support vector machine) were assessed. P2 outperformed P1, with the best results obtained with the support vector machine classifier including radiomic and clinical features (accuracies of 75.3 % (HL), 75.4 % (OC), 71.3 % (OPC), 92.9 % (NPC)). These results indicate that the two-step multiclassification pipeline integrating radiomics and clinical information is a promising approach to predict the tumor site of unknown primary.

A Hybrid Model of Fuzzy Logic to Enhance Data Mining Accuracy Incorporating Intra-Concentration and Inter-Separability (I2CS) Loss into Neighborhood Component Analysis

A Hybrid Model of Fuzzy Logic to Enhance Data Mining Accuracy Incorporating Intra-Concentration and Inter-Separability (I2CS) Loss into Neighborhood Component Analysis

Research on energy redistribution of hybrid vehicle considering thermal constraints

Thermal management is one of the key factors affecting the performance of hybrid vehicles. However, most traditional energy management strategies lack the consideration of thermal constraints under harsh operating conditions. In this paper, taking a specific type of diesel-electric hybrid system as the research object, a strategy for energy redistribution under thermal management constraints is proposed. The diesel-electric hybrid system model is built and verified. Based on the model, the cooling capacity indexes are selected, and the weight coefficient of each cooling capacity index is determined by neighborhood component analysis. Then a comprehensive thermal evaluation system is obtained. Combined with the thermal evaluation system, the energy redistribution strategy based on the momentum gradient descent method is proposed. Two typical working conditions of high altitude and battery cooling system deterioration are selected, and the energy redistribution strategy is simulated and analyzed in real-time under both working conditions. The results show that the energy redistribution strategy can significantly improve the thermal state of the system at the expense of less overall energy consumption, take into account the economy and thermal balance, and ensure the reliable operation of the vehicle.

A Generalized Multi-Stage Deep Machine Learning Framework for Tool Wear Level Prediction in Milling Operations

This work proposes a tool condition monitoring system based on a generalized multi-stage deep machine learning framework for real-time measurement of flank wear in milling processes. At low computational cost, a deep wavelet scattering convolution neural network framework was developed and optimized to generate low-variant features. Discriminative features were automatically selected using a neighborhood component analysis. A gaussian process regression (GPR) model was developed for feature fusion and tool wear measurement. The model was benchmarked against different machine learning algorithms. Extensive experimental validation tests demonstrated the GPR model superiority under various cutting conditions, which facilitates its implementation in industrial facilities.

Optimal Activity Recognition Framework Based on Improvement of Regularized Neighborhood Component Analysis (RNCA)

Optimal Activity Recognition Framework Based on Improvement of Regularized Neighborhood Component Analysis (RNCA)

A no-reference image quality assessment model based on neighborhood component analysis and Gaussian process

In this paper, a human visual system (HVS) based no-reference image quality assessment model (NR-IQA) is proposed. This is an objective NR-IQA model that uses perceptual features such as structure and orientation to compute the loss of naturalness in the image. An adaptive feature extraction process is modeled to capture the underlying significant features of the images along with the noise. Moreover, the optimal subset of features is derived using the neighborhood component analysis and further used as inputs to the Gaussian process for regression. The various experimentations are carried out on LIVE, TID2008, and TID2013 databases to test the effectiveness of the proposed approach. It is observed that the presented model exhibits a competitive performance in comparison with the existing IQA approaches. Moreover, the computation complexity and run-time show the effectuality of the proposed approach. Further, the experiments show that the predicted score matches with human perceptions. Thus, the proposed model is more accurate, less complex, independent of distortions, and well-suited for real-time applications.

Driving fatigue detection based on brain source activity and ARMA model.

Fatigue among drivers is a significant issue in society, and according to organizational reports, it substantially contributes to accidents. So accurate fatigue detection in drivers plays a crucial role in reducing the number of people fatalities or injured resulting from accidents. Several methods are proposed for fatigue driver recognition among which electroencephalography (EEG) is one. This paper proposed a method for fatigue recognition by EEG signals with extracted features from source and sensor spaces. The proposed method starts with preprocessing by applying filtering and artifact rejection. Then source localization methods are applied to EEG signals for active source extraction. A multivariate autoregressive (MVAR) model is fitted to selected sources, and a dual Kalman filter is applied to estimate the source activity and their relationships. Then multivariate autoregressive moving average (ARMA) is fitted between EEG and source activity signals. Features are extracted from model parameters, source relationship matrix, and wavelet transform of EEG and source activity signals. The novelty of this approach is the use of ARMA model between source activities (as input) and EEG signals (as output) and feature extraction from source relations. Relevant features are selected using a combination of RelifF and neighborhood component analysis (NCA) methods. Three classifiers, namely k-nearest neighbor (KNN), support vector machine (SVM), and naive Bayesian (NB) classifiers, are employed to classify drivers. To improve performance, the final label for fatigue detection is calculated by combining these classifiers using the voting method. The results demonstrate that the proposed method accurately recognizes and classifies fatigued drivers with the ensemble classifiers in comparison with other methods.

Novel tiny textural motif pattern-based RNA virus protein sequence classification model

BackgroundRNA viruses, including severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2), are important human pathogens. Sequencing of the proteins produced by RNA viruses is essential for understanding disease pathogenesis and may have diagnostic and therapeutic implications. We aimed to develop an accurate and computationally efficient handcrafted feature engineering model for classifying the protein sequences of six pathogenic RNA viruses: SARS-CoV-2, influenza A, influenza B, influenza C, human respirovirus 3, and human immunodeficiency virus (HIV)-1. The first five cause primary respiratory infections; the last has some functional similarity with SARS-CoV-2, justifying the need for diagnostic differentiation. Materials and methodWe downloaded 14,787 protein sequences belonging to the six categories in FASTA format from the open-source National Center for Biotechnology Information database and transformed the sequences into numeric arrays. First, the signal was divided into overlapping blocks representing three amino acids. Tiny textural motif pattern, a new histogram-based feature extractor, was then applied to extract textural features using simple signum, lower, and upper ternary functions. 512 features were extracted for each protein sequence and fed to an iterative neighborhood component analysis function to select a study dataset-specific optimal number (34) of the most discriminative features for downstream classification using a shallow k-nearest neighbor classifier with 10-fold cross-validation.Novelties: An efficient linear time complexity is introduced for data classification, providing a robust classification approach, especially for complex datasets. Notably, this approach extends beyond the traditional binary classification focus, successfully distinguishing up to six distinct classes. Furthermore, a novel handcrafted feature extraction method is developed, significantly enhancing data analysis and yielding more precise results. ResultsThe model attained 99.71% overall 6-class classification accuracy in a data subset and 99.85% for binary classification of SARS-CoV-2 vs. HIV-1, outperforming a similar published model. ConclusionsOur simple model accurately classified the protein sequences of six pathogenic RNA viruses and can potentially be implemented in diagnostic applications to improve RNA virus disease screening.

Data-driven based fracture prediction of notched components.

A data-driven approach is developed to predict the fracture load of a notched component. To do so, more than 1500 fracture tests (507 unique experimental data points) on mixed-mode I/II loading of notched brittle samples were collected from the literature. After pre-processing the raw data, six features of maximum tangential stress [Formula: see text], maximum tangential stress angle [Formula: see text], ultimate tensile strength [Formula: see text], fracture toughness [Formula: see text], notch opening angle [Formula: see text] and notch tip radius [Formula: see text] were selected by using the neighbourhood component analysis (NCA) technique. To predict the fracture load of various types of notched samples, several machine learning (ML) models were trained using the methods of Gaussian process regression (GPR), decision tree ensemble and artificial neural network (ANN). Then, the Bayesian optimization algorithm was applied to find the optimum hyperparameters for each model. Lastly, the performance of the models in predicting fracture load was evaluated against 124 unseen data points. The results revealed the high potential of data-driven methods for assessing the fracture load of notched brittle components with acceptable precisions of 92%, 89% and 88% accuracy, respectively, for GPR, decision tree ensemble and ANN models. The superior performance of the GPR method can be attributed to its ability to capture complex nonlinear relationships in the data while providing reliable uncertainty estimates. Furthermore, thanks to its interpolation capabilities, GPR is able to seamlessly fill the gaps between data points, resulting in more comprehensive and precise predictions across the entire range of input data. Additionally, the presented models were capable of predicting the fracture load of VO-shaped notched samples with acceptable accuracy, though this type of notch was not used in the model training process. This article is part of the theme issue 'Physics-informed machine learning and its structural integrity applications (Part 2)'.

Remaining electrical life prediction of AC contactor based on CAE-BiGRU-Attention

To tackle the challenges of low prediction accuracy caused by single-feature modeling, and the hidden state of the neural network easily loses some information of the long time series, a method for predicting the remaining electrical life of AC contactor using a convolutional autoencoder-bidirectional gated recurrent unit-attention (CAE-BiGRU-Attention) was proposed in this work. Firstly, the feature parameters were extracted from the AC contactor full-life test, and an optimal feature subset was selected using neighborhood component analysis and Spearman rank correlation coefficient to characterize the degradation state of electrical life effectively. Then, the deep information of the optimal feature subset was extracted using CAE. Finally, the remaining electrical life of the AC contactor was treated as a long time series problem and predicted in time series by BiGRU-Attention accurately. The case analysis demonstrates that the model has better prediction accuracy than recurrent neural network (RNN), long short-term memory (LSTM), GRU, BiGRU and CAE-BiGRU models, with an average effective accuracy of 97.12%. This effectively demonstrates the model’s feasibility to accurately predict temporal sequences in the remaining electrical life prediction of electrical equipment.

A Pyramid Deep Feature Extraction Model for the Automatic Classification of Upper Extremity Fractures.

The musculoskeletal system plays a crucial role in our daily lives, and the accurate diagnosis of musculoskeletal issues is essential for providing effective healthcare. However, the classification of musculoskeletal system radiographs is a complex task, requiring both accuracy and efficiency. This study addresses this challenge by introducing and evaluating a pyramid deep feature extraction model for the automatic classification of musculoskeletal system radiographs. The primary goal of this research is to develop a reliable and efficient solution to classify different upper extremity regions in musculoskeletal radiographs. To achieve this goal, we conducted an end-to-end training process using a pre-trained EfficientNet B0 convolutional neural network (CNN) model. This model was trained on a dataset of radiographic images that were divided into patches of various sizes, including 224 × 224, 112 × 112, 56 × 56, and 28 × 28. From the trained CNN model, we extracted a total of 85,000 features. These features were subsequently subjected to selection using the neighborhood component analysis (NCA) feature selection algorithm and then classified using a support vector machine (SVM). The results of our experiments are highly promising. The proposed model successfully classified various upper extremity regions with high accuracy rates: 92.04% for the elbow region, 91.19% for the finger region, 92.11% for the forearm region, 91.34% for the hand region, 91.35% for the humerus region, 89.49% for the shoulder region, and 92.63% for the wrist region. These results demonstrate the effectiveness of our deep feature extraction model as a potential auxiliary tool in the automatic analysis of musculoskeletal system radiographs. By automating the classification of musculoskeletal radiographs, our model has the potential to significantly accelerate clinical diagnostic processes and provide more precise results. This advancement in medical imaging technology can ultimately lead to better healthcare services for patients. However, future studies are crucial to further refine and test the model for practical clinical applications, ensuring that it integrates seamlessly into medical diagnosis and treatment processes, thus improving the overall quality of healthcare services.