Data Dimensionality Reduction Research Articles

Mcadet: A feature selection method for fine-resolution single-cell RNA-seq data based on multiple correspondence analysis and community detection.

Single-cell RNA sequencing (scRNA-seq) data analysis faces numerous challenges, including high sparsity, a high-dimensional feature space, and biological noise. These challenges hinder downstream analysis, necessitating the use of feature selection methods to identify informative genes, and reduce data dimensionality. However, existing methods for selecting highly variable genes (HVGs) exhibit limited overlap and inconsistent clustering performance across benchmark datasets. Moreover, these methods often struggle to accurately select HVGs from fine-resolution scRNA-seq datasets and minority cell types, which are more difficult to distinguish, raising concerns about the reliability of their results. To overcome these limitations, we propose a novel feature selection framework for scRNA-seq data called Mcadet. Mcadet integrates Multiple Correspondence Analysis (MCA), graph-based community detection, and a novel statistical testing approach. To assess the effectiveness of Mcadet, we conducted extensive evaluations using both simulated and real-world data, employing unbiased metrics for comparison. Our results demonstrate the superior performance of Mcadet in the selection of HVGs in scenarios involving fine-resolution scRNA-seq datasets and datasets containing minority cell populations. Overall, we demonstrate that Mcadet enhances the reliability of selected HVGs, although the impact of HVG selection on various downstream analyses varies and needs to be further investigated.

Automated detection of stale beef from electronic nose data

AbstractAccurate detection of stale beef on the market is important for protecting the legitimate rights and interests of consumers. To this end, we combined electronic nose measurements with machine learning technology to classify beef samples. We used an electronic nose to collect information about the odor characteristics of different beef samples and used linear discriminant analysis to reduce data dimensionality. We then classified samples using the following algorithms: extreme gradient boosting, logistic regression, K‐nearest neighbor, random forest, support vector machine, and neural networks for pattern recognition. We assessed model performance using a 10‐fold cross‐validation technique. All these methods reached an accuracy of 95% or above, with F1 scores and AUC values above 0.96. The support vector machine algorithm outperformed all other models, achieving perfect recognition with 100% accuracy and F1/AUC scores of 1.0. Our study demonstrates that electronic nose data combined with support vector machine can be used to successfully discriminate between stale and fresh beef, paving the way for novel research directions in the detection of stale beef.

New Quadratic Discriminant Analysis Algorithms for Correlated Audiometric Data.

Paired organs like eyes, ears, and lungs in humans exhibit similarities, and data from these organs often display remarkable correlations. Accounting for these correlations could enhance classification models used in predicting disease phenotypes. To our knowledge, there is limited, if any, literature addressing this topic, and existing methods do not exploit such correlations. For example, the conventional approach treats each ear as an independent observation when predicting audiometric phenotypes and is agnostic about the correlation of data from the two ears of the same person. This approach may lead to information loss and reduce the model performance. In response to this gap, particularly in the context of audiometric phenotype prediction, this paper proposes new quadratic discriminant analysis (QDA) algorithms that appropriately deal with the dependence between ears. We propose two-stage analysis strategies: (1) conducting data transformations to reduce data dimensionality before applying QDA; and (2) developing new QDA algorithms to partially utilize the dependence between phenotypes of two ears. We conducted simulation studies to compare different transformation methods and to assess the performance of different QDA algorithms. The empirical results suggested that the transformation may only be beneficial when the sample size is relatively small. Moreover, our proposed new QDA algorithms performed better than the conventional approach in both person-level and ear-level accuracy. As an illustration, we applied them to audiometric data from the Medical University of South Carolina Longitudinal Cohort Study of Age-related Hearing Loss. In addition, we developed an R package, PairQDA, to implement the proposed algorithms.

Tool wear prediction based on K-means and Adaboost auto-encoder

Abstract A new tool wear prediction model is proposed to address the tool wear issue, aimed at monitoring tool wear based on specific task requirements and guiding tool replacement during actual cutting operations. In the data preprocessing phase, tool wear states are classified using unsupervised K-means clustering. The time, frequency, and time-frequency domain features are then labeled and fused using an autoencoder neural network applied to the original set of signal features from the tool. For tool wear prediction, an enhanced autoencoder neural network leveraging AdaBoost is employed to establish the prediction model. The reconstruction error serves as the chosen loss function to assess the autoencoder's performance, taking into account data correlation and the inherent lossy nature of the autoencoder. Experimental results from real machining data obtained from a CNC milling machine demonstrate that the proposed model achieves higher prediction accuracy while reducing data dimensions.

Enhanced Collaborative Filtering: Combining Autoencoder and Opposite User Inference to Solve Sparsity and Gray Sheep Issues

In recent years, the study of recommendation systems has become crucial, capturing the interest of scientists and academics worldwide. Music, books, movies, news, conferences, courses, and learning materials are some examples of using the recommender system. Among the various strategies employed, collaborative filtering stands out as one of the most common and effective approaches. This method identifies similar active users to make item recommendations. However, collaborative filtering has two major challenges: sparsity and gray sheep. Inspired by the remarkable success of deep learning across a multitude of application areas, we have integrated deep learning techniques into our proposed method to effectively address the aforementioned challenges. In this paper, we present a new method called Enriched_AE, focused on autoencoder, a well-regarded unsupervised deep learning technique renowned for its superior ability in data dimensionality reduction, feature extraction, and data reconstruction, with an augmented rating matrix. This matrix not only includes real users but also incorporates virtual users inferred from opposing ratings given by real users. By doing so, we aim to enhance the accuracy of predictions, thus enabling more effective recommendation generation. Through experimental analysis of the MovieLens 100K dataset, we observe that our method achieves notable reductions in both RMSE (Root Mean Squared Error) and MAE (Mean Absolute Error), underscoring its superiority over the state-of-the-art collaborative filtering models.

Enhancing slope stability prediction through integrated PCA-SSA-SVM modeling: a case study of LongLian expressway

China is one of the regions most frequently affected by landslides, which have significant socio-economic impacts. Traditional slope stability analysis methods, such as the limit equilibrium method, limit analysis method, and finite element method, often face limitations due to computational complexity and the need for extensive soil property data. This study proposes a novel approach that combines Principal Component Analysis (PCA), Sparrow Search Algorithm (SSA), and Support Vector Machine (SVM) to improve the accuracy of slope stability prediction. PCA effectively reduces data dimensionality while retaining critical information. SSA optimizes SVM parameters, addressing the limitations of traditional optimization methods. The integrated PCA-SSA-SVM model was applied to a dataset of 257 slope stability samples and validated using five-fold cross-validation to ensure the model’s generalization capability. The results show that the model exhibits superior performance in prediction accuracy, precision, recall, and F1-score, with the test set achieving an accuracy of 84.6%, a recall of 84.7%, a precision of 83.1%, and an F1-score of 84.6%. The model’s robustness was further validated using slope data from the LongLian Expressway, demonstrating high consistency with the actual stability status. These findings indicate that the PCA-SSA-SVM-based slope stability prediction model has significant potential for practical engineering applications, providing a reliable and efficient tool for slope stability forecasting. Classify the training samples through cross-validation, using the accuracy of cross-validation as the fitness of the sparrow individual. Retain the optimal fitness value and position information.

Probabilistic modeling of multivariate extreme non-Gaussian wind loads and its applications in envelope engineering

Probabilistic modeling for non-Gaussian wind load fields under extreme winds is crucial to the quantitative risk and reliability analysis of envelope structures. Based on the multi-point synchronous wind load data during typhoons, a probabilistic model is proposed to characterize multivariate non-Gaussian wind loads to improve the accuracy of the risk analysis considering data dimension reduction. In the proposed model, the Pareto distribution function is utilized to fit the marginal distribution, and the copula function is employed to construct the dependent structure of wind loads from different locations. In the marginal fitted results, the extreme wind load value in the edge region is about 0.10–0.15 higher than those from inner measurement points at quantile p = 95 %. In addition, the variation gradient from the different variable directions is approximately equal, and a sharp variation occurs at the point (0.10, 0.10) for bivariate joint distributions. Engineering applications given in this article are composed of three parts: calculating regional exceeding probability, estimating wind load vector under a specific regional exceeding probability, and determining the location of joint extreme wind loads using the joint gradient value. Finally, risk analysis of existing roof coverings is carried out, the edge corner region is weaker, and two engineering recommendations are given. For determining the regional design wind load, a comprehensive calculation framework considering the temporal dependence of different locations is established, and the reduction rates are in the range (5 %, 25 %).

Remaining useful life prediction method for jointless track circuits based on multivariate feature fusion and nonlinear Wiener process

Abstract Predicting the Remaining Useful Life (RUL) of track circuits is essential to ensure the safe and reliable operation of high-speed railways. In response to the challenges faced by current machine-learning-based RUL prediction methods, which struggle to represent the uncertainty in the probability distribution of RUL predictions, this paper suggests a hybrid-driven method for estimating remaining life. Firstly, the track circuit Health Index (HI) is constructed by feature dimensionality reduction and fusion of the original multivariate monitoring data through Kernel Principal Component Analysis (KPCA) and Autoencoder (AE); Secondly, the degraded state of the rail circuit is modelled using a nonlinear Wiener degradation model. Finally, the principle of First Hitting Time (FHT) is used to derive the Probability Density Function (PDF) of the anticipated RUL. The efficacy and superiority of the approach presented in this paper are validated by experimental research on the track circuit monitoring dataset. The method enhances forecast accuracy and reduces prediction uncertainty, offering robust technical support for track circuit maintenance decision-making.

Automated prediction of phosphorus concentration in soils using reflectance spectroscopy and machine learning algorithms

A method is presented for predicting total phosphorus concentration in soils from Santander de Quilichao, Colombia, using a UV-VIS V-750 Spectrophotometer and machine learning techniques. A total of 152 soil samples, prepared with varying proportions of P2O5 fertilizer and soil, were analyzed, obtaining reflectance spectra in the 200 to 900 nm range with 3501 wavelengths. Additionally, 152 laboratory results of total phosphorus concentration were used to train the prediction model. The spectra were filtered using a Savitzky-Golay filter. Key wavelengths were identified using Variable Importance in Projection - Partial Least Squares (VIP-PLS) and Random Forest (RF), reducing the spectral bands to 1085. Principal Component Analysis (PCA) further reduced data dimensionality. A feedforward artificial neural network was then trained to predict phosphorus concentration. This method is faster than traditional lab tests by leveraging advanced data analysis and machine learning, offering results in less time. While sample preparation remains consistent with standard spectroscopic analysis, the value added by the proposed method lies in its data processing and interpretation. Currently applied to a single soil type, future improvements will include more soil types and other macronutrients, enhancing nutrient management in agriculture. Accurate macronutrient measurements aid in better fertilizer uses planning.• Filtering spectra and determining relevant wavelengths using VIP-PLS and RF.• Dimensionality reduction with PCA.• Training feedforward artificial neural networks.

Dense 3D Point Cloud Environmental Mapping Using Millimeter-Wave Radar

To address the challenges of sparse point clouds in current MIMO millimeter-wave radar environmental mapping, this paper proposes a dense 3D millimeter-wave radar point cloud environmental mapping algorithm. In the preprocessing phase, a radar SLAM-based approach is introduced to construct local submaps, which replaces the direct use of radar point cloud frames. This not only reduces data dimensionality but also enables the proposed method to handle scenarios involving vehicle motion with varying speeds. Building on this, a 3D-RadarHR cross-modal learning network is proposed, which uses LiDAR as the target output to train the radar submaps, thereby generating a dense millimeter-wave radar point cloud map. Experimental results across multiple scenarios, including outdoor environments and underground tunnels, demonstrate that the proposed method can increase the point cloud density of millimeter-wave radar environmental maps by over 50 times, with a point cloud accuracy better than 0.1 m. Compared to existing algorithms, the proposed method achieves superior environmental map reconstruction performance while maintaining a real-time processing rate of 15 Hz.

SVAD: Stacked Variational Autoencoder Deep Neural Network-Based Dimensionality Reduction and Classification of Small Sample Size and High Dimensional Data

SVAD: Stacked Variational Autoencoder Deep Neural Network-Based Dimensionality Reduction and Classification of Small Sample Size and High Dimensional Data

A deep learning method for beat-level risk analysis and interpretation of atrial fibrillation patients during sinus rhythm

Atrial Fibrillation (AF) is a common cardiac arrhythmia. Many AF patients experience complications such as stroke and other cardiovascular issues. Early detection of AF is crucial. The great majority of algorithms can only distinguish “AF rhythm in AF patients” from “sinus rhythm in healthy individuals” . However, AF patients do not always exhibit AF rhythm, most of the time they present with sinus rhythms, and there is also a potential risk of AF in sinus rhythms. How to detect AF from sinus rhythm is a challenge. To address this, this paper proposes a novel artificial intelligence (AI) algorithm to distinguish “sinus rhythm in AF patients” and “sinus rhythm in healthy individuals” in beat-level. We cut 1 s of sinus beats from single-lead Electrocardiogram (ECG) data and fed them to the Net1d model, a deep learning model that processes one-dimensional data, to obtain the risk probability of each beat. Besides, we have also introduced the beat-level risk interpreters, trend risk interpreters, addressing the interpretability issues of deep learning models and the difficulty in explaining AF risk trends. Additionally, the beat-level information fusion decision is presented to enhance model accuracy. The experimental results demonstrate that the average AUC for single beats used as testing data from CPSC 2021 dataset is 0.7314, with an average accuracy of 0.6606 and an F1 score of 0.6470. By employing 150 beats for information fusion decision algorithm, the average AUC can reach 0.7591, while the average accuracy and F1 score improve to 0.6887 and 0.6749. Compared to previous segment-level algorithms, we utilized beats as input, reducing data dimensionality and making the model more lightweight, facilitating deployment on portable medical devices. Furthermore, we draw new and interesting findings through average beat analysis and subgroup analysis, considering varying risk levels. Our code is publicly available at https://github.com/leijsen/ECGBeat4AFSinus.

Comparison of interfacial injected energy between simulated lightning return stroke experiment and common Joule heat & Arc heat model application

A previous study has shown that the thermal damage of the Joule thermal arc heat transfer model is lighter than that of a natural lightning strike. Therefore, this paper focuses on the return stroke current and proposes an improved experimental method of simulated return damage without using arc-inducing wire. Combining the data with the inversion model of injected energy, the energy transfer characteristics of the samples are characterized. Furthermore, a data dimensionality reduction method based on multiple correlation coefficients is used to discuss the impact of the current peak/rise rate/wave tail time on the injected energy discrepancy. The results indicate a positive correlation between the current peak and current rise rate with the injected energy discrepancy. When the tail time exceeds 15 microseconds, the injected energy discrepancy decreases as the tail time increases. The thermal source characteristics of energy transfer during the return stroke process are determined. During the initial phase of the return stroke current, interfacial energy transfer includes contributions from ion enthalpy flux, Joule heating, and electronic enthalpy flux. When the tail time exceeds 15 microseconds, the contribution of ion enthalpy flux to the injected energy diminishes with increasing tail time.

A Comparative Study of Metaheuristic Feature Selection Algorithms for Respiratory Disease Classification.

The correct diagnosis and early treatment of respiratory diseases can significantly improve the health status of patients, reduce healthcare expenses, and enhance quality of life. Therefore, there has been extensive interest in developing automatic respiratory disease detection systems. Most recent methods for detecting respiratory disease use machine and deep learning algorithms. The success of these machine learning methods depends heavily on the selection of proper features to be used in the classifier. Although metaheuristic-based feature selection methods have been successful in addressing difficulties presented by high-dimensional medical data in various biomedical classification tasks, there is not much research on the utilization of metaheuristic methods in respiratory disease classification. This paper aims to conduct a detailed and comparative analysis of six widely used metaheuristic optimization methods using eight different transfer functions in respiratory disease classification. For this purpose, two different classification cases were examined: binary and multi-class. The findings demonstrate that metaheuristic algorithms using correct transfer functions could effectively reduce data dimensionality while enhancing classification accuracy.

An unsupervised approach for the detection of zero‐day distributed denial of service attacks in Internet of Things networks

AbstractThe authors introduce an unsupervised Intrusion Detection System designed to detect zero‐day distributed denial of service (DDoS) attacks in Internet of Things (IoT) networks. This system can identify anomalies without needing prior knowledge or training on attack information. Zero‐day attacks exploit previously unknown vulnerabilities, making them hard to detect with traditional deep learning and machine learning systems that require pre‐labelled data. Labelling data is also a time‐consuming task for security experts. Therefore, unsupervised methods are necessary to detect these new threats. The authors focus on DDoS attacks, which have recently caused significant financial and service disruptions for many organisations. As IoT networks grow, these attacks become more sophisticated and harmful. The proposed approach detects zero‐day DDoS attacks by using random projection to reduce data dimensionality and an ensemble model combining K‐means, Gaussian mixture model, and one‐class SVM with a hard voting technique for classification. The method was evaluated using the CIC‐DDoS2019 dataset and achieved an accuracy of 94.55%, outperforming other state‐of‐the‐art unsupervised learning methods.

Analyzing the Influence of Telematics-Based Pricing Strategies on Traditional Rating Factors in Auto Insurance Rate Regulation

This study examines how telematics variables such as annual percentage driven, total miles driven, and driving patterns influence the distributional behaviour of conventional rating factors when incorporated into predictive models for capturing auto insurance risk in rate regulation. To effectively manage the complexity inherent in telematics data, we advocate for the adoption of non-negative sparse principal component analysis (NSPCA) as a structured approach for data dimensionality reduction. By emphasizing sparsity and non-negativity constraints, NSPCA enhances the interpretability and predictive power of models concerning both loss severity and claim counts. This methodological innovation aims to advance statistical analyses within insurance pricing frameworks, ensuring the robustness of predictive models and providing insights crucial for rate regulation strategies specific to the auto insurance sector. Results show that, to enhance auto insurance risk pricing models, it is essential to address data dimension reduction challenges when integrating telematics data variables. Our findings underscore that integrating telematics variables into predictive models maintains the integrity of risk relativity estimates associated with traditional policy variables.

Latent space representation of electronic health records for clustering dialysis-associated kidney failure subtypes

ObjectiveKidney failure manifests in various forms, from sudden occurrences such as Acute Kidney Injury (AKI) to progressive like Chronic Kidney Disease (CKD). Given its intricate nature, marked by overlapping comorbidities and clinical similarities—including treatment modalities like dialysis—we sought to design and validate an end-to-end framework for clustering kidney failure subtypes. Materials and methodsOur emphasis was on dialysis, utilizing a comprehensive dataset from the UK Biobank (UKB). We transformed raw Electronic Health Record (EHR) data into standardized matrices that incorporate patient demographics, clinical visit data, and the innovative feature of visit time-gaps. This matrix structure was achieved using a unique data cutting method. Latent space transformation was facilitated using a convolution autoencoder (ConvAE) model, which was then subjected to clustering using Principal Component Analysis (PCA) and K-means algorithms. ResultsOur transformation model effectively reduced data dimensionality, thereby accelerating computational processes. The derived latent space demonstrated remarkable clustering capacities. Through cluster analysis, two distinct groups were identified: CKD-majority (cluster 1) and a mixed group of non-CKD and some CKD subtypes (cluster 0). Cluster 1 exhibited notably low survival probability, suggesting it predominantly represented severe CKD. In contrast, cluster 0, with substantially higher survival probability, likely to include milder CKD forms and severe AKI. Our end-to-end framework effectively differentiates kidney failure subtypes using the UKB dataset, offering potential for nuanced therapeutic interventions. ConclusionsThis innovative approach integrates diverse data sources, providing a holistic understanding of kidney failure, which is imperative for patient management and targeted therapeutic interventions.

Host effects on luminescent properties of Er, Yb doped nanophosphors: visual comparison by data dimensionality reduction technique

Host effects on luminescent properties of Er, Yb doped nanophosphors: visual comparison by data dimensionality reduction technique

Industrial Process Fault Detection Based on IGA‐Combinatorial Model Decision Mechanism

ABSTRACTTo address the challenges of extracting features from complex industrial process data, the reliance of numerous fault detection methodologies on presupposed data distribution types, and the limited generalization capacity of fault detection, this manuscript introduces a sophisticated algorithm for industrial process fault detection. This algorithm harnesses the information gain adaptive (IGA) technique for feature selection and a synergistic model decision mechanism. Initially, the process involves the computation of information gain via decision trees, coupled with the determination of the value through cross‐validation. This strategy enables the adaptive selection of features, thereby facilitating data dimensionality reduction and effective feature extraction. The subsequent phase introduces a ternary statistical measure monitoring group for the detection of linear faults, while autoencoders and one‐class SVM methodologies are applied for the monitoring of nonlinear faults. The culmination of this approach is the development of an innovative weighted decision mechanism, designed to amalgamate the findings from both linear and nonlinear detection avenues, yielding more dependable detection results. The validation of this algorithm employs datasets from the water chillers process and Tennessee Eastman (TE) process, demonstrating the IGA‐combined model's superior performance over isolated linear or nonlinear detection algorithms in terms of detection accuracy and robustness. Notably, the efficacy of this method is not contingent upon specific assumptions regarding data distribution, rendering it a versatile and efficacious tool for the fault detection in industrial processes.

Enhanced intrusion detection framework for securing IoT network using principal component analysis and CNN

ABSTRACT The Internet of Things (IoT) has transformed our world by connecting smart devices and enabling seamless interactions. This reliance, however, has led to new security issues and types of attacks. It is of the utmost importance to safeguard the security of IoT networks, with network intrusion detection systems (NIDS) having a significant impact. This paper proposes a novel approach integrating Principal Component Analysis (PCA), Pearson Correlation Coefficient (PCC), and Convolutional Neural Network (CNN) to overcome these security issues. Our innovative method reduces data dimensionality and selects highly correlated features using PCC and PCA, addressing overfitting and improving model performance while maintaining high computational speed and low costs. Our approach uniquely distinguishes between benign and threat packets by employing 1D-CNN, 2D-CNN, and 3D-CNN algorithms trained on Edge-IIoTset and NSL-KDD benchmark datasets. The findings from our experiments indicate that the proposed framework significantly enhances accuracy, precision, recall, and F1-score compared to existing models for both binary and multiclass classifications. Our binary classification models achieved exceptional performance, with an average accuracy of 99.76%, 99.79% precision, 99.89% recall, and 99.85% F1-score on the Edge-IIoTset dataset. On the NSL-KDD dataset, the models attained 99.20% accuracy, 98.07% precision, 97.95% recall, and 97.71% F1-score. For multiclass classification, the proposed model demonstrated an average accuracy of 99.41%, precision of 98.61%, recall of 98.49%, and an F1-score of 98.56% on the Edge-IIoTset dataset. On the NSL-KDD dataset, the model achieved 92.43% accuracy, 93.21% precision, 93.60% recall, and a 93.7% F1-score. Our research introduces a significant advancement that substantially improves NIDS capabilities, making IoT networks safer and more connected.