Effective Dimension Reduction Research Articles

Multimodal Operation Data Mining for Grid Operation Violation Risk Prediction

With the continuous expansion of the power grid, the issue of operational safety has attracted increasing attention. In power grid operation control, unauthorized operations are one of the primary causes of personal accidents. Therefore, preventing and monitoring unauthorized actions by power grid operators is of critical importance. First, multimodal violation data are integrated through information systems, such as the power grid management platform, to construct a historical case database. Next, word vectors for three types of operation-related factors are generated using natural language processing techniques, and key vectors are selected based on generalized correlation coefficients using mutual information, enabling effective dimensionality reduction. Independent component analysis is then employed for feature extraction and further dimensionality reduction, allowing for the effective characterization of operational scenarios. For each historical case, a risk score is derived from a violation risk prediction model constructed using the Random Forests (RF) algorithm. When a high-risk score is identified, the K-Nearest Neighbor (KNN) algorithm is applied to locate similar scenarios in the historical case database where violations may have occurred. Real-time violation risk assessment is performed for each operation, providing early warnings to operators, thereby reducing the likelihood of violations, and enhancing the safety of power grid operations.

Partial Quantile Tensor Regression

Tensors, characterized as multidimensional arrays, are frequently encountered in modern scientific studies. Quantile regression has the unique capacity to explore how a tensor covariate influences different segments of the response distribution. In this work, we propose a partial quantile tensor regression (PQTR) framework, which novelly applies the core principle of the partial least squares technique to achieve effective dimension reduction for quantile regression with a tensor covariate. The proposed PQTR algorithm is computationally efficient and scalable to a large tensor covariate. Moreover, we uncover an appealing latent variable model representation for the PQTR algorithm, justifying a simple population interpretation of the resulting estimator. We further investigate the connection of the PQTR procedure with an envelope quantile tensor regression (EQTR) model, which defines a general set of sparsity conditions tailored to quantile tensor regression. We prove the root-n consistency of the PQTR estimator under the EQTR model, and demonstrate its superior finite-sample performance compared to benchmark methods through simulation studies. We demonstrate the practical utility of the proposed method via an application to a neuroimaging study of post traumatic stress disorder (PTSD). Results derived from the proposed method are more neurobiologically meaningful and interpretable as compared to those from existing methods.

Retraction Note: Effective dimensionality reduction by using soft computing method in data mining techniques

Retraction Note: Effective dimensionality reduction by using soft computing method in data mining techniques

A hybrid novel SWARA-ELECTRE-I method using probabilistic uncertain linguistic information for feature selection in image recognition

In the digital age, the exponential growth of data poses significant challenges for analysts and machine learning algorithms in pattern detection due to its high dimensionality. This study addresses the dimensionality problem by leveraging Probabilistic Uncertain Linguistic Term Set (PULTS), which combine Uncertain Linguistic Term Set (ULTS) with associated probabilities to handle uncertainty in decision-making. We introduce the PUL-weighted average operator to integrate the opinions of multiple decision-makers and propose a novel ELimination and Choice Translating REality (ELECTRE-I) method for optimizing alternatives in multiple attribute group decision-making (MAGDM) scenarios. This method is enhanced by the Stepwise Weight Assessment Ratio Analysis (SWARA) method to determine the relative weight of each attribute. By integrating SWARA with the ELECTRE-I method, we develop a comprehensive approach to tackle MAGDM problems using PULTS. A numerical example involving feature selection in image recognition demonstrates the method’s effectiveness and accuracy. Comparative studies highlight the advantages of our approach in producing a small feature set with high classification accuracy. The proposed method offers a robust solution for feature selection in image recognition and other MAGDM problems, significantly improving decision-making accuracy and efficiency. The methodology’s simplicity and computational ease make it applicable across various domains requiring effective dimensionality reduction.

A hybrid method for fault diagnosis of rolling bearings

Abstract Traditional diagnostic methods often have insufficient accuracy and noise reduction, which leads to diagnostic errors. To address these issues, this paper proposes an advanced fault diagnosis model that combines the variational mode decomposition (VMD) improved by a Variable-Objective Search Whale Optimization Algorithm (VSWOA) with a Pelican Optimization (PO)-boosted Kernel Extreme Learning Machine (KELM) algorithm. The application of the method is shown here in the fault diagnosis of rolling bearings. The proposed VSWOA enhances the performance of VMD by incorporating a Sobol sequence, nonlinear time-varying factors, a multi-objective initial search strategy, and an elite Cauchy chaos mutation strategy, significantly improving noise reduction in vibration signals. Fault information is precisely extracted using waveform factors, sample entropy, and advanced composite multiscale fuzzy entropy, which enables effective feature screening and dimensionality reduction. The POA fine-tunes the KELM parameters, increasing the classification accuracy. The effectiveness of the model is verified through experimental evaluations using bearing data with injected Gaussian noise (from Case Western Reserve University) and the SpectraQuest datasets, where significant improvements in noise reduction and fault detection accuracy are achieved.

Analyzing the online word of mouth dynamics: A novel approach

In today's digital economy, virtually everything from products and services to political debates and cultural phenomena can spark WOM on social media. Analyzing online WOM poses at least three challenges. First, online WOM typically consists of unstructured data that can transform into myriad variables, necessitating effective dimension reduction. Second, online WOM is often continuous and dynamic, with the potential for rapid, time-varying changes. Third, significant events may trigger symmetric or asymmetric responses across various entities, resulting in “bursty” and intense WOM from multiple sources. To address these challenges, we introduce a new computationally efficient method—multi-view sequential canonical covariance analysis. This method is designed to solve the myriad online WOM conversational dimensions, detect online WOM dynamic trends, and examine the shared online WOM across different entities. This approach not only enhances the capability to swiftly interpret and respond to online WOM data but also shows potential to significantly improve decision-making processes across various contexts. We illustrate the method's benefits through two empirical examples, demonstrating its potential to provide profound insights into online WOM dynamics and its extensive applicability in both academic research and practical scenarios.

Dimensional reduction gauge and effective dimensional reduction in four-dimensional Yang-Mills theory

Motivated by one-dimensional color-electric flux-tube formation in four-dimensional (4D) QCD, we investigate a possibility of effective dimensional reduction in the 4D Yang-Mills (YM) theory. We propose a new gauge fixing of “dimensional reduction (DR) gauge” defined so as to minimize RDR≡∫d4sTr[Ax2(s)+Ay2(s)], which has a residual gauge symmetry for the gauge function Ω(t,z) like 2D QCD on the t−z plane. We investigate effective dimensional reduction in the DR gauge using SU(3) quenched lattice QCD at β=6.0. The amplitude of Ax(s) and Ay(s) are found to be strongly suppressed in the DR gauge. We consider “tz-projection” of Ax,y(s)→0 for the gauge configuration generated in the DR gauge, in a similar sense to Abelian projection in the maximally Abelian gauge. By the tz-projection in the DR gauge, the interquark potential is not changed, and At(s) and Az(s) play a dominant role in quark confinement. In the DR gauge, we calculate a spatial correlation ⟨TrA⊥(s)A⊥(s+ra⊥)⟩(⊥=x,y) and estimate the spatial mass of A⊥(s)(⊥=x,y) as M≃1.7 GeV. It is conjectured that this large mass makes A⊥(s) inactive and realizes the dominance of At(s) and Az(s) in infrared region in the DR gauge. We also calculate the spatial correlation of two temporal link-variables and find that the correlation decreases as exp(−mr) with m≃0.6 GeV. Using a crude approximation, the 4D YM theory is reduced into an ensemble of 2D YM systems with the coupling of g2D=gm. Published by the American Physical Society 2024

Learning Accurate Label-Specific Features From Partially Multilabeled Data.

Feature selection is an effective dimensionality reduction technique, which can speed up an algorithm and improve model performance such as predictive accuracy and result comprehensibility. The study of selecting label-specific features for each class label has attracted considerable attention since each class label might be determined by some inherent characteristics, where precise label information is required to guide label-specific feature selection. However, obtaining noise-free labels is quite difficult and impractical. In reality, each instance is often annotated by a candidate label set that comprises multiple ground-truth labels and other false-positive labels, termed partial multilabel (PML) learning scenario. Here, false-positive labels concealed in a candidate label set might induce the selection of false label-specific features while masking the intrinsic label correlations, which misleads the selection of relevant features and compromises the selection performance. To address this issue, a novel two-stage partial multilabel feature selection (PMLFS) approach is proposed, which elicits credible labels to guide accurate label-specific feature selection. First, the label confidence matrix is learned to help elicit ground-truth labels from the candidate label set via the label structure reconstruction strategy, each element of which indicates how likely a class label is ground truth. After that, based on distilled credible labels, a joint selection model, including label-specific feature learner and common feature learner, is designed to learn accurate label-specific features to each class label and common features for all class labels. Besides, label correlations are fused into the features selection process to facilitate the generation of an optimal feature subset. Extensive experimental results clearly validate the superiority of the proposed approach.

Prediction and analysis of mechanical properties of hot-rolled strip steel based on an interpretable machine learning

Establishing a low-cost, high-precision predictive model for mechanical properties is crucial for enhancing the properties of steel. Due to the complexity of the steel production process, traditional mechanistic models struggle to efficiently and accurately describe the relationships among alloy elements, processes, and properties. In response to this, the paper introduces a high-precision framework for predicting and optimizing mechanical properties through feature engineering and machine learning models. Firstly, an effective dimension reduction of features is achieved through a weighted fusion heterogeneous feature selection strategy, thereby identifying the optimal model input features. Subsequently, an improved seagull optimization algorithm is utilized to optimize the hyperparameters of Extreme Gradient Boosting, further enhancing the predictive accuracy of the model. Moreover, based on the Shapley Additive Explanation method, a quantitative analysis of the model's predictive outcomes is conducted, elucidating the impacts of alloy elements and processes on mechanical properties, consistent with established principles of physical metallurgy. The proposed framework not only enables precise prediction of mechanical properties in steel but also provides theoretical guidance and technical support for process optimization design and the development of new steel grades.

MFILS: Tri-Selection via Convex and Nonconvex Regularizations.

In many real-world applications, data are represented by multiple instances and simultaneously associated with multiple labels. These data are always redundant and generally contaminated by different noise levels. As a result, several machine learning models fail to achieve good classification and find an optimal mapping. Feature selection, instance selection, and label selection are three effective dimensionality reduction techniques. Nevertheless, the literature was limited to feature and/or instance selection but has, to some extent, neglected label selection, which also plays an essential role in the preprocessing step, as label noises can adversely affect the performance of the underlying learning algorithms. In this article, we propose a novel framework termed multilabel Feature Instance Label Selection (mFILS) that simultaneously performs feature, instance, and label selections in both convex and nonconvex scenarios. To the best of our knowledge, this article offers, for the first time ever, a study using the triple and simultaneous selection of features, instances, and labels based on convex and nonconvex penalties in a multilabel scenario. Experimental results are built on some known benchmark datasets to validate the effectiveness of the proposed mFILS.

Dimensionality Reduction in Structural Health Monitoring: A Case Study on Damaged Wind Turbine Blades

AbstractIn recent years, advances in structural health monitoring (SHM) of composite materials have been observed, driven by the adoption of intelligent diagnostic techniques. Vibration signals, which embed valuable structural health information, have been increasingly utilized in SHM. However, the high dimensionality of this data has necessitated significant computational resources and has made the differentiation between health states more complex. Highlighting the need for effective feature extraction and dimensionality reduction (DR), a study is conducted. In this research, advanced DR techniques, i.e., principal component analysis (PCA), locally linear embedding (LLE), t‐distributed stochastic neighbors embedding (t‐SNE), and uniform manifold approximation and projection (UMAP), are applied to an experimental dataset from a wind turbine blade under various health and environmental conditions (controlled‐environment vibration signals). The extracted features are then processed for the classification phase, and it is found that UMAP provides the best performance, albeit with a slightly increased computational demand. The findings from this research offer invaluable insights for researchers and engineers, assisting in the selection of the most appropriate DR method for SHM, and weighing up accuracy against computational time.

Deciphering Abnormal Platelet Subpopulations in COVID-19, Sepsis and Systemic Lupus Erythematosus through Machine Learning and Single-Cell Transcriptomics.

This study focuses on understanding the transcriptional heterogeneity of activated platelets and its impact on diseases such as sepsis, COVID-19, and systemic lupus erythematosus (SLE). Recognizing the limited knowledge in this area, our research aims to dissect the complex transcriptional profiles of activated platelets to aid in developing targeted therapies for abnormal and pathogenic platelet subtypes. We analyzed single-cell transcriptional profiles from 47,977 platelets derived from 413 samples of patients with these diseases, utilizing Deep Neural Network (DNN) and eXtreme Gradient Boosting (XGB) to distinguish transcriptomic signatures predictive of fatal or survival outcomes. Our approach included source data annotations and platelet markers, along with SingleR and Seurat for comprehensive profiling. Additionally, we employed Uniform Manifold Approximation and Projection (UMAP) for effective dimensionality reduction and visualization, aiding in the identification of various platelet subtypes and their relation to disease severity and patient outcomes. Our results highlighted distinct platelet subpopulations that correlate with disease severity, revealing that changes in platelet transcription patterns can intensify endotheliopathy, increasing the risk of coagulation in fatal cases. Moreover, these changes may impact lymphocyte function, indicating a more extensive role for platelets in inflammatory and immune responses. This study identifies crucial biomarkers of platelet heterogeneity in serious health conditions, paving the way for innovative therapeutic approaches targeting platelet activation, which could improve patient outcomes in diseases characterized by altered platelet function.

Crop yield prediction using effective deep learning and dimensionality reduction approaches for Indian regional crops

Crop yield prediction (CYP) at the field level is crucial in quantitative and economic assessment for creating agricultural commodities plans for import-export strategies and enhancing farmer incomes. Crop breeding has always required a significant amount of time and money. CYP is developed to forecast higher crop production. This paper proposes an efficient deep learning (DL) and dimensionality reduction (DR) approaches for CYP for Indian regional crops. This paper comprised ‘3′ phases: preprocessing, DR, and classification. Initially, the agricultural data of the south Indian region are collected from the dataset. Then preprocessing is applied to the collected dataset by performing data cleaning and normalization. After that, the DR is performed using squared exponential kernel-based principal component analysis (SEKPCA). Finally, CYP is based on a weight-tuned deep convolutional neural network (WTDCNN), which predicts the high crop yield profit. The simulation outcomes shows that the proposed method attains superior performance for CYP compared to exiting schemes with an improved accuracy of 98.96 %. The novelty of the proposed approach lies in the combination of DL, DR, and WTDCNN techniques for accurate crop yield prediction, specifically tailored for Indian regional crops.

Differentially private federated learning with Laplacian smoothing

Federated learning aims to protect data privacy by collaboratively learning a model without sharing private data among users. However, an adversary may still be able to infer the private training data by attacking the released model. Differential privacy provides a statistical protection against such attacks at the price of significantly degrading the accuracy or utility of the trained models. In this paper, we investigate a utility enhancement scheme based on Laplacian smoothing for differentially private federated learning (DP-Fed-LS), to improve the statistical precision of parameter aggregation with injected Gaussian noise without losing privacy budget. Our key observation is that the aggregated gradients in federated learning often enjoy a type of smoothness, i.e. sparsity in a graph Fourier basis with polynomial decays of Fourier coefficients as frequency grows, which can be exploited by the Laplacian smoothing efficiently. Under a prescribed differential privacy budget, convergence error bounds with tight rates are provided for DP-Fed-LS with uniform subsampling of heterogeneous non-iid data, revealing possible utility improvement of Laplacian smoothing in effective dimensionality and variance reduction, among others. Experiments over MNIST, SVHN, and Shakespeare datasets show that the proposed method can improve model accuracy with DP-guarantee and membership privacy under both uniform and Poisson subsampling mechanisms.

Reducing Effective System Dimensionality with Long-Range Collective Dipole-Dipole Interactions.

Dimensionality plays a crucial role in long-range dipole-dipole interactions (DDIs). We demonstrate that a resonant nanophotonic structure modifies the apparent dimensionality in an interacting ensemble of emitters, as revealed by population decay dynamics. Our measurements on a dense ensemble of interacting quantum emitters in a resonant nanophotonic structure with long-range DDIs reveal an effective dimensionality reduction to d[over ¯]=2.20(12), despite the emitters being distributed in 3D. This contrasts with the homogeneous environment, where the apparent dimension is d[over ¯]=3.00. Our work presents a promising avenue to manipulate dimensionality in an ensemble of interacting emitters.

Functional sufficient dimension reduction through information maximization with application to classification

Considering the case where the response variable is a categorical variable and the predictor is a random function, two novel functional sufficient dimensional reduction (FSDR) methods are proposed based on mutual information and square loss mutual information. Compared to the classical FSDR methods, such as functional sliced inverse regression and functional sliced average variance estimation, the proposed methods are appealing because they are capable of estimating multiple effective dimension reduction directions in the case of a relatively small number of categories, especially for the binary response. Moreover, the proposed methods do not require the restrictive linear conditional mean assumption and the constant covariance assumption. They avoid the inverse problem of the covariance operator which is often encountered in the functional sufficient dimension reduction. The functional principal component analysis with truncation be used as a regularization mechanism. Under some mild conditions, the statistical consistency of the proposed methods is established. Simulation studies and real data analyzes are used to evaluate the finite sample properties of our methods.

Spectrally Segmented-Enhanced Neural Network for Precise Land Cover Object Classification in Hyperspectral Imagery

The paradigm shift brought by deep learning in land cover object classification in hyperspectral images (HSIs) is undeniable, particularly in addressing the intricate 3D cube structure inherent in HSI data. Leveraging convolutional neural networks (CNNs), despite their architectural constraints, offers a promising solution for precise spectral data classification. However, challenges persist in object classification in hyperspectral imagery or hyperspectral image classification, including the curse of dimensionality, data redundancy, overfitting, and computational costs. To tackle these hurdles, we introduce the spectrally segmented-enhanced neural network (SENN), a novel model integrating segmentation-based, multi-layer CNNs, SVM classification, and spectrally segmented dimensionality reduction. SENN adeptly integrates spectral–spatial data and is particularly crucial for agricultural land classification. By strategically fusing CNNs and support vector machines (SVMs), SENN enhances class differentiation while mitigating overfitting through dropout and early stopping techniques. Our contributions extend to effective dimensionality reduction, precise CNN-based classification, and enhanced performance via CNN-SVM fusion. SENN harnesses spectral information to surmount challenges in “hyperspectral image classification in hyperspectral imagery”, marking a significant advancement in accuracy and efficiency within this domain.

Lattice QED in an external magnetic field: Evidence for dynamical chiral symmetry breaking

We simulate quantum electrodynamics (QED) in a strong constant homogeneous external magnetic field on a Euclidean space-time lattice using the rational hybrid Monte Carlo method, developed for simulating lattice quantum chromodynamics (QCD). Our primary goal is to measure the chiral condensate in the limit when the input electron mass m is zero. We observe a nonzero value, indicating that the external magnetic field catalyzes chiral symmetry breaking as predicted by approximate truncated Schwinger-Dyson methods. Such behavior is associated with dominance by the lowest Landau level which causes the effective dimensional reduction from 3+1 dimensions to 1+1 dimensions for charged particles (electrons and positrons) where the attractive forces of QED can produce chiral symmetry breaking with a dynamical electron mass and associated chiral condensate. Since our lattice simulations use bare (lattice) parameters, while the Schwinger-Dyson analyses work with renormalized quantities, direct numerical comparison will require renormalization of our lattice results. Published by the American Physical Society 2024

Inexact augmented Lagrangian method-based full-waveform inversion with randomized singular value decomposition

Abstract The main advantage of full-waveform inversion (FWI) is the ability to obtain useful subsurface structure information, such as velocity and density, from complex seismic data. We have developed a novel inversion algorithm to improve the capability of FWI to achieve high-resolution imaging, even under complex conditions caused by random noise contamination, initial model dependence, or the selection of parameters to be estimated. Our algorithm considers an effective image processing and dimension reduction tool, randomized singular value decomposition-weighted truncated nuclear norm regularization, for embedding FWI to achieve high-resolution imaging results. This algorithm obtains a truncated matrix approximating the original matrix by reducing the rank of the velocity increment matrix, thus achieving the truncation of noisy data, with the truncation range controlled by weighted truncated nuclear norm regularization. Subsequently, we employ an inexact augmented Lagrangian method algorithm in the optimization to compress the solution space range, thus relaxing the dependence of FWI and randomized singular value decomposition-weighted truncated nuclear norm regularization on the initial model and accelerating the convergence rate of the objective function. We tested on one set of synthetic data, and the results show that, compared with traditional FWI, our method can more effectively suppress the impact of random noise, thus obtaining higher resolution and more accurate subsurface model information. This work indicates that the combination of randomized singular value decomposition-weighted truncated nuclear norm regularization and FWI is an effective imaging strategy that can help to solve the challenges faced by traditional FWI.

A feature selection method based on the Golden Jackal-Grey Wolf Hybrid Optimization Algorithm.

This paper proposes a feature selection method based on a hybrid optimization algorithm that combines the Golden Jackal Optimization (GJO) and Grey Wolf Optimizer (GWO). The primary objective of this method is to create an effective data dimensionality reduction technique for eliminating redundant, irrelevant, and noisy features within high-dimensional datasets. Drawing inspiration from the Chinese idiom "Chai Lang Hu Bao," hybrid algorithm mechanisms, and cooperative behaviors observed in natural animal populations, we amalgamate the GWO algorithm, the Lagrange interpolation method, and the GJO algorithm to propose the multi-strategy fusion GJO-GWO algorithm. In Case 1, the GJO-GWO algorithm addressed eight complex benchmark functions. In Case 2, GJO-GWO was utilized to tackle ten feature selection problems. Experimental results consistently demonstrate that under identical experimental conditions, whether solving complex benchmark functions or addressing feature selection problems, GJO-GWO exhibits smaller means, lower standard deviations, higher classification accuracy, and reduced execution times. These findings affirm the superior optimization performance, classification accuracy, and stability of the GJO-GWO algorithm.