Low-dimensional Feature Vector Research Articles

Exploiting common patterns in diverse cancer types via multi-task learning

Cancer prognosis requires precision to identify high-risk patients and improve survival outcomes. Conventional methods struggle with the complexity of genetic biomarkers and diverse medical data. Our study uses deep learning to distil high-dimensional medical data into low-dimensional feature vectors exploring shared patterns across cancer types. We developed a multi-task bimodal neural network integrating RNA Sequencing and clinical data from three The Cancer Genome Atlas project datasets: Breast Invasive Carcinoma, Lung Adenocarcinoma, and Colon Adenocarcinoma. Our approach significantly improved prognosis prediction, especially for Colon Adenocarcinoma, with up to 26% increase in concordance index and 41% in the area under the precision-recall curve. External validation with Small Cell Lung Cancer achieved comparable metrics, indicating that supplementing small datasets with data from other cancers can improve performance. This work represents initial strides in using multi-task learning for prognosis prediction across cancer types, potentially revealing shared mechanisms among cancers and contributing to future applications in precision medicine.

Designing spongy-bone-like cellular materials: Matched topology and anisotropy

Bone is a natural material with properties such as high specific stiffness and strength. These exceptional mechanical properties are attributed to the meso-scale structure and elastic anisotropy of spongy bone. Replicating the topological traits and mechanical properties of spongy bone presents a novel opportunity to develop high-performance cellular materials. To achieve this, we propose an innovative framework for designing biomimetic cellular materials that match the trabecular structure and elastic anisotropy of spongy bone. This framework introduces a forward-flow design process that utilizes gradient-based feature tuning on a low-dimensional feature vector, transforming the complex inverse design problem into an efficient iterative process. A key innovation in our approach is the use of a pre-trained generative model, SliceGAN, to reconstruct 3D unit cells from 2D micro-CT images. This significantly reduces the cost and time associated with traditional layer-by-layer CT scans typically required for 3D training data. Numerical homogenization is then used to determine the effective elastic stiffness matrix, and a Fourier neural operator is trained to predict these matrices efficiently, greatly enhancing the computational efficiency of the design process. Using this framework, we successfully designed unit cells with topological traits and elastic anisotropy that closely approximate those of natural spongy bone. This opens new avenues for developing spongy-bone-mimetic cellular materials with exceptional mechanical properties. Moreover, the framework's versatility allows it to be extended to the design of other bio-inspired cellular materials.

High-dimensional process monitoring under time-varying operating conditions via covariate-regulated principal component analysis

High-dimensional process monitoring, which aims to raise warnings for faulty events, is a fundamental tool in ensuring the safety of large-scale industrial systems. Over the last few decades, there has been significant interest in Principal Component Analysis (PCA)-based Statistical Process Control (SPC) charts. However, most of them rely on PCA’s optimal properties in homogeneous data, which often fails when dealing with heterogeneous data from industrial processes under time-varying operating conditions. To address this issue, this study proposes a Covariate-regulated PCA model (CrPCA) seamlessly integrated into a process monitoring framework. The main idea is to adjust the principal component directions smoothly according to the time-varying operating conditions, resulting in significantly less information loss in the principal component scores compared to existing methods. This approach further yields a low-dimensional feature vector that follows a distribution with fixed parameters, regardless of covariates, for real-time surveillance. We validate the performance of our methodology through a comprehensive numerical study and two real-world applications: wind turbine condition monitoring and hot rolling process monitoring.

Test Input Prioritization for 3D Point Clouds

3D point cloud applications have become increasingly prevalent in diverse domains, showcasing their efficacy in various software systems. However, testing such applications presents unique challenges due to the high-dimensional nature of 3D point cloud data and the vast number of possible test cases. Test input prioritization has emerged as a promising approach to enhance testing efficiency by prioritizing potentially misclassified test cases during the early stages of the testing process. Consequently, this enables the early labeling of critical inputs, leading to a reduction in the overall labeling cost. However, applying existing prioritization methods to 3D point cloud data is constrained by several factors: (1) inadequate consideration of crucial spatial information, and (2) susceptibility to noises inherent in 3D point cloud data. In this article, we propose PCPrior , the first test prioritization approach specifically designed for 3D point cloud test cases. The fundamental concept behind PCPrior is that test inputs closer to the decision boundary of the model are more likely to be predicted incorrectly. To capture the spatial relationship between a point cloud test and the decision boundary, we propose transforming each test (a point cloud) into a low-dimensional feature vector, toward indirectly revealing the underlying proximity between a test and the decision boundary. To achieve this, we carefully design a group of feature generation strategies, and for each test input, we generate four distinct types of features, namely spatial features, mutation features, prediction features, and uncertainty features. Through a concatenation of the four feature types, PCPrior assembles a final feature vector for each test. Subsequently, a ranking model is employed to estimate the probability of misclassification for each test based on its feature vector. Finally, PCPrior ranks all tests based on their misclassification probabilities. We conducted an extensive study based on 165 subjects to evaluate the performance of PCPrior, encompassing both natural and noisy datasets. The results demonstrate that PCPrior outperforms all of the compared test prioritization approaches, with an average improvement of 10.99% to 66.94% on natural datasets and 16.62% to 53% on noisy datasets.

Missing Data Filling of Model Based on Neural Network

Today’s society has entered the pace of information development era. All kinds of information are digitized, while the loss of information data also directly affects the normal operation of the application system and has become the biggest obstacle to the development of information technology. The existing missing filling methods do not take into account the time-series information of the data set. Based on the neural network method for filling missing data in time series, an end-to-end missing data filling method for time series based on the residual of regression equation is proposed. Under the assumption that the activation function and the noise diffusion coefficient function are satisfied, the exponential stability of the complex-valued stochastic inertial neural network systems with additive time-varying delays is studied. The bipartite graph model of the time series data missing value filling method of the countermeasure network and the filling cyclic neural unit are generated. According to the end-to-end time series data missing value filling method of the self encoder, the corresponding low-dimensional feature vector can be automatically generated for each time series data. It avoids overfitting by using nonlinear methods directly in low-dimensional space. Experiments show that the method proposed in this paper uses Monte Carlo to fill data missing at different proportions. In data gap filling process, the coefficient variance is less than 0.05, which enhances the rationality of filling data. It is of great research value and practical significance to reasonably fill in the missing values of time series data. The research can accelerate the improvement of big data system, improve the level and effectiveness of database management, and is an important means of computing capacity of existing data centers.

Memory and Communication Efficient Federated Kernel k-Means.

A federated kernel k -means (FedKKM) algorithm is developed in this article to conduct distributed clustering with low memory consumption on user devices. In FedKKM, a federated eigenvector approximation (FEA) algorithm is designed to iteratively determine the low-dimensional approximate vectors of the transformed feature vectors, using only low-dimensional random feature vectors. To maintain high communication efficiency in each iteration of FEA, a communication-efficient Lanczos algorithm (CELA) is further designed in FEA to reduce the communication cost. Based on the low-dimensional approximate vectors, the clustering result is obtained by leveraging a distributed linear k -means algorithm. A theoretical analysis shows that: 1) FEA has a convergence rate of O(1/T) , where T is the number of iterations; 2) the scalability of FedKKM is not affected by the dataset size since the communication cost of FedKKM is independent of the number of users' data; and 3) FedKKM is a (1+ϵ) approximation algorithm. The experimental results show that FedKKM achieves the comparable clustering quality to that of a centralized kernel k -means. Compared with state-of-the-art schemes, FedKKM reduces the memory consumption on user devices by up to 94% and also reduces the communication cost by more than 40%.

Image splicing detection using low-dimensional feature vector of texture features and Haralick features based on Gray Level Co-occurrence Matrix

Digital image forgery has become hugely widespread, as numerous easy-to-use, low-cost image manipulation tools have become widely available to the common masses. Such forged images can be used with various malicious intentions, such as to harm the social reputation of renowned personalities, to perform identity fraud resulting in financial disasters, and many more illegitimate activities. Image splicing is a form of image forgery where an adversary intelligently combines portions from multiple source images to generate a natural-looking artificial image. Detection of image splicing attacks poses an open challenge in the forensic domain, and in recent literature, several significant research findings on image splicing detection have been described. However, the number of features documented in such works is significantly huge. Our aim in this work is to address the issue of feature set optimization while modeling image splicing detection as a classification problem and preserving the forgery detection efficiency reported in the state-of-the-art. This paper proposes an image-splicing detection scheme based on textural features and Haralick features computed from the input image’s Gray Level Co-occurrence Matrix (GLCM) and also localizes the spliced regions in a detected spliced image. We have explored the well-known Columbia Image Splicing Detection Evaluation Dataset and the DSO-1 dataset, which is more challenging because of its constituent post-processed color images. Experimental results prove that our proposed model obtains 95% accuracy in image splicing detection with an AUC score of 0.99, with an optimized feature set of dimensionality of 15 only.

Personalized Federated Learning with Adaptive Feature Extraction and Category Prediction in Non-IID Datasets

Federated learning trains a neural network model using the client’s data to maintain the benefits of centralized model training while maintaining their privacy. However, if the client data are not independently and identically distributed (non-IID) because of different environments, the accuracy of the model may suffer from client drift during training owing to discrepancies in each client’s data. This study proposes a personalized federated learning algorithm based on the concept of multitask learning to divide each client model into two layers: a feature extraction layer and a category prediction layer. The feature extraction layer maps the input data to a low-dimensional feature vector space. Furthermore, the parameters of the neural network are aggregated with those of other clients using an adaptive method. The category prediction layer maps low-dimensional feature vectors to the label sample space, with its parameters remaining unaffected by other clients to maintain client uniqueness. The proposed personalized federated learning method produces faster learning model convergence rates and higher accuracy rates for the non-IID datasets in our experiments.

A practical low-dimensional feature vector generation method based on wavelet transform for psychophysiological signals

A practical low-dimensional feature vector generation method based on wavelet transform for psychophysiological signals

An intelligent online fault diagnosis system for gas turbine sensors based on unsupervised learning method LOF and KELM

The performance of gas turbine inevitably grades slowly in service. In order to obtain high-precision state assessment, an intelligent online real-time sensor fault diagnosis algorithm was proposed in this paper. This method can automatically establish an accurate diagnosis model in a short time, realize the rapid diagnosis of sensor faults, and can effectively solve the problem of operation data imbalance. Firstly, wavelet analysis quickly converts the high-dimensional time-series sensor signal into a low-dimensional feature vector. Then, the unsupervised method LOF was used to screen the abnormal sensor signals. Finally, the KELM is used to achieve fast online identify the fault modes of the sensors. This fault diagnosis system achieves a faster diagnosis speed while ensuring the accuracy. The effectiveness of the method proposed in this paper was verified on the operational data of a gas turbine, the diagnosis time is about 0.233 s, which greatly increases the diagnosis speed compared with other methods, at the same time, the proposed method can guarantee more than 95 % of diagnosis accuracy.

Nonlinear characterization of enhanced and generalized Hjorth’s feature space for bearing condition monitoring

The degradation assessment of rolling bearings provides a reasonable maintenance plan for the safe operation of mechanical equipment. The general strategy for bearing condition monitoring is to construct a health indicator (HI) to characterize different degradation stages. A preferable HI that can sensitively detect initial faults and track machine degradation is crucial to developing timely maintenance strategies for mechanical equipment to avoid catastrophic accidents. However, many developed and reported HIs are still insensitive to early faults, resulting in delayed maintenance schedules. To identify the incipient defects as early as possible, a novel HI constructed by nonlinear characterization of enhanced and generalized Hjorth’s feature space based on extended probability entropy is proposed in this paper. Firstly, the time-frequency spectral amplitude modulation helps to enhance the characteristics of the original signal with the amplitude editing in the time-frequency domain. Then, three new features of generalized Hjorth’s parameter combinations are designed and combined with other similar feature combinations to construct a high-dimensional enhanced and generalized Hjorth’s feature space. On this basis, a set of low-dimensional sensitive features is obtained by nonlinearly characterizing high-dimensional features through extended probability entropy after these features are standardized. Finally, a novel HI is developed by calculating the distance between the minimum volume ellipse (MVE) center of the low-dimensional feature subspace based on nonlinear characterization and the low-dimensional feature vector of the real-time monitoring signal. The performance of the proposed approach is verified in three cases, whose experimental results indicate that the proposed HI is more sensitive and significant in detecting early faults compared to some current HIs.

Dual-input anomaly detection method based on deep reinforcement learning

Aiming at the problem of low accuracy of unsupervised learning anomaly detection algorithm, a dual-input anomaly detection method based on deep reinforcement learning was proposed. The proposed model mainly consists of a feature extractor and anomaly detector. Based on the deep reinforcement learning framework, the feature extractor uses a dual-input deep neural network to form the current value network and the target value network, which are used to extract the low-dimensional feature vectors. Based on the 3σ principle, the reward function of reinforcement learning is designed to reward and punish the output results of the model during training. The model was trained only with the normal data, and the extracted feature vector of the normal class was used as the input of the anomaly detector to complete the learning of the detector. During the test, the input anomaly detection was realized based on the dual-input convolutional neural network, and the anomaly detector was completed by learning. To illustrate the generality and generalization performance of the proposed method, four sets of image data and two sets of rolling bearing fault data in different fields were verified respectively. At the same time, the proposed method is applied to the fault detection of a real aero-engine rolling bearing.The results show that the proposed model has high anomaly detection accuracy, which is superior to the current optimal method.

Pathology steered stratification network for subtype identification in Alzheimer's disease.

Alzheimer's disease (AD) is a heterogeneous, multifactorial neurodegenerative disorder characterized by three neurobiological factors beta-amyloid, pathologic tau, and neurodegeneration. There are no effective treatments for AD at a late stage, urging for early detection and prevention. However, existing statistical inference approaches in neuroimaging studies of AD subtype identification do not take into account the pathological domain knowledge, which could lead to ill-posed results that are sometimes inconsistent with the essential neurological principles. Integrating systems biology modeling with machine learning, the study aims to assist clinical AD prognosis by providing a subpopulation classification in accordance with essential biological principles, neurological patterns, and cognitive symptoms. We propose a novel pathology steered stratification network (PSSN) that incorporates established domain knowledge in AD pathology through a reaction-diffusion model, where we consider non-linear interactions between major biomarkers and diffusion along the brain structural network. Trained on longitudinal multimodal neuroimaging data, the biological model predicts long-term evolution trajectories that capture individual characteristic progression pattern, filling in the gaps between sparse imaging data available. A deep predictive neural network is then built to exploit spatiotemporal dynamics, link neurological examinations with clinical profiles, and generate subtype assignment probability on an individual basis. We further identify an evolutionary disease graph to quantify subtype transition probabilities through extensive simulations. Our stratification achieves superior performance in both inter-cluster heterogeneity and intra-cluster homogeneity of various clinical scores. Applying our approach to enriched samples of aging populations, we identify six subtypes spanning AD spectrum, where each subtype exhibits a distinctive biomarker pattern that is consistent with its clinical outcome. The proposed PSSN (i) reduces neuroimage data to low-dimensional feature vectors, (ii) combines AT[N]-Net based on real pathological pathways, (iii) predicts long-term biomarker trajectories, and (iv) stratifies subjects into fine-grained subtypes with distinct neurological underpinnings. PSSN provides insights into pre-symptomatic diagnosis and practical guidance on clinical treatments, which may be further generalized to other neurodegenerative diseases.

A DCT probability histogram-based ROI features for content-based natural and medical image retrieval applications

The effectiveness of a Content-based Image Retrieval (CBIR) system depends on selecting representative and salient visual features. Capturing the salient image features for forming a feature vector is an essential part of the CBIR process, as it can significantly affect retrieval efficiency. Most images contain a visually prominent region that perceives maximum image semantic information, known as Regions-of-Interest (ROIs). This paper suggests a new CBIR scheme that employs a Graph-based Visual Saliency (GBVS) map to extract the ROI of the image. Further, block-level Discrete Cosine Transforms (DCT) and subsequent histograms are computed for the DC and significant AC coefficients of the extracted ROI image. In addition, a low-dimensional feature vector is formed from the modified histograms. Subsequently, six statistical features from the background scene have also been computed for the final feature vector construction. As a result, the final feature vector contains ROI and background information in their proper proportion to improve retrieval performance. Moreover, the performance of the proposed CBIR scheme has been evaluated using one medical, three natural, two objects, one texture, and one natural heterogeneous image database. All these databases collectively contain 53732 different images from 200 image classes. The outcomes of the experiments demonstrate substantial improvement in the retrieval process with some existing related schemes. At the same time, it also shows that the performance of the proposed scheme is robust concerning all kinds of image databases.

Multi-View Learning-Based Fast Edge Embedding for Heterogeneous Graphs

Edge embedding is a technique for constructing low-dimensional feature vectors of edges in heterogeneous graphs, which are also called heterogeneous information networks (HINs). However, edge embedding research is still in its early stages, and few well-developed models exist. Moreover, existing models often learn features on the edge graph, which is much larger than the original network, resulting in slower speed and inaccurate performance. To address these issues, a multi-view learning-based fast edge embedding model is developed for HINs in this paper, called MVFEE. Based on the “divide and conquer” strategy, our model divides the global feature learning into multiple separate local intra-view features learning and inter-view features learning processes. More specifically, each vertex type in the edge graph (each edge type in HIN) is first treated as a view, and a private skip-gram model is used to rapidly learn the intra-view features. Then, a cross-view learning strategy is designed to further learn the inter-view features between two views. Finally, a multi-head attention mechanism is used to aggregate these local features to generate accurate global features of each edge. Extensive experiments on four datasets and three network analysis tasks show the advantages of our model.

Deep learning system for classification of ploidy status using time-lapse videos

To develop a spatiotemporal model for de prediction of euploid and aneuploid embryos using time-lapse videos from 10-115 hours after insemination (hpi). Retrospective study. The research used an end-to-end approach to develop an automated artificial intelligence system capable of extracting features from images and classifying them, considering spatiotemporal dependencies. A convolutional neural network extracted the most relevant features from each video frame. A bidirectional long short-term memory layer received this information and analyzed the temporal dependencies, obtaining a low-dimensional feature vector that characterized each video. A multilayer perceptron classified them into 2 groups, euploid and noneuploid. The model performance in accuracy fell between 0.6170 and 0.7308. A multi-input model with a gate recurrent unit module performed better than others; the precision (or positive predictive value) is 0.8205 for predicting euploidy. Sensitivity, specificity, F1-Score and accuracy are 0.6957, 0.7813, 0.7042, and 0.7308, respectively. This article proposes an artificial intelligence solution for prioritizing euploid embryo transfer. We can highlight the identification of a noninvasive method for chromosomal status diagnosis using a deep learning approach that analyzes raw data provided by time-lapse incubators. This method demonstrated potential automation of the evaluation process, allowing spatial and temporal information to encode.

A Low-Dimensional Feature Vector Representation for Gait-based Parkinson’s Disease Detection

Thanks to the developing technology, Parkinson's disease can be detected by using datasets which are obtained from different sources. Gait activity analysis is one of the methods used to detect Parkinson’s disease. The gait activity of Parkinson's disease differs from the gait of a normal person. In this study, a support vector machine-based classification method using low-dimensional feature vector representation is proposed to detect Parkinson's disease. Pressure sensors placed under the foot are divided into 3 categories, placed on the heel of the foot, the center of the foot, and the toe. Average stance duration, average stride duration, and average distance are extracted from the heel of the foot and toe. The frequency value obtained from the center of the foot during the walking period is used. Only 4 feature values having O(n) time complexity are used for the classification process. Experimental results point out that the proposed method can compete with similar studies proposed in the literature, even under these few features. According to the experimental results, high classification performance, up to 85%, is obtained under the whole dataset. Moreover, superior classification performance, up to 91%, is obtained when the datasets are evaluated individually.

Unbalance Detection in Induction Motors through Vibration Signals Using Texture Features

The detection of faults in induction motors has been one of the main challenges to the industry in recent years. An effective fault detection method is fundamental to ensure operational security and productivity. Different models for intelligent fault diagnosis have been recently proposed. However, not all of them are accessible for some manufacturing processes because of the black-box approach, the complexity of hyperparameter tuning, high-dimensionality feature vectors, and the need for sophisticated computational resources. In this paper, a method for the detection of an unbalance fault in induction motors based on a low-dimensional feature vector and a low-complexity classification approach is proposed. The feature vector presented in this manuscript is based on texture features, which are a basic tool for image processing and image understanding. Nevertheless, texture features have not been explored as a powerful instrument for induction motor fault analysis. In this approach, texture features are used to analyze a set of vibration signals belonging to two different classes: an unbalanced motor and a healthy motor. Training-validation and testing stages are developed to build and evaluate the performance of the classifier, respectively. The results show higher accuracy and lower training time in comparison with different state-of-the-art approaches.

An Efficient Compression Method for Lightning Electromagnetic Pulse Signal Based on Convolutional Neural Network and Autoencoder.

Advances in technology have facilitated the development of lightning research and data processing. The electromagnetic pulse signals emitted by lightning (LEMP) can be collected by very low frequency (VLF)/low frequency (LF) instruments in real time. The storage and transmission of the obtained data is a crucial link, and a good compression method can improve the efficiency of this process. In this paper, a lightning convolutional stack autoencoder (LCSAE) model for compressing LEMP data was designed, which converts the data into low-dimensional feature vectors through the encoder part and reconstructs the waveform through the decoder part. Finally, we investigated the compression performance of the LCSAE model for LEMP waveform data under different compression ratios. The results show that the compression performance is positively correlated with the minimum feature of the neural network extraction model. When the compressed minimum feature is 64, the average coefficient of determination R2 of the reconstructed waveform and the original waveform can reach 96.7%. It can effectively solve the problem regarding the compression of LEMP signals collected by the lightning sensor and improve the efficiency of remote data transmission.

Labyrinth morphological modeling and its application on unreferenced segmentation assessment

The labyrinth of the inner ear is an important auditory and balanced sensory organ and is closely related to tinnitus, hearing loss, vertigo, and Ménière diseases. Quantitative description and measurement of the labyrinth is a challenging task in both clinical practice and medical research. A data-driven-based labyrinth morphological modeling method is proposed for extracting simple and low-dimensional representations or feature vectors to quantify the normal and abnormal labyrinths in morphology. Firstly, a two-stage pose alignment strategy is introduced to align the segmented inner ear labyrinths. Then, an energy-adaptive spatial and inter-slice dimensionality reduction strategy is adopted to extract compact morphological features via a variational autoencoder (VAE). Finally, a statistical model of the compact feature in the latent space is established to represent the morphology distribution of the labyrinths. As one of an application of our model, a reference-free quality evaluation for the segmentation of the labyrinth is explored. The experimental results show that the consistency between the proposed method and the Dice similarity coefficient (DSC) reaches 0.78. Further analysis showed that the model also has a high potential to apply to morphological analysis, such as anomaly detection, of the labyrinths.