Local Principal Component Research Articles

Quadratic Matrix Factorization With Applications to Manifold Learning.

Matrix factorization is a popular framework for modeling low-rank data matrices. Motivated by manifold learning problems, this paper proposes a quadratic matrix factorization (QMF) framework to learn the curved manifold on which the dataset lies. Unlike local linear methods such as the local principal component analysis, QMF can better exploit the curved structure of the underlying manifold. Algorithmically, we propose an alternating minimization algorithm to optimize QMF and establish its theoretical convergence properties. To avoid possible over-fitting, we then propose a regularized QMF algorithm and discuss how to tune its regularization parameter. Finally, we elaborate how to apply the regularized QMF to manifold learning problems. Experiments on a synthetic manifold learning dataset and three real-world datasets, including the MNIST handwritten dataset, a cryogenic electron microscopy dataset, and the Frey Face dataset, demonstrate the superiority of the proposed method over its competitors.

Gender Classification Using Viola Jones, Orthogonal Difference Local Binary Pattern and Principal Component Analysis

Facial recognition is currently a widely discussed topic, particularly in the context of gender classification. Facial recognition by computers is more complex and time-consuming compared to humans. There is ongoing research on facial feature extraction for gender classification. Geometry and texture features are effective for gender classification. This study aimed to combine these two features to improve the accuracy of gender classification. This research used the Viola-Jones and Orthogonal Difference Local Binary Pattern (OD-LBP) methods for feature extraction. The Viola-Jones algorithm faces issues in facial detection, leading to outliers in geometry features. At the same time, OD-LBP is a new descriptor capable of addressing pose, lighting, and expression variations. Therefore, this research attempts to utilize OD-LBP for gender classification. The dataset used was FERET, which contained various lighting variations, making OD-LBP suitable for addressing this challenge. Random Forest and Backpropagation were employed for classification. This research demonstrates that combining these two features is effective for gender classification using Backpropagation, achieving an accuracy of 93%. This confirms the superiority of the proposed method over single-feature extraction methods.

SLRfinder: A method to detect candidate sex-linked regions with linkage disequilibrium clustering.

Despite their critical roles in genetic sex determination, sex chromosomes remain unknown in many non-model organisms, especially those having recently evolved sex-linked regions (SLRs). These evolutionarily young and labile sex chromosomes are important for understanding early sex chromosome evolution but are difficult to identify due to the lack of Y/W degeneration and SLRs limited to small genomic regions. Here, we present SLRfinder, a method to identify candidate SLRs using linkage disequilibrium (LD) clustering, heterozygosity and genetic divergence. SLRfinder does not rely on specific sequencing methods or a specific type of reference genome (e.g., from the homomorphic sex). In addition, the input of SLRfinder does not require phenotypic sexes, which may be unknown from population sampling, but sex information can be incorporated and is necessary to validate candidate SLRs. We tested SLRfinder using various published datasets and compared it to the local principal component analysis (PCA) method and the depth-based method Sex Assignment Through Coverage (SATC). As expected, the local PCA method could not be used to identify unknown SLRs. SATC works better on conserved sex chromosomes, whereas SLRfinder outperforms SATC in analysing labile sex chromosomes, especially when SLRs harbour inversions. Power analyses showed that SLRfinder worked better when sampling more populations that share the same SLR. If analysing one population, a relatively larger sample size (around 50) is needed for sufficient statistical power to detect significant SLR candidates, although true SLRs are likely always top-ranked. SLRfinder provides a novel and complementary approach for identifying SLRs and uncovering additional sex chromosome diversity in nature.

A painting authentication method based on multi-scale spatial-spectral feature fusion and convolutional neural network

The scientific authentication of paintings holds significant importance within the realm of art collection. Employing convolutional neural networks for the classification of authentic and counterfeit painting images based on color images is a viable but suboptimal choice. This study investigates the potential for authenticating paintings by incorporating high-spectral images alongside high-resolution spatial images. High-resolution and high-spectral images of genuine and counterfeit paintings were acquired using a push-broom digital scanning system. The processing methods presented in this approach for the acquired images are: 1) The study utilized the circular local binary pattern (LBP) and principal component analysis (PCA) to extract surface texture and spectral data from Chinese character images in paintings, encompassing both spatial and spectral dimensions. 2) The technique utilizing non-subsampling Shearlet transform (NSST) and pulse-coupled neural network (PCNN) was employed to integrate the spatial and spectral characteristics of the images into a pseudo-color image, producing a dataset of feature data for genuine and counterfeit paintings. 3) The experiments aimed to achieve the authenticity of artworks using EfficientNet v2-s, the hyperparameters of which were fine-tuned accordingly. The experimental findings demonstrate that this approach attained a 90.8 % accuracy on the test dataset, representing a 3.5 % enhancement over the existing top-performing three-dimensional convolutional neural network (3D-CNN).

Data fusion of Raman spectra in MSPC for fault detection and diagnosis in pharmaceutical manufacturing

This study investigates the use of Raman spectroscopy fused with other types of data (e.g., pH, temperature and turbidity) for multivariate statistical process control of two pharmaceutical case studies: one simulated industrial-scale fed-batch process for the production of penicillin and one real lab-scale crystallization process. The monitoring schemes are built on local principal component analysis models and hyper-parameters are tuned with regards to highest accuracy in fault detection. Accuracies above 90% are obtained for all types of data and level of DF. Furthermore, for the first case study the model built solely on spectra achieves higher fault detection rates, when only considering faults that also result in off-specification quality. This is supported by the fact that the fault is not necessarily detected when it occurs, but rather when it starts to affect quality variables as measured by the spectra.

Principal space approximation ensemble discriminative marginalized least-squares regression for hyperspectral image classification

Discriminative marginalized least-squares regression (DMLSR) is unable to extract the spectral-spatial joint features, the proportion of learned interfering pixels is high. To solve this problem, a novel principal space approximation ensemble discriminant edge least-squares regression, namely PSAE-DMLSR is proposed for hyperspectral image classification. In the PSAE-DMLSR, a marginal principal component method (MP) is employed to search the optimal spectral subspace, and a principal space local marginal principal component (PSLMP) method is proposed to search the optimal representation space (ORS). In the PSLMP, a principal space representation (PSR) is designed to integrate the global spectral-spatial joint features information of the ORS, and the PSR is used to impose approximate averaging constraints and stochastic cascade fusion on the ORS, which can further improve the representation ability of the ORS. The ORS can effectively reduce the proportion of interfering pixels in DMLSR learning. It conducted comparative experiments with some more advanced classification methods on the three commonly used hyperspectral datasets. The experiment results show that the PSAE-DMLSR classification model can still obtain high classification accuracy under low hardware conditions, and the execution efficiency also has advantages.

Golden eagle based improved Att-BiLSTM model for big data classification with hybrid feature extraction and feature selection techniques

ABSTRACT The remarkable development in technology has led to the increase of massive big data. Machine learning processes provide a way for investigators to examine and particularly classify big data. Besides, several machine learning models rely on powerful feature extraction and feature selection techniques for their success. In this paper, a big data classification approach is developed using an optimized deep learning classifier integrated with hybrid feature extraction and feature selection approaches. The proposed technique uses local linear embedding-based kernel principal component analysis and perturbation theory, respectively, to extract more representative data and select the appropriate features from the big data environment. In addition, the feature selection task is fine-tuned by using perturbation theory through heuristic search based on their output accuracy. This feature selection heuristic search method is analysed with five recent heuristic optimization algorithms for deciding the final feature subset. Finally, the data are categorized through an attention-based bidirectional long short-term memory classifier that is optimized with a golden eagle-inspired algorithm. The performance of the proposed model is experimentally verified on publicly accessible datasets. From the experimental outcomes, it is demonstrated that the proposed framework is capable of classifying large datasets with more than 90% accuracy.

Texture characterization and classification of polarized images based on multi-angle orthogonal difference.

The Local Binary Pattern (LBP) and its variants are capable of extracting image texture and have been successfully applied to classification. However, LBP has not been used to extract and describe the texture of polarized images, and simple LBP cannot characterize the polarized texture information from different polarizations of angles. In order to solve these problems, we propose a new multi-angle orthogonal difference polarization image texture descriptor (MODP_ITD) by analyzing the relationship between the difference of orthogonal difference polarization images from different angles and the pixel intensity distribution in the local neighborhood of images from different angles. The MODP_ITD consists of three patterns: multi-angle polarization orthogonal difference local binary pattern (MODP_LBP), multi-angle polarization orthogonal difference local sampling point principal component sequence pattern (MODP_LPCSP) and multi-angle orthogonal difference polarization local difference binary pattern (MODP_LDBP). The MODP_LBP extracts local corresponding texture characteristics of polarized orthogonal difference images from multiple angles. The MODP_LPCSP sorts the principal component order of each angle orthogonal difference local sampling point. The MODP LDBP extracts the local difference characteristics between different angles by constructing a new polarized image. Then, the frequency histograms of MODP_LBP, MOD_LPCSP ,and MODP_LDBP are cascaded to generate MODP_ITD, so as to distinguish local neighborhoods. By using vertical and parallel polarization and unpolarized light active illumination, combined with the measurements at three different detection zenith angles, we constructed a polarization texture image database. A substantial number of experimental results on the self-built database show that our proposed MODP_ITD can represent the detailed information of polarization images texture. In addition, compared with the existing LBP methods, The MODP_ITD has a competitive advantage in classification accuracy.

Automated adaptive chemistry for Large Eddy Simulations of turbulent reacting flows

Large Eddy Simulations (LES) of turbulent reacting flows carried out with detailed kinetic mechanisms have a key role for the discovery of the physical and chemical processes occurring in combustion systems, and are essential for the development of efficient, stable, and non-pollutant technologies. Nevertheless, these simulations require a large amount of computational resources, making their utilization for large-scale systems, such as industrial burners and gas turbines, impractical. In this work, we combine state-of-the-art machine learning algorithms and model reduction methods to deliver a fully automated strategy for performing LES with adaptive chemistry. This strategy is based on the Sample-Partitioning Adaptive Chemistry (SPARC) algorithmic procedure, which consists of four steps: the generation of a training dataset, its partitioning in clusters, the generation of a set of reduced chemical mechanisms specifically tailored to each cluster and, lastly, the numerical simulation of the case of interest with adaptive chemistry enabled by an on-the-fly classification of every grid point.The SPARC approach has already been demonstrated to substantially reduce the computational effort of reactive flows simulations. However a non-negligible level of user interventions is needed, upon which the method’s success critically depend. Therefore, with the goal of boosting the performance of this workflow and minimise the user-specified degrees of freedom, we plug in and exploit the Local Principal Component Analysis augmented with an automated Bayesian-optimised search for optimal clustering solutions, and the Computational Singular Perturbation method with an additional layer of automation based on the Tangential Stretching Rate for minimally-sized reduced mechanisms. We employ a cheap and easy-to-generate 1-dimensional-flames training database and we demonstrate the efficiency, accuracy and robustness of this strategy with an application to LES of the Adelaide Jet in Hot Coflow (AJHC) burner, a turbulent reacting flow exhibiting intense turbulence-chemistry interactions.

Leukemia Blood Cells Detection using Neural Network Classifier

Image segmentation is an image processing operation performed on the image in order to partition the image into some images based on the information contained in the original image. Image segmentation plays an important role in many medical imaging applications, image segmentation facilitates the anatomy process in a particular body of human body. Classification and clustering are the methods used un data mining for analyzing the data sets and divide them on the basis of some particular classification rules. There are many image segmentation tools that used for medical purpose, so it is necessary to define and/or to improve the image segmentation methods in order to get the best method. In this study, the image of leukemia and red blood cells will be used as samples to determine the best algorithm in image segmentation. The procedure for doing segmentation itself is clustering image, edge detection on image, and image classification. The clustering is to extract important information from an image. The edge detection is to determine the existence of edges of lines in image in order to investigate and localize the desired edge features. Moreover, the classification analyzes the properties of some images and organizes the information into certain categories. In this study, the Neural Network and K-Nearest Neighbor are used for image classification by paired with Local Binary Pattern and Principal Component Analysis. The results revealed that the best method of proven in classifying images is from Local Binary Pattern feature extraction with the average accuracy of 94%.

Adaptive local Principal Component Analysis improves the clustering of high-dimensional data

In local Principal Component Analysis (PCA), a distribution is approximated by multiple units, each representing a local region by a hyper-ellipsoid obtained through PCA. We present an extension for local PCA which adaptively adjusts both the learning rate of each unit and the potential function which guides the competition between the local units. Our local PCA method is an online neural network method where unit centers and shapes are modified after the presentation of each data point. For several benchmark distributions, we demonstrate that our method improves the overall quality of clustering, especially for high-dimensional distributions where many conventional methods do not perform satisfactorily. Our online method is also well suited for the processing of streaming data: The two adaptive mechanisms lead to a quick reorganization of the clustering when the underlying distribution changes.

A method for detecting tomato canopies’ phenotypic traits based on improved skeleton extraction algorithm

Automatic acquisition of tomato canopies’ phenotypic traits is essential for tomato varieties’ selection and scientific cultivation. Due to the infinite growth characteristics of tomato, its organ development is stochastic and the canopies' internal structure of is also complex. These make it challenging to obtain organs’ detailed phenotypic traits. Thus, this work proposed a method for detecting tomato canopies’ phenotypic traits based on improved skeleton extraction algorithm (ISEA). Firstly, after collecting tomato canopies' point cloud data from multiple perspectives, this work reconstructed its three-dimensional (3D) model accurately. Secondly, the least squares method was used to simplify the spatial contraction model of the Laplace Skeleton Extraction algorithm to obtain the tomatoes’ skeleton point set. On this basic, Greedy algorithm was used to optimise the Edge Collapse algorithm to extract more accurate and reliable skeleton structure. Then, in conjunction with the canopy growth characteristics of the crop and the Intrinsic Shape Signatures (ISS) principle, the simplified skeleton structure was subjected to local principal component analysis (PCA), which achieved the separation of tomatoes’ main stem and leaves. Finally, a modelling algorithm based on Delaunay triangulation was applied to construct the separated organs’ model to calculate phenotypic traits such as stem diameter, leaf area index and average leaf inclination. The calculated results were also compared with the measured values at different growth stages for performance evaluation. The average precision, average recall, average accuracy and micro F1 score of ISEA were 0.9144, 0.7751, 0.7243 and 0.8306, respectively. The overall R2 between calculated values and measured values for stem diameter, leaf area index and average leaf inclination were 0.9638, 0.9067, and 0.9428, and the root mean square errors (RMSE) were 0.3922, 0.0029, and 0.0186, respectively. As a result, the proposed method can extract a simple skeleton from the complex tomato canopy and calculate phenotypic traits accurately. It also provided solid technical support for studying the interaction about “genotype-phenotype-envirotype” in tomato.

Lie PCA: Density estimation for symmetric manifolds

We introduce an extension to local principal component analysis for learning symmetric manifolds. In particular, we use a spectral method to approximate the Lie algebra corresponding to the symmetry group of the underlying manifold. We derive the sample complexity of our method for a variety of manifolds before applying it to various data sets for improved density estimation.

Unsupervised long-term damage detection in an uncontrolled environment through optimal autoencoder

Unsupervised damage detection in the presence of both regular environmental variations, such as a daily change in temperature and humidity, and irregular environmental variations, such as rain and snow, remains a critical challenge in guided wave structural health monitoring. This paper proposes an optimal autoencoder-based damage detection strategy to solve this problem. Although the autoencoder and other neural networks have been used to detect anomalies in structural health monitoring, the training data has been also required to be collected from a known intact structure, which increases the time and labor cost for inspection and limits the application of such methods. Instead, our autoencoder is trained with guided wave data that contain uncontrolled regular, irregular, and damage variations. We investigate hyperparameters that will negatively influence autoencoder-based damage detection, including the training time and damage duration. We also propose sparsity, dropout, and weight decay regularization strategies to enhance the robustness of the autoencoder to these hyperparameters. Results show that our optimal autoencoder method can achieve an area under the receiver operating curve score near 0.92 for detecting damage present in the last 16 days, which improves previous local principal components analysis reconstruction methods with a score of 0.88.

Estimation and Inference on Time-Varying FAVAR Models

ABSTRACT We introduce a time-varying (TV) factor-augmented vector autoregressive (FAVAR) model to capture the TV behavior in the factor loadings and the VAR coefficients. To consistently estimate the TV parameters, we first obtain the unobserved common factors via the local principal component analysis (PCA) and then estimate the TV-FAVAR model via a local smoothing approach. The limiting distribution of the proposed estimators is established. To gauge possible sources of TV features in the FAVAR model, we propose three L 2 -distance-based test statistics and study their asymptotic properties under the null and local alternatives. Simulation studies demonstrate the excellent finite sample performance of the proposed estimators and tests. In an empirical application to the U.S. macroeconomic dataset, we document overwhelming evidence of structural changes in the FAVAR model and show that the TV-FAVAR model outperforms the conventional time-invariant FAVAR model in predicting certain key macroeconomic series.

Acetazolamide-augmented BOLD MRI to Assess Whole-Brain Cerebrovascular Reactivity in Chronic Steno-occlusive Disease Using Principal Component Analysis.

Background Exhaustion of cerebrovascular reactivity (CVR) portends increased stroke risk. Acetazolamide-augmented blood oxygenation level-dependent (BOLD) MRI has been used to estimate CVR, but low signal-to-noise conditions relegate its use to terminal CVR (CVRend) measurements that neglect dynamic features of CVR. Purpose To demonstrate comprehensive characterization of acetazolamide-augmented BOLD MRI response in chronic steno-occlusive disease using a computational framework to precondition signal time courses for dynamic whole-brain CVR analysis. Materials and Methods This study focused on retrospective analysis of consecutive patients with unilateral chronic steno-occlusive disease who underwent acetazolamide-augmented BOLD imaging for recurrent minor stroke or transient ischemic attack at an academic medical center between May 2017 and October 2020. A custom principal component analysis-based denoising pipeline was used to correct spatially varying non-signal-bearing contributions obtained by a local principal component analysis of the MRI time series. Standard voxelwise CVRend maps representing terminal responses were produced and compared with maximal CVR (CVRmax) as isolated from binned (per-repetition time) denoised BOLD time course. A linear mixed-effects model was used to compare CVRmax and CVRend in healthy and diseased hemispheres. Results A total of 23 patients (median age, 51 years; IQR, 42-61, 13 men) who underwent 32 BOLD examinations were included. Processed MRI data showed twofold improvement in signal-to-noise ratio, allowing improved isolation of dynamic characteristics in signal time course for sliding window CVRmax analysis to the level of each BOLD repetition time (approximately 2 seconds). Mean CVRmax was significantly higher than mean CVRend in diseased (5.2% vs 3.8%, P < .01) and healthy (5.5% vs 4.0%, P < .01) hemispheres. Several distinct time-signal signatures were observed, including nonresponsive; delayed/blunted; brisk; and occasionally nonmonotonic time courses with paradoxical features in normal and abnormal tissues (ie, steal and reverse-steal patterns). Conclusion A principal component analysis-based computational framework for analysis of acetazolamide-augmented BOLD imaging can be used to measure unsustained CVRmax through twofold improvements in signal-to-noise ratio. © RSNA, 2023 Supplemental material is available for this article.

Understanding Drug Resistance of Wild-Type and L38HL Insertion Mutant of HIV-1 C Protease to Saquinavir.

Acquired immunodeficiency syndrome (AIDS) is one of the most challenging infectious diseases to treat on a global scale. Understanding the mechanisms underlying the development of drug resistance is necessary for novel therapeutics. HIV subtype C is known to harbor mutations at critical positions of HIV aspartic protease compared to HIV subtype B, which affects the binding affinity. Recently, a novel double-insertion mutation at codon 38 (L38HL) was characterized in HIV subtype C protease, whose effects on the interaction with protease inhibitors are hitherto unknown. In this study, the potential of L38HL double-insertion in HIV subtype C protease to induce a drug resistance phenotype towards the protease inhibitor, Saquinavir (SQV), was probed using various computational techniques, such as molecular dynamics simulations, binding free energy calculations, local conformational changes and principal component analysis. The results indicate that the L38HL mutation exhibits an increase in flexibility at the hinge and flap regions with a decrease in the binding affinity of SQV in comparison with wild-type HIV protease C. Further, we observed a wide opening at the binding site in the L38HL variant due to an alteration in flap dynamics, leading to a decrease in interactions with the binding site of the mutant protease. It is supported by an altered direction of motion of flap residues in the L38HL variant compared with the wild-type. These results provide deep insights into understanding the potential drug resistance phenotype in infected individuals.

패널데이터를 이용한 양식 송어 출하량 결정함수 추정

This study is to analyze the factors of affecting shipment by estimating the shipment determination function of farmed trout. As a result of principal component analysis, it was confirmed that the first principal component showed an eigenvalue of 2.8842 and explained about 58% of the total breeding quantity. Also, as a result of the Hausman test, the null hypothesis was rejected, so the random effect model was adopted. The likelihood ratio test was performed to select the forms of the Cobb-Douglas function and the Trans-log function, and as a result of the LR test, the form of the Trans-log function was adopted at a significance level of 5%. After estimating the form of trans-log shipment determination function, shipment elasticity and marginal shipment were calculated. As a whole, it was confirmed that the local price, fry provision, and principal component of breeding volume affect the shipment. Among them, local price was analyzed to have the greatest influence. In addition, as a result of dividing the province into Gangwon, Chungbuk, Gyongbuk and testing the returns to scale, Gangwon was in a state of constant returns to scale. However, Chungbuk and Gyongbuk were in a state of decreasing returns to scale.

Multi-Feature Integrated Concurrent Neural Network for Human Facial Expression Recognition

&lt;p&gt;Facial expression helps to communicate between the people for conveying abundant information about human emotions. Facial expression classification is applied in various fields such as remote learning education, medical care, and smart traffic. However, due to the complexity and diversity of the facial emotions, the present facial expression recognition model causes a low recognition rate and it is hard to extract the precise features that are related to facial expression changes. In order to overcome this problem, we proposed Multi-feature Integrated Concurrent Neural Network (MICNN) which is significantly different from the single neural network architectures. It aggregates the prominent features of facial expressions by integrating the three kinds of networks such as Sequential Convolutional Neural Network (SCNN), Residual Dense Network (RDN), and Attention Residual Learning Network (ARLN) to enhance the accuracy rate of facial emotions detection system. Additionally, Local Binary Pattern (LBP) and Principal Component Analysis (PCA) are applied for representing the facial features and these features are combined with the texture features identified by the Gray-level Co-occurrence Matrix (GLCM). Finally, the integrated features are fed into softmax layer to classify the facial images. The experiments are carried out on benchmark datasets by applying k-fold cross-validation and the results demonstrate the superiority of the proposed model.&lt;/p&gt; &lt;p&gt;&amp;nbsp;&lt;/p&gt;

Stable generalized finite element method (SGFEM) for three-dimensional crack problems

This paper proposes a stable generalized finite element method (SGFEM) for the linear 3D elasticity problem with cracked domains. Conventional material-independent branch functions serve as singular enrichments. We prove that the proposed SGFEM with the geometric enrichment scheme yields the optimal order of convergence in the energy norm, O(h), for fully 3D elasticity planar crack problems; h is the mesh parameter. To improve the conditioning of SGFEM, two stability techniques have been employed, namely, (a) a cubic polynomial has been used as the PU (partition of unity), instead of the standard FE hat-functions, to address the possible almost linear dependence between the PU functions and the enrichments, and (b) a local principal component analysis (LPCA) has been implemented to address the local bad conditioning produced by multi-fold enrichments at a node. The scaled condition number for the proposed SGFEM is shown to be O(h^{-2}) (same as that of a standard Finite Element Method), for various relative positions of crack surface and mesh. The robustness of the scaled condition number for the proposed SGFEM, with respect to the relative positions of the crack-surface and the element boundaries, has been observed numerically. The numerical experiments for both the planar and fully 3D planar crack problems are presented to show the efficiency of the proposed SGFEM.