Probabilistic Features Research Articles

Data-based approach for time-correlated closures of turbulence models.

Developed turbulent motion of fluid still lacks an analytical description despite more than a century of active research. Nowadays, phenomenological ideas are widely used in practical applications, such as small-scale closures for numerical simulations of turbulent flows. In the present paper, we use a shell model of turbulence to construct a closure intended to have a solid theoretical background and to capture intrinsic probabilistic features of turbulence. Shell models of turbulence are dynamical deterministic systems used to model energy cascade and other key aspects of the Navier-Stokes such as intermittency. We rescale the variables of the Sabra model in a way which leads to hidden symmetries and universal distributions. We then use such fine distributions to write closures, i.e., missing expressions for some of the Sabra variables. Our closures rely on approximating probability density functions using a Gaussian mixture model, which makes them probabilistic by nature and allows us to write time-correlated closures. We also provide a framework where other machine learning tools can be employed with reduced black-box aspects.

Selected Aspects of Precision Grinding Processes Optimization.

The paper describes selected aspects of the optimization of grinding processes, taking into account the characteristic probabilistic features of this process. Characteristic features of the grinding process that influence the significant dispersion of the quantities used in the optimization process to define goals and limitations are indicated. Attention was paid to the reasons for uncertainty in the use of research results, imperfections in information extraction procedures and the limited amount of data in the use of simulation and regression models in optimization procedures. The issue of determining the durability of abrasive tools in grinding process optimization procedures was analyzed. Methodologies for defining tool life are specified, taking into account the dispersion of the values of controlled process parameters. The effects of interference were taken into account in the relationships describing grinding efficiency and costs. The benefits of optimization taking into account the probabilistic nature of the process were determined.

Probabilistic feature selection for improved asset lifetime estimation in renewables. Application to transformers in photovoltaic power plants

The increased penetration of renewable energy sources (RESs) as an effective mechanism to reduce carbon emissions leads to an increased weather dependency for power and energy systems. This has created dynamic operation and degradation phenomena, which affect the lifetime estimation of the assets operated with RESs. For the reliable and efficient operation of RES it is crucial to monitor the health of its constituent components and feature selection is a crucial step for building robust and accurate health monitoring approaches. In this context, this paper presents a probabilistic feature selection approach, which probabilistically weights and selects features through a heuristic and iterative process for an improved asset lifetime estimation. Power transformers are key power grid assets and they are used to demonstrate the validity and impact of the proposed approach. The approach is tested on two different photovoltaic power plants operated in Spain and Australia. Results consistently show that the proposed feature-selection approach reduces the prediction error and consistently selects relevant features. The approach has been applied to transformer lifetime estimation, but it can be generally applied to assist in the lifetime estimation of other components operated in RESs. Part of the studies presented here as well as source codes are all open-source under the GitHub repository https://github.com/iramirezg/FeatureSelection.

Continual Learning-Based Probabilistic Slow Feature Analysis for Monitoring Multimode Nonstationary Processes

A novel continual learning-based probabilistic slow feature analysis algorithm is introduced for monitoring multimode nonstationary processes. Multimode slow features are extracted and an elastic weight consolidation (EWC) is adopted for sequential modes. EWC was originally introduced in the setting of machine learning of sequential multi-tasks with the aim of avoiding catastrophic forgetting issue, which equally poses as a major challenge in multimode nonstationary process monitoring. When a new mode arrives, a small set of data are collected for continual learning by the proposed algorithm. A regularization term is introduced to prevent new data from significantly interfering with the learned knowledge, where the parameter importance measures are estimated. The proposed method is referred to as PSFA–EWC, which is updated continually and is capable of achieving excellent performance. PSFA–EWC furnishes backward and forward transfer ability by a single model. The significant features of previous modes are retained while consolidating new information, which may contribute to learning new relevant modes. The effectiveness of the proposed method is demonstrated via a continuous stirred tank heater and a practical coal pulverizing system. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Note to Practitioners</i> —Since industrial systems operate in varying modes and data are nonstationary within each mode, multimode nonstationary process monitoring is increasingly important. Traditional multimode monitoring methods generally need complete data from all possible modes and may need to be retrained from scratch when a new mode arrives, which require expensive computation and storage resources. Besides, it is difficult to distinguish real faults from normal variations in multimode nonstationary processes. This paper proposes a novel continual learning-based probabilistic slow feature analysis, where elastic weight consolidation is employed to consolidate the previously learned knowledge while extracting multimode slow features. The monitoring model is updated sequentially and provides backward as well as forward transfer learning ability for successive modes. It is able to separate real faults from normal dynamics, which is beneficial to identifying a new mode for multimode nonstationary processes. In addition, the proposed approach delivers excellent model interpretability and deals with missing data as well as uncertainty. In industrial applications, such as power plants and intelligent manufacturing processes, the proposed method can provide excellent monitoring performance.

Hybrid Probabilistic Slow Feature Analysis of Continuous and Binary Data for Dynamic Process Monitoring

Hybrid Probabilistic Slow Feature Analysis of Continuous and Binary Data for Dynamic Process Monitoring

Probabilistic Adaptive Slow Feature Analysis for State Estimation and Classification

Probabilistic Adaptive Slow Feature Analysis for State Estimation and Classification

Kidney Ensemble-Net: Enhancing Renal Carcinoma Detection Through Probabilistic Feature Selection and Ensemble Learning

Kidney Ensemble-Net: Enhancing Renal Carcinoma Detection Through Probabilistic Feature Selection and Ensemble Learning

Elevating Driver Behavior Understanding With RKnD: A Novel Probabilistic Feature Engineering Approach

Elevating Driver Behavior Understanding With RKnD: A Novel Probabilistic Feature Engineering Approach

MLW-BFECF: a multi-weighted dynamic cascade forest based on bilinear feature extraction for predicting the stage of Kidney Renal Clear Cell Carcinoma on multi-modal gene data.

The stage prediction of kidney renal clear cell carcinoma (KIRC) is important for the diagnosis, personalized treatment, and prognosis of patients. Many prediction methods have been proposed, but most of them are based on unimodal gene data, and their accuracy is difficult to further improve. Therefore, we propose a novel multi-weighted dynamic cascade forest based on the bilinear feature extraction (MLW-BFECF) model for stage prediction of KIRC using multimodal gene datasets (RNA-seq, CNA, and methylation). The proposed model utilizes a dynamic cascade framework with shuffle layers to prevent early degradation of the model. In each cascade layer, a voting technique based on three gene selection algorithms is first employed to effectively retain gene features more relevant to KIRC and eliminate redundant information in gene features. Then, two new bilinear models based on the gated attention mechanism are proposed to better extract new intra-modal and inter-modal gene features; Finally, based on the idea of the bagging, a multi-weighted ensemble forest classifiers module is proposed to extract and fuse probabilistic features of the three-modal gene data. A series of experiments demonstrate that the MLW-BFECF model based on the three-modal KIRC dataset achieves the highest prediction performance with an accuracy of 88.92%.

Novel Transformer Based Contextualized Embedding and Probabilistic Features for Depression Detection From Social Media

Novel Transformer Based Contextualized Embedding and Probabilistic Features for Depression Detection From Social Media

ANNprob-ACPs: A novel anticancer peptide identifier based on probabilistic feature fusion approach

Anticancer Peptides (ACPs) offer significant potential as cancer treatment drugs in this modern era. Quickly identifying active compounds from protein sequences is crucial for healthcare and cancer treatment. In this paper ANNprob-ACPs, a novel and effective model for detecting ACPs has been implemented based on nine feature encoding techniques, including AAC, CC, W2V, DPC, PAAC, QSO, CTDC, CTDT, and CKSAAGP. After analyzing the performance of several machine learning models, the six best models were selected based on their overall performances in every evaluation metric. The probability scores of each model were subsequently aggregated and used as input of our meta- model, called ANNprob-ACPs. Our model outperformed all others and its potential to lead to phenomenal identification of ACPs. The results of this study showed notable improvement in 10-fold cross-validation and independent test, with accuracy of 93.72% and 90.62%, respectively. Our proposed model, ANNprob-ACPs outperformed existing approaches in terms of accuracy and effectiveness in discovering ACPs. By using SHAP, this study obtained the physicochemical properties of QSO, and compositional properties of DPC, AAC, and PAAC are more impactful for our model's performances, which have a major impact on a drug's interactions and future discoveries. Consequently, this model is crucial for the future and has a high probability of detecting ACPs more frequently. We developed a web server of ANNprob-ACPs, which is accessible at ANNprob-ACPs webserver.

Nonlinear autoregression-based non-destructive evaluation approach for railway tracks using an ultrasonic fiber bragg grating array

The safe operation of railway systems relies on rapid and accurate non-destructive damage detection and evaluation techniques to help rule out potential threats brought by rail track damages. In this paper, an innovative fiber Bragg grating (FBG) array-based sensing system is developed for rail defect inspection by integrating the ultrasonic testing technology, and a nonlinear autoregressive neural network with exogenous inputs (NARX) is proposed for rail damage detection based on measured ultrasonic signals. The developed sensing system can realize the high-speed and multiplexed ultrasonic signals demodulation. The NARX is proposed to process the ultrasonic signals obtained by the developed sensing system, and a specified probabilistic damage sensitive feature (DSF) is tailored to indicate rail health status, derived from the probability density function (PDF) of NARX prediction errors. To verify the proposed sensing system and damage identification algorithm, experimental studies considering four rail conditions (i.e., intact, cracked, bump, and welded conditions) are conducted in this study. First, baseline NARX models are priorly trained using ultrasonic signals acquired on an intact rail segment; then, DSFs corresponding to each condition are calculated enabling effective rail damage diagnosis. To optimize the training parameters of NARX models, three different training functions are utilized to select the most appropriate parameters that are sensitive to rail damages. Last, large-scale testing is conducted, further proving the applicability and reliability of the proposed rail damage evaluation approach. Through this study, it is suggested that integrating high-performance sensing technologies with effective data processing tools would maximumly enable efficient and robust non-destructive testing, especially on important infrastructures such as rails.

StackER: a novel SMILES-based stacked approach for the accelerated and efficient discovery of ERα and ERβ antagonists

The role of estrogen receptors (ERs) in breast cancer is of great importance in both clinical practice and scientific exploration. However, around 15–30% of those affected do not see benefits from the usual treatments owing to the innate resistance mechanisms, while 30–40% will gain resistance through treatments. In order to address this problem and facilitate community-wide efforts, machine learning (ML)-based approaches are considered one of the most cost-effective and large-scale identification methods. Herein, we propose a new SMILES-based stacked approach, termed StackER, for the accelerated and efficient identification of ERα and ERβ inhibitors. In StackER, we first established an up-to-date dataset consisting of 1,996 and 1,207 compounds for ERα and ERβ, respectively. Using the up-to-date dataset, StackER explored a wide range of different SMILES-based feature descriptors and ML algorithms in order to generate probabilistic features (PFs). Finally, the selected PFs derived from the two-step feature selection strategy were used for the development of an efficient stacked model. Both cross-validation and independent tests showed that StackER surpassed several conventional ML classifiers and the existing method in precisely predicting ERα and ERβ inhibitors. Remarkably, StackER achieved MCC values of 0.829–0.847 and 0.712–0.786 in terms of the cross-validation and independent tests, respectively, which were 5.92–8.29 and 1.59–3.45% higher than the existing method. In addition, StackER was applied to determine useful features for being ERα and ERβ inhibitors and identify FDA-approved drugs as potential ERα inhibitors in efforts to facilitate drug repurposing. This innovative stacked method is anticipated to facilitate community-wide efforts in efficiently narrowing down ER inhibitor screening.

Determining the best feature combination through text and probabilistic feature analysis for GPT-2-based mobile app review detection

Mobile apps, used by many people worldwide, have become an essential part of life. Before using a mobile app, users judge the reliability of apps according to their reviews. Therefore, app reviews are essential components of management for companies. Unfortunately, some fake reviewers write negative reviews for competing apps. Moreover, artificial intelligence (AI)-based macro bot programs that generate app reviews have emerged and can create large numbers of reviews with malicious purposes in a short time. One notable AI technology that can generate such reviews is Generative Pre-trained Transformer-2 (GPT-2). The reviews generated by GPT-2 use human-like grammar; therefore, it is difficult to detect them with only text mining techniques, which use tools like part-of-speech (POS) tagging and sentiment scores. Thus, probability-based sampling techniques in GPT-2 must be used. In this study, we identified features to detect reviews generated by GPT-2 and determined the optimal feature combination for improving detection performance. To achieve this, based on the analysis results, we built a training dataset to find the best feature combination for detecting the generated reviews. Various machine learning models were then trained and evaluated using this dataset. As a result, the model that used both text mining and probability-based sampling techniques detected generated reviews more effectively than the model that used only text mining techniques. This model achieved a top classification accuracy of 90% and a macro F1 of 0.90. We expect the results of this study to help app developers maintain a more stable mobile app ecosystem.Graphical abstract

Generalizations in Clinical Trials—Do Generics Help Or Harm?

ABSTRACT: Generalizations in medical research can be informative, but also misleading. Building on recent work in the philosophy of science and ethics of communication, I offer a novel analysis of common generalizations in clinical trials as generics in natural language. Generics, which express generalizations without terms of quantification, have attracted considerable attention from philosophers, psychologists, and linguists. My analysis draws on probabilistic and contextual features of generics to diagnose how these generalizations function and malfunction across communicative contexts in medicine. Given a high risk of misinterpretation ("slippage"), I recommend avoidance of generic claims about medical interventions in public contexts, exemplified by clinical trials and medical research more generally. Generics should only be used with vigilance in private contexts, exemplified by the physician–patient encounter. My analysis provides tools to support vigilance when communicating with generics, suggests new norms for public science communication, and raises deeper questions in the ethics of clinical communication.

Robust multi-mode probabilistic slow feature analysis with application to fault detection

This paper proposes a robust multi-mode dynamic data-driven model to identify complex industrial processes and study its application in detecting incipient faults. To model the process dynamics, a robust multi-mode probabilistic slow feature analysis (RMPSFA) is developed. A multiple switching conditional random field (MSCRF) is utilized to handle the multi-modality in the process. In order to make the model robust to the presence of outliers, a Laplace distribution is utilized to describe noise characteristics. To apply it in fault detection, several informative indices are defined. Then, the practical applicability of the proposed method is studied through an experiment on a hybrid tank pilot plant setup. Moreover, the real-life performance of the proposed model is tested on an industrial example.

Rice seed vigor detection based on near-infrared hyperspectral imaging and deep transfer learning.

Vigor is one of the important factors that affects rice yield and quality. Rapid and accurate detection of rice seed vigor is of great importance for rice production. In this study, near-infrared hyperspectral imaging technique and transfer learning were combined to detect rice seed vigor. Four varieties of artificial-aged rice seeds (Yongyou12, Yongyou1540, Suxiangjing100, and Longjingyou1212) were studied. Different convolutional neural network (CNN) models were built to detect the vigor of the rice seeds. Two transfer strategies, fine-tuning and MixStyle, were used to transfer knowledge among different rice varieties for vigor detection. The experimental results showed that the convolutional neural network model of Yongyou12 classified the vigor of Yongyou1540, Suxiangjing100, and Longjingyou1212 through MixStyle transfer knowledge, and the accuracy reached 90.00%, 80.33%, and 85.00% in validation sets, respectively, which was better or close to the initial modeling performances of each variety. MixStyle statistics are based on probabilistic mixed instance-level features of cross-source domain training samples. When training instances, new domains can be synthesized, which increases the domain diversity of the source domain, thereby improving the generalization ability of the trained model. This study would help rapid and accurate detection of a large varieties of crop seeds.

FPRnet: A lightweight multi-domain multi-stream network for complex horizontal oil-water two-phase flow pattern recognition

The complicated spatio-temporal structure of horizontal oil-water flows renders the identification of flow patterns exceedingly challenging, owing to the presence of interfacial waves and droplet entrainment. In this study, a multi-domain fusion feature (MFF) as flow pattern descriptors (FPD) and a lightweight multi-stream networks (LMN) as flow pattern classifier (FPC) are proposed to identify the flow patterns of horizontal oil-water two-phase flow. MFF can map time series into different domains and compactly encode them into higher dimensional expressions, thus displaying implicit flow pattern signals incorporating nonlinear, time-frequency, and probabilistic transition domain features. Finally, the comparison of LMN, variational and other networks is evaluated on the horizontal oil-water flows pattern identification task. Extensive comparison experiments show that the time-frequency feature exhibits optimal characterization for the D O/W flow pattern, the URP feature is most accurately characterized for the D W/O and D O/W flow patterns, and the MTF feature exhibits superior characterization for the remaining three flow patterns. The 98.40 % recognition accuracy demonstrates that MFF has a good representation of flow patterns and the proposed LMN outperforms existing classifiers in flow pattern recognition.

Robust hybrid intelligent control using probabilistic feature for active power filter

Harmonic problem in the power grid is becoming increasingly serious, which greatly threatens the stable operation and security of power system. As a reliable solution to suppress harmonics, active power filter (APF) faces with severe challenges in dealing with uncertainties for control design. To tackle this issue, an improved terminal sliding mode control (TSMC) scheme based on modified wavelet fuzzy neural network (MWFNN) is designed for APF. This fills the gap in the application of MWFNN with probabilistic feature in APF system and remedies the flaw that WFNN can't effectively handle the stochastic uncertainties before. Firstly, the dynamic model of APF considering external disturbances and component parameter perturbations is obtained according to its internal structure. Then TSMC is designed for APF, and the stability and finite time convergence are proved by Lyapunov theory. In addition, the MWFNN using probabilistic feature to enhance the advantages of wavelet neural networks is constructed to approximate the uncertain function, and adaptive laws of network parameters are also designed. Finally, compared with recurrent neural network (RNN) and TSMC by simulation and experiment, it can be found that the MWFNN has superior performance in harmonic suppression.Index Terms—Terminal sliding mode control, fuzzy neural network, wavelet fuzzy neural network, active power filter

MiPEPPred-FRL: A Novel Method for Predicting Plant MiRNA-Encoded Peptides Using Adaptive Feature Representation Learning.

MicroRNAs (miRNAs) are an essential type of small molecule RNAs that play significant regulatory roles in organisms. Recent studies have demonstrated that small open reading frames (sORFs) harbored in primary miRNAs (pri-miRNAs) can encode small peptides, known as miPEPs. Plant miPEPs can increase the abundance and activity of cognate miRNAs by promoting the transcription of their corresponding pri-miRNAs, thereby modulating plant traits. Biological experiments are the most effective way to accurately identify miPEPs; however, they are time-consuming and expensive. Hence, an efficient computational method for the identification of miPEPs on a large scale is highly desirable. Up to now, there have been no specialized computational tools for identifying miPEPs. In this work, a novel predictor named miPEPPred-FRL based on an adaptive feature representation learning framework that consists of the feature transformation module and the cascade architecture has been proposed. The feature transformation module integrating a newly designed feature selection method and classifier selection rule is developed to convert sequence-based features into primary class and probabilistic features, which are then fed into the improved cascade architecture to obtain more stable and discriminative augmented features. Finally, the augmented features are utilized to construct the final predictor. Cross-validation experiments illustrate that the novel feature selection method and classifier selection rule contribute to boosting the feature representation ability of the framework. Furthermore, the high accuracy of miPEPPred-FRL on independent testing data suggests that it is a trustworthy and valuable tool for the identification of miPEPs.