Gaussian Processes For Machine Learning Research Articles

Comparison of Machine Learning Algorithms for Structure State Prediction in Operational Load Monitoring.

The aim of operational load monitoring is to make predictions about the remaining usability time of structures, which is extremely useful in aerospace industry where in-service life of aircraft structural components can be maximized, taking into account safety. In order to make such predictions, strain sensors are mounted to the structure, from which data are acquired during operational time. This allows to determine how many load cycles has the structure withstood so far. Continuous monitoring of the strain distribution of the whole structure can be complicated due to vicissitude nature of the loads. Sensors should be mounted in places where stress and strain accumulations occur, and due to experiencing variable loads, the number of required sensors may be high. In this work, different machine learning and artificial intelligence algorithms are implemented to predict the current safety factor of the structure in its most stressed point, based on relatively low number of strain measurements. Adaptive neuro-fuzzy inference systems (ANFIS), support-vector machines (SVM) and Gaussian processes for machine learning (GPML) are trained with simulation data, and their effectiveness is measured using data obtained from experiments. The proposed methods are compared to the earlier work where artificial neural networks (ANN) were proven to be efficiently used for reduction of the number of sensors in operational load monitoring processes. A numerical comparison of accuracy and computational time (taking into account possible real-time applications) between all considered methods is provided.

A Gaussian process-based definition reveals new and bona fide genetic interactions compared to a multiplicative model in the Gram-negative Escherichia coli.

A digenic genetic interaction (GI) is observed when mutations in two genes within the same organism yield a phenotype that is different from the expected, given each mutation's individual effects. While multiplicative scoring is widely applied to define GIs, revealing underlying gene functions, it remains unclear if it is the most suitable choice for scoring GIs in Escherichia coli. Here, we assess many different definitions, including the multiplicative model, for mapping functional links between genes and pathways in E.coli. Using our published E.coli GI datasets, we show computationally that a machine learning Gaussian process (GP)-based definition better identifies functional associations among genes than a multiplicative model, which we have experimentally confirmed on a set of gene pairs. Overall, the GP definition improves the detection of GIs, biological reasoning of epistatic connectivity, as well as the quality of GI maps in E.coli, and, potentially, other microbes. The source code and parameters used to generate the machine learning models in WEKA software were provided in the Supplementary information. Supplementary data are available at Bioinformatics online.

Voxel-based automated detection of focal cortical dysplasia lesions using diffusion tensor imaging and T2-weighted MRI data

The aim of this study was to automatically detect focal cortical dysplasia (FCD) lesions in patients with extratemporal lobe epilepsy by relying on diffusion tensor imaging (DTI) and T2-weighted magnetic resonance imaging (MRI) data. We implemented an automated classifier using voxel-based multimodal features to identify gray and white matter abnormalities of FCD in patient cohorts. In addition to the commonly used T2-weighted image intensity feature, DTI-based features were also utilized. A Gaussian processes for machine learning (GPML) classifier was tested on 12 patients with FCD (8 with histologically confirmed FCD) scanned at 1.5 T and cross-validated using a leave-one-out strategy. Moreover, we compared the multimodal GPML paradigm's performance with that of single modal GPML and classical support vector machine (SVM). Our results demonstrated that the GPML performance on DTI-based features (mean AUC = 0.63) matches with the GPML performance on T2-weighted image intensity feature (mean AUC = 0.64). More promisingly, GPML yielded significantly improved performance (mean AUC = 0.76) when applying DTI-based features to multimodal paradigm. Based on the results, it can also be clearly stated that the proposed GPML strategy performed better and is robust to unbalanced dataset contrary to SVM that performed poorly (AUC = 0.69). Therefore, the GPML paradigm using multimodal MRI data containing DTI modality has promising result towards detection of the FCD lesions and provides an effective direction for future researches.

Comparison of adaptive neuro-fuzzy inference system (ANFIS) and Gaussian processes for machine learning (GPML) algorithms for the prediction of skin temperature in lower limb prostheses

Monitoring of the interface temperature at skin level in lower-limb prosthesis is notoriously complicated. This is due to the flexible nature of the interface liners used impeding the required consistent positioning of the temperature sensors during donning and doffing. Predicting the in-socket residual limb temperature by monitoring the temperature between socket and liner rather than skin and liner could be an important step in alleviating complaints on increased temperature and perspiration in prosthetic sockets. In this work, we propose to implement an adaptive neuro fuzzy inference strategy (ANFIS) to predict the in-socket residual limb temperature. ANFIS belongs to the family of fused neuro fuzzy system in which the fuzzy system is incorporated in a framework which is adaptive in nature. The proposed method is compared to our earlier work using Gaussian processes for machine learning. By comparing the predicted and actual data, results indicate that both the modeling techniques have comparable performance metrics and can be efficiently used for non-invasive temperature monitoring.

Comparing the performance of multispectral vegetation indices and machine-learning algorithms for remote estimation of chlorophyll content: a case study in the Sundarbans mangrove forest

Optical vegetation indices (VIs) have been used to retrieve and assess biophysical variables from satellite reflectance data. These indices, however, also are sensitive to a number of confounding factors, such as canopy geometry, soil optical properties, and solar position. This suggests that VIs should be used cautiously for biophysical parameter estimation. Among biophysical variables, chlorophyll content is of particular importance as an indicator of photosynthetic activity. The goal of this study is to investigate the performance of multispectral optical VIs for chlorophyll content estimation in the world’s largest mangrove forest, the Sundarbans, and to compare these with machine-learning algorithms (MLAs). To this end, we have investigated the performance of 15 multispectral VIs and six state-of-the-art MLAs that are widely used for adaptive data fitting. The MLAs are Artificial Neural Networks (ANNs), Genetic Algorithm (GA), Gaussian Processes for Machine Learning (GPML), Kernel Ridge Regression (KRR), Locally Weighted Polynomials (LWP), and Multivariate Adaptive Regression Splines (MARS). We use an in situ data set of reflectance and chlorophyll measurements to develop and validate our models. Each MLA was evaluated 500 times with random partitions of training and validation data. Results showed that the weight optimization and term selection used within GA produce the most reliable chlorophyll content estimation. However, green normalized difference VI (GNDVI) is a simple and computationally efficient VI that produces results that are nearly as accurate as GA in terms of model fit and performance. Results also show that all methods except ANNs and MARS produce a quasi-linear relationship between spectral reflectance and chlorophyll content. Statistical transformations of GNDVI and chlorophyll content have the capability of further reducing model error.

Gaussian Processes for Machine Learning (GPML) Toolbox

The GPML toolbox provides a wide range of functionality for Gaussian process (GP) inference and prediction. GPs are specified by mean and covariance functions; we offer a library of simple mean and covariance functions and mechanisms to compose more complex ones. Several likelihood functions are supported including Gaussian and heavy-tailed for regression as well as others suitable for classification. Finally, a range of inference methods is provided, including exact and variational inference, Expectation Propagation, and Laplace's method dealing with non-Gaussian likelihoods and FITC for dealing with large regression tasks.

Digital Communication Receivers Using Gaussian Processes for Machine Learning

We propose Gaussian processes (GPs) as a novel nonlinear receiver for digital communication systems. The GPs framework can be used to solve both classification (GPC) and regression (GPR) problems. The minimum mean squared error solution is the expectation of the transmitted symbol given the information at the receiver, which is a nonlinear function of the received symbols for discrete inputs. GPR can be presented as a nonlinear MMSE estimator and thus capable of achieving optimal performance from MMSE viewpoint. Also, the design of digital communication receivers can be viewed as a detection problem, for which GPC is specially suited as it assigns posterior probabilities to each transmitted symbol. We explore the suitability of GPs as nonlinear digital communication receivers. GPs are Bayesian machine learning tools that formulates a likelihood function for its hyperparameters, which can then be set optimally. GPs outperform state-of-the-art nonlinear machine learning approaches that prespecify their hyperparameters or rely on cross validation. We illustrate the advantages of GPs as digital communication receivers for linear and nonlinear channel models for short training sequences and compare them to state-of-the-art nonlinear machine learning tools, such as support vector machines.