Gaussian Process Machine Research Articles

Physical Education Teaching Quality Assessment Model Based on Gaussian Process Machine Learning Algorithm

Physical education is an integral component of academic curricula focused on promoting overall health and well-being through physical activity and exercise. It encompasses a range of activities designed to enhance students' physical fitness, motor skills, and knowledge of healthy lifestyle habits. In addition to fostering physical development, physical education contributes to the development of social skills, teamwork, and discipline. Students engage in various sports, fitness routines, and educational modules that encourage a lifelong commitment to an active and healthy lifestyle. This demand for improvement in the teaching quality assessment of physical education among the students. Hence, this paper proposed a novel Gaussian Hidden Chain Probabilistic Machine Learning (GHCP-ML). The proposed GHCP-ML model estimates the features for the teaching quality assessment using the Gaussian Hidden Chain model. With the proposed GHCP-ML model features related to the teaching assessment of the physical education are computed. The proposed GHCP-ML model uses the machine learning model for the assessment and computation of the factors related to the teaching quality of students in physical education. With the Gaussian Chain model, the factors related to physical education are evaluated for the classification of the relationship between physical education and teaching quality assessment. Simulation analysis demonstrated that with the proposed GHCP-ML model physical education is improved significantly with teaching quality by ~12% than the conventional techniques. The student physical education performance is improved by more than 80% with the proposed GHCP-ML model compared with the conventional techniques.

Measuring wake deflection from SCADA data during wake steering using machine learning

As wake steering is implemented on large wind plants, methods for evaluating how well these systems optimize plant performance are needed. The data analysis from experiments conducted so far generally focuses on evaluating the improvement in power or energy production of the plant and comparing that to the predicted improvement. In this study, we explore a new approach to provide additional insight and validation of optimization tools by measuring the wake deflection experimentally using only the downstream turbine as a sensor. This approach is demonstrated using the SMARTEOLE wind plant wake steering experimental data. Light gradient boosting machines (LGBM) and Gaussian process (GP) machine learning models are trained and then interrogated by making a set of predictions under defined conditions to determine the wake deflection observed at the downstream turbine. The data set is sparse, particularly for larger yaw angles, and noisy due to factors not captured in the SCADA leading to relatively high uncertainty in the predictions. The GP model is better suited to smoothly fit this data. Using the GP model, a wake deflection of 0.35 rotor diameters at 3.7 rotor diameters downwind is estimated for a yaw error of 20 degrees on the upwind turbine.

Improving safety in mixed traffic: A learning-based model predictive control for autonomous and human-driven vehicle platooning

As autonomous vehicles (AVs) become more common on public roads, their interaction with human-driven vehicles (HVs) in mixed traffic is inevitable. This requires new control strategies for AVs to handle the unpredictable nature of HVs. This study focused on safe control in mixed-vehicle platoons consisting of both AVs and HVs, particularly during longitudinal car-following scenarios. We introduce a novel model that combines a conventional first-principles model with a Gaussian process (GP) machine learning-based model to better predict HV behavior. Our results showed a significant improvement in predicting HV speed, with a 35.64% reduction in the root mean square error compared with the use of the first-principles model alone. We developed a new control strategy called GP-MPC, which uses the proposed HV model for safer distance management between vehicles in the mixed platoon. The GP-MPC strategy effectively utilizes the capacity of the GP model to assess uncertainties, thereby significantly enhancing safety in challenging traffic scenarios, such as emergency braking scenarios. In simulations, the GP-MPC strategy outperformed the baseline MPC method, offering better safety and more efficient vehicle movement in mixed traffic.

Reservoir porosity assessment and anomaly identification from seismic attributes using Gaussian process machine learning

AbstractPorosity, as one of the reservoir properties, is an important parameter to numerous studies, i.e., the reservoir’s oil/gas volume estimation or even the storage capacity measurement in the Carbon Capture Storage (CCS) project. However, an approach to estimate porosity using elastic property from the inversion propagates its error, affecting the result’s accuracy. On the other hand, direct estimation from seismic data is another approach to estimating porosity, but it poses a high non-linear problem. Thus, we propose the non-parametric machine learning approach, Gaussian Process (GP), which draws distribution over the function to solve the high non-linear problem between seismic data with porosity and quantify the prediction uncertainty simultaneously. With the help of Random Forest (RF) as the feature selection method, the GP predictions show excellent results in the blind test, a well that is completely removed from the training data, and comparison with other machine learning models. The uncertainty, standard deviation from GP prediction, can act as a quantitative evaluation of the prediction result. Moreover, we generate a new attribute based on the quartile of the standard deviation to delineate the anomaly zones. High anomaly zones are highlighted and associated with high porosity from GP and low inverted P-impedance from inversion results. Thus, applying the GP using seismic data shows its potential to characterize the reservoir property spatially, and the uncertainty offers insights into quantitative and qualitative evaluation for hydrocarbon exploration and development.

Machine learning models for predicting the performance of solar-geothermal desalination in different meteorological conditions

This research aimed to evaluate the amount of produced fresh water (FWP) in a desalination system based on humidification-dehumidification using TRNSYS software. The study was conducted for one year, analyzing the results for five cities in Iran with different climatic conditions. Meteorological data from Meteonorm software were used for the simulation. Different heating sources, including solar energy (SE) and geothermal energy (GE), were considered in the design. The impact of using three types of collectors and the simultaneous use of SE and GE heating sources was investigated. The findings showed that using a flat plate solar collector resulted in the highest FWP in June and July, as well as during certain day time hours with increased solar radiation intensity. Increasing the number of flat plate collectors and their cross-sectional area intensified the FWP about 10.60%–33.16%. When SE and GE were used as heat sources, increasing the mass flow rate of water and air entering the system led to a decrease and increase in FWP, respectively. The highest FWP for Hamedan city was achieved when using GE simultaneously with a compound parabolic collector. Exergy destruction was analyzed for humidification and dehumidification devices, with the maximum observed in the case of Type74. The LSTM deep learning neural network and the Gaussian process (GP) machine learning algorithm were used to approximate the desalination efficiency, with the GP method exhibiting slightly higher accuracy.

A new approach to probabilistic classification based on Gaussian process and support vector machine

This paper proposes three algorithms that combine the Support Vector Machine (SVM) and Gaussian Process (GP) in a unified framework to classify large datasets efficiently and obtain probabilistic information on the classification results. The first algorithm works in two steps. In Step 1, the algorithm judiciously selects a sample of size m from the training dataset of size n, where m ≪ n. Step 2 then runs a Gaussian Process Classification (GPC) on the selected sample. The second algorithm is based on the first one, where instead of a standard GPC, a sparse GPC (a low-cost variant of standard GPC) is run in Step 2. The third algorithm is based on manipulating the Gaussian Process Regression (GPR) to classify the data. Unlike GPC, GPR uses an exact inference method that greatly reduces the computational complexity. We have experimented with seven datasets to compare the performance of the proposed algorithms with the existing state-of-the-art methodologies. In addition to providing probabilistic information, the proposed algorithms have proved to be computationally efficient, especially in the training phase, where they consistently deliver faster results than the existing algorithms. The accuracies provided by the proposed algorithms are satisfactory, and at times even surpass the accuracy obtained by the existing algorithms.

Prediction of dislocation - grain boundary interactions in FCC aluminum bicrystals using a modified continuum criterion and machine learning methods

Mechanical properties of metals such as strength and toughness are strongly correlated to complex interactions between various defects in the crystalline structure. While elementary interactions between these defects have been investigated using recent micro- and nano-characterization techniques, understanding of the detailed interaction mechanisms has hardly been obtained. To understand defect-driven plasticity at various time and length scales, it is necessary to formulate a general guideline to predict both the interaction type (transmission or reflection) and the dislocation's subsequent slip system after the interaction. Many criteria based on the geometric alignment of the defects have been developed to predict this phenomenon, but these have yet to be found to be accurate when applied to general data sets of grain boundaries (GBs). With this motivation, we conduct a systematic study using molecular dynamics (MD) models of bicrystals to analyze defect interaction process between a prismatic dislocation loop and eleven different grain boundaries of the following character: three tilt, three twist, and five mixed. Based on the MD observations, two new prediction methods are developed: the first is a new data-driven parametric score function based on the classical geometric criteria, and the second is by applying Gaussian process machine learning methods to find the probability distribution of a hidden function. The proposed data-driven prediction methods could pave a new way to predict the unit interaction of dislocations with various GBs, which could show much higher accuracy compared to pre-existing geometric criteria.

Magnesiothermic Reduction of Silica: A Machine Learning Study.

Fundamental studies have been carried out experimentally and theoretically on the magnesiothermic reduction of silica with different Mg/SiO2 molar ratios (1-4) in the temperature range of 1073 to 1373 K with different reaction times (10-240 min). Due to the kinetic barriers occurring in metallothermic reductions, the equilibrium relations calculated by the well-known thermochemical software FactSage (version 8.2) and its databanks are not adequate to describe the experimental observations. The unreacted silica core encapsulated by the reduction products can be found in some parts of laboratory samples. However, other parts of samples show that the metallothermic reduction disappears almost completely. Some quartz particles are broken into fine pieces and form many tiny cracks. Magnesium reactants are able to infiltrate the core of silica particles via tiny fracture pathways, thereby enabling the reaction to occur almost completely. The traditional unreacted core model is thus inadequate to represent such complicated reaction schemes. In the present work, an attempt is made to apply a machine learning approach using hybrid datasets in order to describe complex magnesiothermic reductions. In addition to the experimental laboratory data, equilibrium relations calculated by the thermochemical database are also introduced as boundary conditions for the magnesiothermic reductions, assuming a sufficiently long reaction time. The physics-informed Gaussian process machine (GPM) is then developed and used to describe hybrid data, given its advantages when describing small datasets. A composite kernel for the GPM is specifically developed to mitigate the overfitting problems commonly encountered when using generic kernels. Training the physics-informed Gaussian process machine (GPM) with the hybrid dataset results in a regression score of 0.9665. The trained GPM is thus used to predict the effects of Mg-SiO2 mixtures, temperatures, and reaction times on the products of a magnesiothermic reduction, that have not been covered by experiments. Additional experimental validation indicates that the GPM works well for the interpolates of the observations.

Intelligent Tracking Error Prediction and Feedforward Compensation for Nanopositioning Stages With High-Bandwidth Control

In this paper, an intelligent feedforward prediction and compensation scheme to combine with a dual-loop high-bandwidth controller is proposed for high-speed and high-precision tracking control of a nanopositioning stage. Firstly, the dual-loop controller (DLC) consisting of an inner-loop damping and an outer-loop tracking controller is developed with all the parameters optimized simultaneously, which could provide a control bandwidth over the first resonant frequency of the stage. Next, the Gaussian process (GP) machine learning model is employed to capture the dynamic characteristics of the tracking error of the dual-loop controlled plant. Then, a feedforward compensator is constructed to add a compensation term to the initial reference trajectory. Experimental investigations on a self-made piezoelectric-actuated stage validate the effectiveness of the intelligent tracking error prediction method and the excellent performance of the control strategy for high-precision tracking of high-frequency reference trajectories.

Position-based impedance torque control for automatic clutch with robust predefined-time stability guarantee

Accurate clutch torque control is essential in improving vehicle comfort, drivability, and fuel economy. In this article, for automatic clutch system with electro-hydraulic clutch actuator, a clutch torque control strategy with a robust predefined-time stability guarantee based on position closed-loop impedance control is proposed and evaluated. For this purpose, a general second order model of electro-hydraulic clutch actuator with a disturbance term is established. Based on this model, a reference position compensator based on force control in the outer loop and a predefined-time backstepping position controller in the inner loop are developed. In addition, to obtain the release load of the release bearing, a virtual sensor is designed, composed of an online adaptive sliding mode disturbance observer with predefined-time stability and an offline Gaussian process model of uncertain disturbance based on the Gaussian process machine learning method. Finally, simulations and experiments are completed to verify the proposed control strategy. The results show that the control strategy can realize the precise clutch torque tracking control and achieve satisfactory performance.

Characterization of breast lesions using multi-parametric diffusion MRI and machine learning

Objective. To investigate quantitative imaging markers based on parameters from two diffusion-weighted imaging (DWI) models, continuous-time random-walk (CTRW) and intravoxel incoherent motion (IVIM) models, for characterizing malignant and benign breast lesions by using a machine learning algorithm. Approach. With IRB approval, 40 women with histologically confirmed breast lesions (16 benign, 24 malignant) underwent DWI with 11 b-values (50 to 3000 s/mm2) at 3T. Three CTRW parameters, D m , α, and β and three IVIM parameters D diff, D perf, and f were estimated from the lesions. A histogram was generated and histogram features of skewness, variance, mean, median, interquartile range; and the value of the 10%, 25% and 75% quantiles were extracted for each parameter from the regions-of-interest. Iterative feature selection was performed using the Boruta algorithm that uses the Benjamin Hochberg False Discover Rate to first determine significant features and then to apply the Bonferroni correction to further control for false positives across multiple comparisons during the iterative procedure. Predictive performance of the significant features was evaluated using Support Vector Machine, Random Forest, Naïve Bayes, Gradient Boosted Classifier (GB), Decision Trees, AdaBoost and Gaussian Process machine learning classifiers. Main Results. The 75% quantile, and median of D m ; 75% quantile of f; mean, median, and skewness of β; kurtosis of D perf; and 75% quantile of D diff were the most significant features. The GB differentiated malignant and benign lesions with an accuracy of 0.833, an area-under-the-curve of 0.942, and an F1 score of 0.87 providing the best statistical performance (p-value < 0.05) compared to the other classifiers. Significance. Our study has demonstrated that GB with a set of histogram features from the CTRW and IVIM model parameters can effectively differentiate malignant and benign breast lesions.

Breast invasive ductal carcinoma diagnosis using machine learning models and Gabor filter method of histology images

Breast cancer is the most common type of cancer in women and the leading cause of death from a malignant growth in the world. Machine learning methods have been created to help with cancer detection accuracy. There are several methods for detecting cancer. Histopathological images are more accurate. In this study, we employed the Gabor filter to extract statistical features from invasive ductal carcinoma histopathology images. From the histopathological images, we chose 100, 200, 400, 1000, and 2000 at random. These statistical features were used to train several models to classify these images as malignant or benign, including the decision tree, quadratic discriminant analysis, extra randomized trees, gradient boosting, Gaussian process, Naive Bayes, nearest centroid, multilayer perceptron, and support vector machine. The models' accuracy, sensitivity, specificity, precision, and F1_score were examined. The models produced the highest results when there were 100 images and a wavenumber of 0.2. While as the number of images increased, the models' effectiveness reduced. The most obvious finding to emerge from this study is that we suggest using deep learning instead of machine learning models for large datasets.

Vehicle stochastic response prediction of sea-crossing railway bridges under correlated wind and wave via machine learning

Offshore railway bridges are exposed to the complex coastal environment, and vehicles could experience significant responses when vehicles cross the sea-crossing bridge. To predict the vehicle response subjected to the stochastic excitations (wind and wave actions), Archimedes copulas are applied to identify the correlation between wind speed and wave height. Based on the Gibbs sampling, an algorithm of Markov Chain Monte Carlo (MCMC), training samples are sampled from the optimal copula model (e.g., Clayton copula) as the input parameters. Taking a representative vehicle-bridge model as the study object, wind tunnel and wave flume scaling tests are performed to obtain the aerodynamic characteristics with the influence of wave surface. The external loads are calculated using the Morison equation and the MacCamy-Fuchs equation. Vehicle indexes as the output parameters are quantified using Support Vector Machine (SVM), Gaussian Process (GP), and Neural Network (NN) Machine Learning (ML) method. Training and testing results indicate that the NN algorithm outperforms other training strategies even though SVM and GP reasonably predict the vehicle dynamic response. Since the wind and wave action is lateral, vertical acceleration performs insensitivity to input parameters and is mainly influenced by track irregularity.

Machine Learning Techniques for Evaluating Concrete Strength with Waste Marble Powder.

The purpose of the research is to predict the compressive and flexural strengths of the concrete mix by using waste marble powder as a partial replacement of cement and sand, based on the experimental data that was acquired from the laboratory tests. In order to accomplish the goal, the models of Support vector machines, Support vector machines with bagging and Stochastic, Linear regression, and Gaussian processes were applied to the experimental data for predicting the compressive and flexural strength of concrete. The effectiveness of models was also evaluated by using statistical criteria. Therefore, it can be inferred that the gaussian process and support vector machine methods can be used to predict the respective outputs, i.e., flexural and compressive strength. The Gaussian process and Support vector machines Stochastic predicts better outcomes for flexural and compressive strength because it has a higher coefficient of correlation (0.8235 and 0.9462), lower mean absolute and root mean squared error values as (2.2808 and 1.8104) and (2.8527 and 2.3430), respectively. Results suggest that all applied techniques are reliable for predicting the compressive and flexural strength of concrete and are able to reduce the experimental work time. In comparison to input factors for this data set, the number of curing days followed by the CA, C, FA, w, and MP is essential in predicting the flexural and compressive strength of a concrete mix for this data set.

A Machine Learning Approach for Rate Constants. III. Application to the Cl(2P) + CH4 → CH3 + HCl Reaction.

The temperature dependence of the thermal rate constant for the reaction Cl(3P) + CH4 → HCl + CH3 is calculated using a Gaussian Process machine learning (ML) approach to train on and predict thermal rate constants over a large temperature range. Following procedures developed in two previous reports, we use a training data set of approximately 40 reaction/potential surface combinations, each of which is used to calculate the corresponding database of rate constant at approximately eight temperatures. For the current application, we train on the entire data set and then predict the temperature dependence of the title reaction employing a "split" data set for correction at low and high temperatures to capture both tunneling and recrossing. The results are an improvement on recent RPMD calculations compared to accurate quantum ones, using the same high-level ab initio potential energy surface. Both tunneling at low temperatures and significant recrossing at high temperatures are observed to influence the rate constants. The recrossing effects, which are not described by TST and even sophisticated tunneling corrections, do appear in experiment at temperatures above around 600 K. The ML results describe these effects and in fact merge at 600 K with RPMD results (which can describe recrossing), and both are close to experiment at the highest experimental temperatures. These results are in accord with a recent high-level experiment-theory study of this reaction.

Machine Learning-Empowered Beam Management for mmWave-NOMA in Multi-UAVs Networks

We consider a mission-driven multiple unmanned aerial vehicles (multi-UAVs) network with millimeter-wave (mmWave) transmissions, where a leader UAV (LUAV) communicates with a large number of follower UAVs (FUAVs) simultaneously via a uniform planar array with only a limited number of radio frequency chains. Since only a few orthogonal beams are available and mission-driven UAV networks are autonomous and delay-sensitive, non-orthogonal multiple access (NOMA) over these beams is considered for agility and efficiency. In particular, aiming to address these challenges of highly dynamic mobility, we propose a machine learning framework to enable agile analog beam management for mmWave-NOMA transmissions. The proposed beam management aims to achieve efficient beam tracking and NOMA-grouping-aware analog beamforming optimization to facilitate mmWave-NOMA transmissions by judiciously utilizing angular domain information (ADI). More specifically, a Gaussian process machine learning-based ADI prediction scheme is proposed to track the angular dynamics of FUAVs, which facilitates fast beam-tracking for mmWave-NOMA transmissions. Moreover, by exploiting the predicted ADI, an unsupervised-learning-based FUAV grouping scheme is proposed to facilitate mmWave-NOMA transmissions with high radio-frequency chain efficiency, while a deep learning-based NOMA-grouping-aware fast transmit beamforming optimization scheme is proposed to improve the coverage of mmWave-NOMA transmissions in highly dynamic multi-UAVs networks. Simulation results validate the performance advantages of our proposed beam management scheme against state-of-the-art schemes.

Machine learning-based method to adjust electron anomalous conductivity profile to experimentally measured operating parameters of Hall thruster

The problem of determining the electron anomalous conductivity profile in a Hall thruster, when its operating parameters are known from the experiment, is considered. To solve the problem, we propose varying the parametrically set anomalous conductivity profile until the calculated operating parameters match the experimentally measured ones in the best way. The axial 1D3V hybrid model was used to calculate the operating parameters with parametrically set conductivity. Variation of the conductivity profile was performed using Bayesian optimization with a Gaussian process (machine learning method), which can resolve all local minima, even for noisy functions. The calculated solution corresponding to the measured operating parameters of a Hall thruster in the best way proved to be unique for the studied operating modes of KM-88. The local plasma parameters were calculated and compared to the measured ones for four different operating modes. The results show the qualitative agreement. An agreement between calculated and measured local parameters can be improved with a more accurate model of plasma-wall interaction.

Modeling and Optimizing the Impact of Process and Equipment Parameters in Sputtering Deposition Systems Using a Gaussian Process Machine Learning Framework

We present a method for empirically modeling and optimizing variations in sputtering deposition processes using Gaussian Process (GP) machine learning methods. Our predictive models can be trained with limited training data to enable rapid sputtering process tuning. As a first case, we model the effect of process recipe parameters such as chamber pressure and power on sputtered film thickness uniformity. A second more challenging case is also demonstrated: modeling film thickness spatial uniformity as a function of equipment configuration parameters. The effects of the chamber configuration variables are complex, motivating incorporation of prior process knowledge into the GP framework by utilizing a physics-based solver. Because adjusting equipment configuration parameters and obtaining corresponding wafer fabrication data is costly, a key metric is the expected number of tunes required until process constraints are met. Using past experimental data, we show that tunes using the GP-based predictive model are expected to converge in significantly fewer iterations compared to tunes using polynomial, gradient boosted regression tree, multivariate spline, and deep learning based modeling methods.

Atomistic and machine learning studies of solute segregation in metastable grain boundaries

The interaction of alloying elements with grain boundaries (GBs) influences many phenomena, such as microstructural evolution and transport. While GB solute segregation has been the subject of active research in recent years, most studies focus on ground-state GB structures, i.e., lowest energy GBs. The impact of GB metastability on solute segregation remains poorly understood. Herein, we leverage atomistic simulations to generate metastable structures for a series of [001] and [110] symmetric tilt GBs in a model Al–Mg system and quantify Mg segregation to individual sites within these boundaries. Our results show large variations in the atomic Voronoi volume due to GB metastability, which are found to influence the segregation energy. The atomistic data are then used to train a Gaussian Process machine learning model, which provides a probabilistic description of the GB segregation energy in terms of the local atomic environment. In broad terms, our approach extends existing GB segregation models by accounting for variability due to GB metastability, where the segregation energy is treated as a distribution rather than a single-valued quantity.

Gaussian Process Regression and Machine Learning Methods for Carbon-Based Material Adsorption

Antibiotics have received a lot of attention as promising contaminants because of their ecotoxicological and long-term chemical stability in the atmosphere. Antibiotic adsorption on carbon-based materials (CBMs) such as charcoal and activated carbon has been identified as mainly effective for treating the wastewater strategies. Machine learning (ML) approaches were used to create generalized computation methods for tetracycline (TC) and sulfamethoxazole (SMX) adsorption in CBMs in this investigation. In the existing system, random forest and ANN methods were used for TC and SMX for predicting the quantities of antibiotics in the CBMs. For reducing the antibiotics from the industrial wastewater, the broadcast efforts of the experiments are a little complicated. In the proposed method, Gaussian process regression (GPR), active learning (AL), and ANN are used for predicting the antibiotic levels in the industrial wastewater. Below a variety of environmental parameters (e.g., warmth, solution pH) and adsorbent varieties, the created Ml algorithms outperformed classic isotherm models in conditions of generalisation. To evaluate TC and SMX adsorption on CBMs, we used comparative significance investigation and partial trust plots based on ML models. The proposed GPR reduces the antibiotics in wastewater; minimal experimental screening and the comparative significance and partial trust plot help in the treatment of wastewater.