Relevance Vector Machine Model Research Articles

Q-Learning-Incorporated Robust Relevance Vector Machine for Remaining Useful Life Prediction

Accurate and reliable remaining useful life (RUL) prediction is crucial for improving equipment reliability and safety, realizing predictive maintenance. The relevance vector machine (RVM) method is commonly utilized for RUL prediction, profiting from its sparse property under a Bayesian framework. However, the RVM faces the issue of poor robustness, which is mainly manifested as poor prediction accuracy and difficulty in fitting when the predicted data fluctuate greatly. This is due to weights and random errors following Gaussian distributions, which are highly sensitive to outliers. Also, the traditional model training process heavily relies on an additional feature extraction process, which suffers from the problem of effective data loss as well as the risk of overfitting. Thus, a robust regression framework against outliers is developed by incorporating t-distribution into the RVM. And a Q-learning (QL) algorithm is embedded into the constructed robust RVM model to replace the feature extraction process. In addition, this paper firstly predicts the degradation trend of RUL to enhance the accuracy and interpretability of RUL prediction. Finally, a comparative experiment on the performance degradation of capacitors in the traction system is designed, and the root mean square errors for the QL-RRVM, QL-RVM, RRVM, and RVM models are obtained as 0.751, 8.599, 38.316, and 41.892, respectively. The experimental results confirm the superiority of the proposed method.

A robust multi-model framework for groundwater level prediction: The BFSA-MVMD-GRU-RVM model

Groundwater level prediction is critical for environmental protection and agricultural planning. Accurate predictions help manage risks associated with excessive groundwater extraction and land subsidence. This study introduces a novel model combining multivariate variational mode decomposition (MVMD), gated recurrent unit (GRU), and relevance vector machine (RVM), along with the Boruta feature selection algorithm (BFSA), for precise groundwater level forecasting. The model operates in several stages. First, BFSA selects the most informative features as input data. Next, the MVMD method decomposes the time series of these features. The GRU model then extracts crucial information from these decompositions. Finally, the extracted data is fed into the RVM model to predict groundwater levels one month ahead in Iran's Bastam Plain. To assess the model's accuracy, multiple error indices were employed. The MVMD-GRU-RVM model outperformed other models, improving the testing Nash–Sutcliffe Efficiency and mean absolute error by 24–31 % and 6–61 %, respectively. Additionally, it enhanced R2 values of the MVMD-CNN, MVMD-RNN, MVMD-MLP, and MVMD-RBFNN models by 1.0–3.33 %. These results demonstrate that the MVMD-GRU-RVM model significantly improves groundwater level prediction accuracy. The key points of the paper are the successful effectiveness of MVMD in processing non-stationary time series and improving the predictive performance of the models, as well as the high ability of the GRU model in data feature extraction. The study also shows that the novel model can provide outputs with lower uncertainty.

Predicting Depressive Disorders in Diabetic Workers: A Comparative Analysis of Relevance Vector Machine and Traditional Machine Learning Models

Predicting Depressive Disorders in Diabetic Workers: A Comparative Analysis of Relevance Vector Machine and Traditional Machine Learning Models

Predicting ground vibration during rock blasting using relevance vector machine improved with dual kernels and metaheuristic algorithms

The ground vibration caused by rock blasting is an extremely hazardous outcome of the blasting operation. Blasting activity has detrimental effects on both the ecology and the human population living in proximity to the area. Evaluating the magnitude of blasting vibrations requires careful evaluation of the peak particle velocity (PPV) as a fundamental and essential parameter for quantifying vibration velocity. Therefore, this study employs models using the relevance vector machine (RVM) approach for predicting the PPV resulting from quarry blasting. This investigation utilized the conventional and optimized RVM models for the first time in ground vibration prediction. This work compares thirty-three RVM models to choose the most efficient performance model. The following conclusions have been mapped from the outcomes of the several analyses. The performance evaluation of each RVM model demonstrates each model achieved a performance of more than 0.85 during the testing phase, there was a strong correlation observed between the actual ground vibrations and the predicted ones. The analysis of performance metrics (RMSE = 21.2999 mm/s, 16.2272 mm/s, R = 0.9175, PI = 1.59, IOA = 0.8239, IOS = 0.2541), score analysis (= 93), REC curve (= 6.85E−03, close to the actual, i.e., 0), curve fitting (= 1.05 close to best fit, i.e., 1), AD test (= 11.607 close to the actual, i.e., 9.790), Wilcoxon test (= 95%), Uncertainty analysis (WCB = 0.0134), and computational cost (= 0.0180) demonstrate that PSO_DRVM model MD29 outperformed better than other RVM models in the testing phase. This study will help mining and civil engineers and blasting experts to select the best kernel function and its hyperparameters in estimating ground vibration during rock blasting project. In the context of the mining and civil industry, the application of this study offers significant potential for enhancing safety protocols and optimizing operational efficiency.

Reliability‐based state parameter liquefaction probability prediction using soft computing techniques

The state parameter (ѱ) accounts for both relative density and effective stress, which influence the cyclic stress or liquefaction characteristic of the soil significantly. This study presents a ѱ‐based probabilistic liquefaction evaluation method using six soft computing (SC) techniques. The liquefaction probability of failure (PL) is calculated using the first‐order second moment (FOSM) method based on the cone penetration test (CPT) database. Then, six SC techniques, such as Gaussian process regression (GPR), relevance vector machine (RVM), functional network (FN), genetic programming (GP), minimax probability machine regression (MPMR) and multivariate adaptive regression splines (MARS), are used to predict PL. The performance of these models is examined using nine statistical indices. Additionally, plots such as regression plots, Taylor diagrams, error matrix and rank analysis are shown to assess the SC model's performance. Finally, sensitivity analysis is performed using the cosine amplitude method (CAM) to assess the influence of input parameters on output. The current study demonstrates that SC models based on state parameter predict PL effectively. RVM and MPMR models closely follow the GPR model in terms of performance, which is superior to the other models. Notably, two equations are generated using GP and MARS models to predict PL. The results of the sensitivity analysis reveal the magnitude of earthquake (Mw) as the most sensitive parameter. The outcomes of this research will offer risk evaluations for geotechnical engineering designs and expand the use of state parameter‐based SC models in liquefaction analysis.

Assessment of Uniaxial Strength of Rocks: A Critical Comparison Between Evolutionary and Swarm Optimized Relevance Vector Machine Models

Assessment of Uniaxial Strength of Rocks: A Critical Comparison Between Evolutionary and Swarm Optimized Relevance Vector Machine Models

Offshore wind power prediction based on two-stage hybrid modeling**

Accurate prediction of offshore wind power generation is essential for efficient power scheduling and grid integration. This study introduces an innovative hybrid forecasting approach to address variability in power output due to different climatic conditions and challenges in measuring offshore wind speeds. The approach consists of two primary phases. First, a gated recurrent unit neural network with an attentional mechanism and a quantile regression model forecast wind speeds between cut-in and rated wind speeds, capturing trends under distinct climatic conditions. Second, wind speeds at nine quantile points are used as inputs to a relevance vector machine model, optimized via a cuckoo search algorithm, to establish the relationship between wind speed and power output. An empirical evaluation on a European offshore wind power dataset validates the approach's effectiveness across various climatic conditions. The two-stage model demonstrates enhanced adaptability, offering more reliable power predictions than conventional methods. Results indicate this hybrid forecasting method is more accurate than traditional techniques, significantly improving offshore wind power prediction performance.

High-Resolution Downscaling with Interpretable Relevant Vector Machine: Rainfall Prediction for Case Study in Selangor

Due to the discrepancy in resolution between existing global climate model output and the resolution required by decision-makers, there is a persistent need for climate downscaling. We conducted a study to determine the effectiveness of Relevant Vector Machine (RVM), one of the machine learning approaches, in outperforming existing statistical methods in downscaling historical rainfall data in the complex terrain of Selangor, Malaysia. While machine learning eliminates the requirement for manual feature selection when extracting significant information from predictor fields, considering multiple pivotal factors is essential. These factors include identifying relevant atmospheric features contributing to rainfall, addressing missing data, and developing a significant model to predict daily rainfall intensity using appropriate machine-learning techniques. The Principal Component Analysis (PCA) technique was employed to choose relevant environmental variables as input for the machine learning model, and various imputation methods were utilized to manage missing data, such as mean imputation and the KNN algorithm. To assess the performance of the RVM-based rainfall model, we collected a dataset from the Department of Irrigation and Drainage Malaysia. We used Nash-Sutcliffe Efficiency (NSE) and Root Mean Square Error (RMSE) as evaluation metrics. This study concluded that Relevance Vector Machine (RVM) models are suitable for forecasting future rainfall since they can support large rainfall extremes and generate reliable daily rainfall estimates based on rainfall extremes. In this study, the RVM model was employed to determine a predictive association between predictand variables and predictors.

A Study of Adaptive Threshold Based on the Reconstruction Model for Marine Systems and Their Equipment Failure Warning

To achieve the failure warning of marine systems and their equipment (MSAE), the threshold is one of the most prominent issues that should be solved first. In this study, a fusion model based on sparse Bayes and probabilistic statistical methods is applied to determine a new and more accurate adaptive alarm threshold. A multistep relevance vector machine (RVM) model is established to realize the parameter reconstruction in which the internal uncertainties caused by the degradation process and the external uncertainty caused by the loading, environment, and disturbances were considered. Then, a varying moving window (VMW) method is employed to determine the window size and achieve continuous data reconstruction. Further, the model based on Johnson distribution systems is utilized to complete the transformation of the residual parameters and calculate the adaptive threshold. Finally, the proposed adaptive decision threshold is successfully involved in the actual examples of the peak pressure and exhaust temperature of marine diesel engines. The results show that the proposed method can realize the continuous health condition monitoring of MSAE, successfully detect abnormal conditions in advance, achieve an early warning of failure, and reserve sufficient time for decision-making to prevent the occurrence of catastrophic disasters.

Modelling of healthcare data analytics using optimal machine learning model in big data environment

AbstractRecent advances in wireless networking, big data technologies, namely Internet of Things (IoT) 5G networks, health care big data analytics, and other technologies in artificial intelligence (AI) and wearables, have supported the progression of intellectual disease diagnosis methods. Medical data covers all patient data such as pharmacy texts, electronic health reports (EHR), prescriptions, study data from medical journals, clinical photographs, and diagnostic reports. Big data is a renowned method in the healthcare sector, with beneficial datasets that are highly difficult, voluminous, and rapid for healthcare providers for interpreting and computing using prevailing tools. This study combines concepts like deep learning (DL) and big data analytics in medical field. This article develops a new healthcare data analytics using optimal machine learning model in big data environment (HDAOML‐BDE) technique. The presented HDAOML‐BDE technique mainly aims to examine the healthcare data for disease detection and classification in the big data environment. For handling big data, the HDAOML‐BDE technique uses Hadoop MapReduce environment. In addition, the HDAOML‐BDE technique uses manta ray foraging optimization‐based feature selection (MRFO‐FS) technique to reduce high dimensionality problems. Moreover, the HDAOML‐BDE method uses relevance vector machine (RVM) model for the healthcare data environment. Furthermore, the arithmetic optimization algorithm (AOA) is utilized for the parameter tuning of the RVM classifier. The simulation results of the HDAOML‐BDE technique are tested on a healthcare dataset, and the outcomes portray the improved performance of the HDAOML‐BDE strategy over recent approaches in different measures.

Quality control prediction of electrolytic copper using novel hybrid nonlinear analysis algorithm

Traditional linear regression and neural network models demonstrate suboptimal fit and lower predictive accuracy while the quality of electrolytic copper is estimated. A more dependable and accurate model is essential for these challenges. Notably, the maximum information coefficient was employed initially to discern the non-linear correlation between the nineteen factors influencing electrolytic copper quality and the five quality control indicators. Additionally, the random forest algorithm elucidated the primary factors governing electrolytic copper quality. A hybrid model, integrating particle swarm optimization with least square support vector machine, was devised to predict electrolytic copper quality based on the nineteen factors. Concurrently, a hybrid model combining random forest and relevance vector machine was developed, focusing on primary control factors. The outcomes indicate that the random forest algorithm identified five principal factors governing electrolytic copper quality, corroborated by the non-linear correlation analysis via the maximum information coefficient. The predictive accuracy of the relevance vector machine model, when accounting for all nineteen factors, was comparable to the particle swarm optimization—least square support vector machine model, and surpassed both the conventional linear regression and neural network models. The predictive error for the random forest-relevance vector machine hybrid model was notably less than the sole relevance vector machine model, with the error index being under 5%. The intricate non-linear variation pattern of electrolytic copper quality, influenced by numerous factors, was unveiled. The advanced random forest-relevance vector machine hybrid model circumvents the deficiencies seen in conventional models. The findings furnish valuable insights for electrolytic copper quality management.

Remaining useful life prediction for rolling bearings based on RVM-Hausdorff distance

To address the shortcomings of existing bearing remaining useful life (RUL) prediction process such as low accuracy and reliance on expert experience for parameter estimation, this paper proposes a bearing RUL prediction method combining relevance vector (RV) machine (RVM) and hybrid degradation model. The bearing degradation characteristics are extracted from the acquired vibration acceleration signals, the time-varying 3σ criterion is then used to determine the bearing first predicting time, and the sequence from initial failure time point to the inspection time is regressed by differential kernel parameter RVM to obtain the different sparse RVs. A mixed degenerate model combined single exponential, weighted double exponential, and polynomial is used to fit the sparse RVs to obtain the fitted curve clusters. The similarity based on bidirectional Hausdorff distance is used to select the best degradation curve, and to extrapolate the best degradation curve to the failure threshold. The experimental results indicate that the proposed method overcomes the widespread drawbacks of monotonicity and trend bias in model-based methods, and has better prediction efficiency than the conventional exponential models.

State-of-charge of lithium-ion battery based on equivalent circuit model – Relevance vector machine fusion model considering varying ambient temperatures

Ambient temperature significantly impacts battery characteristics and state-of-charge (SOC) accuracy, so it is crucial to estimate SOC under various temperatures. Most circuit models of lithium-ion batteries have poor temperature adaptability, especially at low temperatures. To solve this challenge, this paper proposes a fusion model of the Equivalent Circuit Model-Relevance Vector Machine to enhance SOC estimation under various temperatures. First, a second-order equivalent circuit model based on the forgetting factor recursive least squares is built to obtain the SOC value. Second, build a data-driven battery model based on the relevance vector machine (RVM) algorithm with a moving window method, and the SOC value is obtained based on the RVM model and the unscented Kalman filter algorithm. The weights of the models are merged using the Bayesian principle. The experiments verify that the fusion model accurately estimates SOC for different types of batteries under variable ambient temperature environments and exhibits strong robustness.

A Hybrid Prediction Model for Local Resistance Coefficient of Water Transmission Tunnel Maintenance Ventilation Based on Machine Learning

Multiple ducts in the working shaft and main body of tunnels form a combined tee structure. An efficient and accurate prediction method for the local resistance coefficient is the key to the design and optimization of the maintenance ventilation scheme. However, most existing studies use numerical simulations and model experiments to analyze the local resistance characteristics of specific structures and calculate the local resistance coefficient under specific ventilation conditions. Therefore, there are shortcomings of low efficiency and high cost in the ventilation scheme optimization when considering the influence of the local resistance. This paper proposes a hybrid prediction model for the local resistance coefficient of water transmission tunnel maintenance ventilation based on machine learning. The hybrid prediction model introduces the hybrid kernel into a relevance vector machine to build the hybrid kernel relevance vector machine model (HKRVM). The improved artificial jellyfish search algorithm (IAJS), which utilizes Fuch chaotic mapping, lens-imaging reverse learning, and adaptive hybrid mutation strategies to improve the algorithm performance, is applied to the kernel parameter optimization of the HKRVM model. The results of a case study show that the method proposed in this paper can achieve the efficient and accurate prediction of the local resistance coefficient of maintenance ventilation and improve the prediction accuracy and prediction efficiency to a certain extent. The method proposed in this paper provides a new concept for the prediction of the ventilation local resistance coefficient and can further provide an efficient prediction method for the design and optimization of maintenance ventilation schemes.

Construction of Building Energy Consumption Prediction Model Based on Multi-Optimization Model

This study explores the utilization of the Relevance Vector Machine (RVM) model, optimized using the Sparrow Search Algorithm (SSA), Simulate Anneal Arithmetic (SAA), Particle Swarm Optimization (PSO), and Bayesian Optimization Algorithm (BOP), to construct an energy dissipation model for public buildings in Wuhan City. Energy consumption data and influential factors were collected from 100 public buildings, yielding 15 input variables, including building area, personnel density, and supply air temperature. Energy dissipation served as the output scalar indicator. Through correlation analysis between input and output variables, it was found that building area, personnel density, and supply air temperature significantly impact energy dissipation in public buildings. Principal component analysis (PCA) was employed for data dimensionality reduction, selecting seven main influential factors along with energy dissipation values as the dataset for the predictive model. The BOP-RVM model showed superior performance in terms of R2 (0.9523), r (0.9761), and low RMSE (5.3894) and SI (0.056). These findings hold substantial practical value for accurately predicting building energy consumption and formulating effective energy management strategies.

Prediction of Surface Settlement in Shield-Tunneling Construction Process Using PCA-PSO-RVM Machine Learning

Surface settlement is one of the key engineering issues during shield construction process. In order to accurately predict surface settlement, this paper proposes a new machine learning method based on relevance vector machine (RVM), principal component analysis (PCA), and particle swarm optimization (PSO). Taking Beijing Metro Line 6 as a case study, the PCA-PSO-RVM model is used to make the prediction and compared with the prediction results of the RVM model using the same samples. In order to evaluate the reliability of the model, three evaluation indexes including mean relative error (MRE), root mean square error (RMSE), and Theil inequality coefficient (TIC) were calculated, and sensitivity analysis was carried out on them. The results show that the minimum relative error between PCA-PSO-RVM and the actual value is only 0.06%. The calculated MRE, RMSE, and TIC are 0.17%, 0.0714 mm, and 0.027%, respectively, which shows that PCA-PSO-RVM model has higher prediction accuracy, smaller deviations, and higher reliability compared with the three other models. Through sensitivity analysis, it is found that the weighted average internal friction angle (φ) has the most significant impact on the surface settlement, which should be focused on in relevant research.

Multi-Kernel Relevance Vector Machine With Parameter Optimization for Cycling Aging Prediction of Lithium-Ion Batteries

Aging prediction plays a vital role in battery prognostics and health management, which contributes to preventing unexpected failure and evaluating battery systems’ residual value. In this study, a reliable cycling aging prediction based on a data-driven model is proposed to address the urgent issue of adaptive and early prediction of lithium-ion battery remaining useful life (RUL). First, to enhance the learning and generalization abilities of standard relevance vector machines (RVMs), a multi-kernel RVM model containing two kernel functions with different characteristics is constructed, followed by the particle swarm optimization (PSO) algorithm for determining the kernel and weight parameters. Then, a similarity criterion of the battery capacity curves is proposed to screen battery offline data for model training to achieve early life prediction. Battery cycling aging data from two types of batteries under different aging conditions are used for model training and verification. Quantitative experimental results demonstrate that the proposed multi-kernel RVM model can realize the accurate prediction of the failure cycle and capacity attenuation trajectory of different types of batteries. Moreover, the proposed method has also been proved to be able to learn the general fading characteristics from other types of batteries.

Modeling Potential Evapotranspiration by Improved Machine Learning Methods Using Limited Climatic Data

Modeling potential evapotranspiration (ET0) is an important issue for water resources planning and management projects involving droughts and flood hazards. Evapotranspiration, one of the main components of the hydrological cycle, is highly effective in drought monitoring. This study investigates the efficiency of two machine-learning methods, random vector functional link (RVFL) and relevance vector machine (RVM), improved with new metaheuristic algorithms, quantum-based avian navigation optimizer algorithm (QANA), and artificial hummingbird algorithm (AHA) in modeling ET0 using limited climatic data, minimum temperature, maximum temperature, and extraterrestrial radiation. The outcomes of the hybrid RVFL-AHA, RVFL-QANA, RVM-AHA, and RVM-QANA models compared with single RVFL and RVM models. Various input combinations and three data split scenarios were employed. The results revealed that the AHA and QANA considerably improved the efficiency of RVFL and RVM methods in modeling ET0. Considering the periodicity component and extraterrestrial radiation as inputs improved the prediction accuracy of the applied methods.

Machine learning for better prediction of seepage flow through embankment dams: Gaussian process regression versus SVR and RVM.

In the present study, three machine learning methods were applied for predicting seepage flow through embankment dams, namely (i) support vector regression (SVR), relevance vector machine (RVM), and Gaussian process regression (GPR). The three models were developed using seepage flow (Q: L/mn) and piezometer level (Z:m) measured at several piezometers placed in the corps body of the dam. The proposed models were calibrated and validated using a separate subset. Models evaluation and comparison was successfully achieved using various performances metrics, i.e., coefficient of correlation (R), Nash-Sutcliffe efficiency (NSE), root mean square error (RMSE), and mean absolute error (MAE). Experimental results showed that the proposed models are a good alternative to the in situ measured and contributed significantly in overcoming the case of missing measured seepage flow. The best performances were obtained using the RVM model with R and NSE values of ≈0.909 and ≈0.823, followed by the GPR model with R and NSE values of ≈0.891 and ≈0.767, while the SVR model was ranked as the poorest one exhibiting R and NSE values of ≈0.780 and ≈0.600, respectively. While, a growing number of investigations have focused on testing machine learning in terms of their feasibilities to accurately describe seepage flow, as well as providing important support to our understanding of the factors affecting its fluctuation, the present work was demonstrated that the combination of a wide range of variables can help in simulating seepage flow, and enhance their sensitivity which has help in developing new algorithms.

SMS Spam Detection using Relevance Vector Machine

Spam in Short Message Service(SMS) is a serious issue that impacts mobile phone consumers all around the world. Many strategies have been applied using several deep learning and machine learning techniques to overcome these issues. The bagging approach is used in the study to combine four different algorithms, namely RVM, SVM, Naive Bayes, and KNN. Then the final prediction is calculated from the predictions obtained from each of these algorithms by using a majority-based voting approach. So, this paper offers research on the comparative analysis of various text classification algorithms for accurately detecting and classifying spam SMS messages. The dataset is first preprocessed and then vectorized using the TF-IDF method which gives more importance to the less frequent words rather than common words. The Relevance vector machine (RVM) implementation on the dataset, achieves the best performance on this dataset with an F1 score of 0.975175. According to the study's findings, the suggested RVM model may successfully categorize SMS spam messages and be applied in practical settings.