Parameters Of Support Vector Regression Research Articles

Modelling a chemical plant using grey‐box models employing the support vector regression and artificial neural network

AbstractIn this work, the performances of a nonlinear dynamic industrial process are examined using grey‐box (GB) models. To understand the dynamics of the system, the transient state is targeted. A white‐box (WB) model holds the prevailing knowledge using some assumptions. The performance of this model is limited. Artificial neural network (ANN) and support vector regression (SVR), which are techniques employed in numerous chemical engineering applications, are employed to construct the associated black‐box (BB) models. GA is used to optimize the SVR parameters. Dimensional and range extrapolations of different manipulated inputs, feed concentrations, feed temperatures, and cooling temperatures of the GB model and BB model are discussed. The different inputs extrapolation has different results because each input's effectiveness in the system is different. The results are compared, and the best model is suggested among the models, ANN, SVR, first principle (FP)‐ANN serial structure, FP‐ANN parallel structure, FP‐SVR serial structure, and FP‐SVR parallel structure.

Improving Cryptocurrency Price Prediction Accuracy with Multi-Kernel Support Vector Regression Approach

Cryptocurrencies are digital assets that have attracted a lot of investment and attention. It is challenging and essential for investors and traders to predict their stock price movements. Making accurate predictions about cryptocurrency prices is crucial for avoiding losses and gaining profits. Our research proposes a novel method for predicting the stock closed prices of three popular cryptocurrencies: Bitcoin, Ethereum and Polkadot. The SVR (Support vector regression) machine learning method can provide robust and accurate predictions for nonlinear and nonstationary data. This paper compares SVR radial basis functions (RBFs) and hybrid kernels based on cryptocurrency data characteristics. SVR parameters such as regularization, gamma, and epsilon can also be tuned using grid search. Our approach is tested on real-world cryptocurrency stock prices collected from Yahoo Finance. Prediction performance is measured using regression metrics like MAPE (Mean absolute percentage error) and R2 score. In our work, a MAPE value of 0.07772 and an R2 score of 0.9999 have been obtained. The results of our experiments indicate that our approach is significantly more accurate and reliable than existing methods.

Comparison of parameter optimization methods for a runoff forecast model based on a support vector machine

Long-term flow prediction is crucial in water resource management, with support vector regression (SVR) commonly used for runoff prediction. This paper aims to clarify SVR parameter optimization through a case study, focusing on the penalty coefficient (C), the kernel function parameter (γ), and the insensitive loss coefficient (ε), using different heuristic methods including particle swarm optimization (PSO), a complex method (CM), and simulated annealing (SA). A runoff prediction model based on SVR was established to forecast the monthly inflow runoff of Zipingpu Reservoir. The study evaluates the applicability of each optimization method for the SVM-based monthly streamflow forecast model. Results indicate CM has the best operational efficiency with an average running time of less than 2 s, significantly lower than PSO and SA. SA shows the best stability with an average standard deviation of fitness values of 0.00032, significantly lower than PSO's 0.0015 and CM's 0.021. The SA-SVM model reduces RMSE and MARE by 8.35% and 15% respectively, compared to the standard SVM model, while NS and R improve by 11.67% and 6.57%, achieving the highest prediction accuracy. Thus, the SA algorithm is the most applicable, followed by the PSO algorithm.

Fusing SVR with PSO Improves E-commerce Sales Prediction with 8.98% MAPE

This study explores the integration of Support Vector Regression (SVR) with Particle Swarm Optimization (PSO) to forecast clothing product sales at Nara Gallery Collection Boutique, addressing the challenge of achieving high forecast accuracy in e-commerce. Through literature review, direct observation, and interviews with a textile SME owner, SVR parameters are optimized using PSO. Results indicate a Mean Absolute Percentage Error (MAPE) value of 8.98% with optimized parameters (C = 34.3642, ε = 0.0110, σ = 0.3677, cLR = 0.1062, λ = 0.0117), enhancing decision-making in inventory management and strategic planning for e-commerce businesses. This research highlights the potential of integrating SVR with PSO for accurate sales forecasting and suggests avenues for further exploration in alternative forecasting methods and optimization techniques. Highlight: Enhanced Forecasting Accuracy: SVR and PSO integration improves e-commerce sales predictions. Parameter Optimization: PSO optimizes SVR parameters, reducing Mean Absolute Percentage Error. Strategic Inventory Management: Accurate forecasts aid in effective e-commerce inventory control. Keywoard: Support Vector Regression, Particle Swarm Optimization, Sales Forecasting, E-commerce, Inventory Management

Intelligent Analysis of Import and Export in Green Trade Barrier Based on Big Data Analysis

Abstract With the rapid development of economic globalisation, global economic and trade activities are escalating. However, environmental problems and the emergence of green economy, a response to these problems, has led to the widespread introduction of green trade barriers. These barriers implicitly limit the development of trade activities. This paper focuses on the export difficulties caused by green trade barriers and proposes a method to quantify discrete product characteristics, explore the internal characteristics of commodities and decide optimally on intended export regions. Firstly, the discrete feature of products is quantified by quantitative transformation method. Secondly, the quantitative data are used to derive the best decision for export regions through support vector regression (SVR) method. Particle swarm optimisation is used in optimising SVR parameters to achieve high-precision decision making. Comparison with historical data from the industry park shows the identification accuracy of the optimised SVR model to be better than that of the traditional regression model. This finding presents a novel perspective for developing import and export under the background of green trade barriers.

Data Restoration of dissolved gas content in transformer oil based on the CS-SVR model

Accurate monitoring of the dissolved gas content in transformer oil is crucial for transformers’ safe and stable operation. The early identification for detecting potential power transformer failures is necessary for the stability of an electrical grid. Dissolved gas analysis is an essential technology in transformers diagnosing insulation faults. Missing dissolved gas data can directly impact the reliability of monitoring results of a transformer. This study presents a data plug-in model based on support vector regression (SVR) to restore missing dissolved gas data. To further improve the accuracy of data restoration, the cuckoo search algorithm (CS) is used for optimizing SVR parameters. By verifying H2 and C2H4, the CS-SVR model demonstrates superiority over other plug-in procedures in repairing dissolved gas data.

Predicting the cognitive function status in end-stage renal disease patients at a functional subnetwork scale.

Brain functional networks derived from functional magnetic resonance imaging (fMRI) provide a promising approach to understanding cognitive processes and predicting cognitive abilities. The topological attribute parameters of global networks are taken as the features from the overall perspective. It is constrained to comprehend the subtleties and variances of brain functional networks, which fell short of thoroughly examining the complex relationships and information transfer mechanisms among various regions. To address this issue, we proposed a framework to predict the cognitive function status in the patients with end-stage renal disease (ESRD) at a functional subnetwork scale (CFSFSS). The nodes from different network indicators were combined to form the functional subnetworks. The area under the curve (AUC) of the topological attribute parameters of functional subnetworks were extracted as features, which were selected by the minimal Redundancy Maximum Relevance (mRMR). The parameter combination with improved fitness was searched by the enhanced whale optimization algorithm (E-WOA), so as to optimize the parameters of support vector regression (SVR) and solve the global optimization problem of the predictive model. Experimental results indicated that CFSFSS achieved superior predictive performance compared to other methods, by which the mean absolute error (MAE), mean absolute percentage error (MAPE), and root mean square error (RMSE) were up to 0.5951, 0.0281 and 0.9994, respectively. The functional subnetwork effectively identified the active brain regions associated with the cognitive function status, which offered more precise features. It not only helps to more accurately predict the cognitive function status, but also provides more references for clinical decision-making and intervention of cognitive impairment in ESRD patients.

Using Diverse Local Optima for Setting Kernel Parameters in Support Vector Regression: Forecasting Emerging Market Credit Spreads

Using Diverse Local Optima for Setting Kernel Parameters in Support Vector Regression: Forecasting Emerging Market Credit Spreads

Optimization-based parameter search of support vector regression for high-temperature compression constitutive modeling of 25CrMo4 steel

An accurate intrinsic structural model is essential to describing the high-temperature deformation behavior of metal materials. Support Vector Regression (SVR) has strong regression analysis capabilities, but its application research in constructing constitutive models of 25CrMo4 steel still needs to be improved. In this study, we use grid search, particle swarm optimization, improved genetic algorithm, and improved gray wolf optimization to optimize SVR parameters. A constitutive relationship model for 25CrMo4 steel under high-temperature compression based on SVR was established through training using experimental data models. The predicted data of SVR constitutive models with different optimization algorithms were compared with experimental data. Statistical values, such as average absolute percentage error (AAPE), mean absolute percentage error (MAPE), and correlation coefficient (R2), were introduced to evaluate the accuracy of each model. The particle swarm optimization-SVR model achieved the best performance, with an AAPE of 0.455 38, MAPE of 0.489 09%, and R2 of 0.999 74. Furthermore, compared to other models, it requires the least time. This model has a higher accuracy than other commonly used instantaneous models. These findings can provide a basis for selecting appropriate deformation parameters and preventing hot working defects of 25CrMo4 steel, thus helping to improve the manufacturing process and material properties.

Developing a Generalized Regression Forecasting Network for the Prediction of Human Body Dimensions

With the increasing demand for intelligent custom clothing, the development of highly accurate human body dimension prediction tools using artificial neural network technology has become essential to ensuring high-quality, fashionable, and personalized clothing. Although support vector regression (SVR) networks have demonstrated state-of-the-art (SOTA) performances, they still fall short on prediction accuracy and computation efficiency. We propose a novel generalized regression forecasting network (GRFN) that incorporates kernel ridge regression (KRR) within a multi-strategy multi-subswarm particle swarm optimizer (MMPSO)-SVR nonlinear regression model that applies a residual correction prediction mechanism to enhance prediction accuracy for body dimensions. Importantly, the predictions are generated using only a few basic body size parameters from small-batch samples. The KRR regression model is employed for preliminary residual sequence prediction, and the MMPSO component optimizes the SVR parameters to ensure superior correction of nonlinear relations and noise data, thereby yielding more accurate residual correction value predictions. The GRFN hybrid model is superior to SOTA SVR models and increases the root mean square performance by 91.73–97.12% with a remarkably low mean square error of 0.0054 ± 0.07. This outstanding advancement sets the stage for marketable intelligent apparel design tools for the fast fashion industry.

Improved gray correlation analysis and combined prediction model for aviation accidents

PurposeThe purpose of this paper is to identify the key influencing factors of aviation accidents and to predict the aviation accidents caused by the factors.Design/methodology/approachThis paper proposes an improved gray correlation analysis (IGCA) theory to make the relational analysis of aviation accidents and influencing factors and find out the critical causes of aviation accidents. The optimal varying weight combination model (OVW-CM) is constructed based on gradient boosted regression tree (GBRT), extreme gradient boosting (XGBoost) and support vector regression (SVR) to predict aviation accidents due to critical factors.FindingsThe global aviation accident data from 1919 to 2020 is selected as the experimental data. The airplane, takeoff/landing and unexpected results are the leading causes of the aviation accidents based on IGCA. Then GBRT, XGBoost, SVR, equal-weight combination model (EQ-CM), variance-covariance combination model (VCW-CM) and OVW-CM are used to predict aviation accidents caused by airplane, takeoff/landing and unexpected results, respectively. The experimental results show that OVW-CM has a better prediction effect, and the prediction accuracy and stability are higher than other models.Originality/valueUnlike the traditional gray correlation analysis (GCA), IGCA weights the sample by distance analysis to more objectively reflect the degree of influence of different factors on aviation accidents. OVW-CM is built by minimizing the combined prediction error at sample points and assigns different weights to different individual models at different moments, which can make full use of the advantages of each model and has higher prediction accuracy. And the model parameters of GBRT, XGBoost and SVR are optimized by the particle swarm algorithm. The study can guide the analysis and prediction of aviation accidents and provide a scientific basis for aviation safety management.

Parameter optimization of SVM algorithm for predicting physical parameters of SF6–Cu mixture plasma under local thermodynamic equilibrium

The physical parameters of SF6–Cu mixture plasma are necessary for arc calculation simulation. The calculation of these parameters is very difficult, but the prediction of the corresponding parameters using the existing database is one of the methods used to solve this difficult problem. The support vector regression (SVR) algorithm can effectively deal with the high-dimensional input vector problem and is widely used in the prediction field. To address the problem that the RBF kernel parameters gamma and penalty coefficient C are difficult to be obtained using the SVR algorithm, which leads to some data not satisfying the prediction accuracy, this paper first uses particle swarm optimization and the gray wolf optimizer to optimize the parameters of SVR, then uses the optimized hyperparameters to predict the data, and finally compares and analyzes the predicted data before and after the optimization. The results show that the optimized SVR parameters obtained using the optimization-seeking algorithm can fit the data better, which verifies the feasibility of the optimization of SVR hyperparameters by the optimization-seeking algorithm.

A decomposition and ensemble model based on GWO and Differential Evolution algorithm for PM2.5 concentration forecasting

Accurate and reliable prediction of PM2.5 concentrations is the basis for appropriate warning measures, and a single prediction model is often ineffective. In this paper, we propose a novel decomposition-and-ensemble model to predict the concentration of PM2.5. The model utilizes Ensemble Empirical Mode Decomposition (EEMD) to decompose PM2.5 series, Support Vector Regression (SVR) to predict each Intrinsic Mode Function (IMF), and a hybrid algorithm based on Differential Evolution (DE) and Grey Wolf Optimizer (GWO) to optimize SVR parameters. The proposed prediction model EEMD-SVR-DEGWO is employed to forecast the concentration of PM2.5 in Guangzhou, Wuhan, and Chongqing of China. Compared with six prediction models, the proposed EEMD-SVR-DEGWO is a reliable predictor and has achieved competitive results.

Dynamic weighing algorithm for dairy cows based on time domain features and error compensation

Weight is an essential indicator for the growth and development of cows. Traditional static weighing method requires a lot of labor and financial resources, the existing dynamic weighing algorithm has no consideration of the influence of hidden information on weighing results during cows' movement, and fails to meet the weighing requirements in complex environments. In this paper, we propose a cow dynamic weighing algorithm based on time domain features and error compensation, quantitatively analyze the hidden information in the dynamic weighing signal, and compensate for the error of the preliminary prediction results, leading to a high-precision dynamic weighing of cows. Firstly, the dynamic weighing signal of cows is pre-processed to obtain the effective signal, and each time domain feature of the effective signal are extracted. Then, the effective signal is decomposed by using the empirical wavelet transform (EWT), and the trend component's mean value is taken as the prediction value of EWT, so that the error between the prediction weight value and the real weight can be calculated. Next, four time-domain features are used as input and the error values are used as output to construct the data set, and the sparrow search algorithm (SSA) is used to obtain the optimal parameters of support vector regression (SVR) model for the training. Finally, the error prediction values output from the model are summed with the prediction values of EWT as the final weight prediction value. To evaluate the performance of the method in this paper, we collect dynamic weighing data from 626 cows, and then randomly select 501 data as the training set while the remaining 125 data as the test set. The average relative error of weight prediction of our method is 0.68%, and the root mean square error is 4.83 kg, better than the existing dynamic weighing algorithms. The experimental results show that the method in this paper is feasible to quantitatively analyze the implicit information of the effective signal according to the time domain features, and the error compensation method can effectively reduce dynamic weighing errors, particularly under extreme conditions, making the method more robust and better meeting the practical needs of farms.

Soft computing assessment of current and future groundwater resources under CMIP6 scenarios in northwestern Iran

Excessive use of water resources in combination with climate change threaten to significantly reduce groundwater in arid and semiarid regions. We studied the effects of climate change on the groundwater level for the important Dehgolan Aquifer in northwestern Iran. The water level in this aquifer has dropped by about 35 m during the last 30 years. Soft computing techniques were used together with climate projections in three methodological steps to estimate the groundwater level drop by 2045. Firstly, MODFLOW was used to simulate groundwater flow and movement. Secondly, simulation results, support vector regression (SVR), and least-squares SVR (LSSVR) machine learning models were used to predict groundwater levels for the future 20-year period (2026–2045). The whale optimization algorithm (WOA) was used to improve the prediction results by optimizing the SVR parameters. Thirdly, three climate models of CMIP6 (ACCESS-CM2, BCC-CSM2-MR, and CMCC-ESM2) were used to predict the changes in precipitation for the future period (2026–2045) using SSP 2.6 and SSP 8.5 scenarios. The results showed that the MODFLOW-LSSVR model predicted the groundwater level more accurately than MODFLOW-SVR and MODFLOW-SVR-WOA. The calculation scenario containing previous month groundwater level, monthly aquifer withdrawal, and monthly precipitation had the highest performance in predicting groundwater level with root mean square error (RMSE), mean absolute percentage error (MAPE), and Nash Sutcliffe efficiency (NSE) equal to 0.305 m, 0.014 m, and 0.998, respectively. The results indicate that precipitation may decrease in the future period for the SSP 8.5 scenario (about 6% compared to the reference period 1987–2005). This decrease, along with the continuation of the current aquifer withdrawal, will cause a drop of about 36 m (during 28 years) of the groundwater level (1.3 m per year). The results reveal that the drop could be reduced to 12 m by adopting a 25% reduction in the current aquifer withdrawal. The findings show the necessity of providing a suitable management approach to prevent future aquifer exhaustion due to the continuation of the current withdrawal situation in the region.

An enhanced grey wolf optimizer boosted machine learning prediction model for patient-flow prediction

Large and medium-sized general hospitals have adopted artificial intelligence big data systems to optimize the management of medical resources to improve the quality of hospital outpatient services and decrease patient wait times in recent years as a result of the development of medical information technology and the rise of big medical data. However, owing to the impact of several elements, including the physical environment, patient, and physician behaviours, the real optimum treatment effect does not meet expectations. In order to promote orderly patient access, this work provides a patient-flow prediction model that takes into account shifting dynamics and objective rules of patient-flow to handle this issue and forecast patients' medical requirements. First, we propose a high-performance optimization method (SRXGWO) and integrate the Sobol sequence, Cauchy random replacement strategy, and directional mutation mechanism into the grey wolf optimization (GWO) algorithm. The patient-flow prediction model (SRXGWO-SVR) is then proposed using SRXGWO to optimize the parameters of support vector regression (SVR). Twelve high-performance algorithms are examined in the benchmark function experiments' ablation and peer algorithm comparison tests, which are intended to validate SRXGWO's optimization performance. In order to forecast independently in the patient-flow prediction trials, the data set is split into training and test sets. The findings demonstrated that SRXGWO-SVR outperformed the other seven peer models in terms of prediction accuracy and error. As a result, SRXGWO-SVR is anticipated to be a reliable and efficient patient-flow forecast system that may help hospitals manage medical resources as effectively as possible.

Prediction of Deposition Layer Morphology Dimensions Based on PSO-SVR for Laser–arc Hybrid Additive Manufacturing

Laser–arc composite additive manufacturing holds significant potential for a wide range of industrial applications, and the control of morphological dimensions in the deposited layer is a critical aspect of this technology. The width and height dimensions within the deposited layer of laser–arc hybrid additive manufacturing serve as essential indicators of its morphological characteristics, directly influencing the shape quality of the deposited layer. Accurate prediction of the shape dimensions becomes crucial in providing effective guidance for size control. To achieve precise prediction of shape dimensions in laser–arc composite additive manufacturing and ensure effective regulation of the deposited layer’s shape quality, this study introduces a novel approach that combines a particle swarm algorithm (PSO) with an optimized support vector regression (SVR) technique. By optimizing the SVR parameters through the PSO algorithm, the SVR model is enhanced and fine-tuned to accurately predict the shape dimensions of the deposited layers. In this study, a series of 25 laser–arc hybrid additive manufacturing experiments were conducted to compare different approaches. Specifically, the SVR model was built using selected radial basis function (rbf) kernel functions. Furthermore, the penalty factors and kernel parameters of the SVR model were optimized using the particle swarm optimization (PSO) algorithm, leading to the development of a PSO-SVR prediction model for the morphological dimensions of the deposited layers. The performance of the PSO-SVR model was compared with that of the SVR, BPNN, and LightGBM models. Model accuracy was evaluated using a test set, revealing average relative errors of 2.39%, 7.719%, 9.46%, and 5.356% for the PSO-SVR, SVR, BPNN, and LightGBM models, respectively. The PSO-SVR model exhibited excellent prediction accuracy with minimal fluctuations in prediction error. This performance demonstrates the model’s ability to effectively capture the intricate and non-linear relationship between process parameters and deposition layer dimensions. Consequently, the PSO-SVR model can provide a foundation for the control of morphological dimensions in the deposition layer, offering an effective guide for deposition layer morphology dimension control in laser–arc composite additive manufacturing.

Research and Application for Corrosion Rate Prediction of Natural Gas Pipelines Based on a Novel Hybrid Machine Learning Approach

An accurate and stable prediction of the corrosion rate of natural gas pipelines has a major impact on pipeline material selection, inhibitor filling process, and maintenance schedules. At present, corrosion data are impacted by non-linearity and noise interference. The traditional corrosion rate prediction methods often ignore noise data, and only a small number of researchers have carried out in-depth research on non-linear data processing. Therefore, an innovative hybrid prediction model has been proposed with four processes: data preprocessing, optimization, prediction, and evaluation. In the proposed model, a decomposing algorithm is applied to eliminate redundant noise and to extract the primary characteristics of the corrosion data. Stratified sampling is applied to separate the training set and the test set to avoid deviation due to the sampling randomness of small samples. An improved particle swarm optimization algorithm is applied to optimize the parameters of support vector regression. A comprehensive evaluation of this framework is also conducted. For natural gas pipelines in southwest China, the coefficient of determination and mean absolute percentage error of the proposed hybrid model are 0.925 and 5.73%, respectively, with better prediction performance compared to state-of-the-art models. The results demonstrate the best approach for improving the prediction accuracy of the proposed hybrid model. This can be applied to improve the corrosion control effect and to support the digital transformation of the corrosion industry.

Predicting Rainfall-induced Landslide Using Bee Colony Algorithm Based on Support Vector Regression

Objective: Natural disasters caused by landslides have done great harm to agricultural production, people's lives, and property. Considering the slope disaster caused by heavy rainfall, it is important to establish an early warning system to monitor rainfall disaster prevention. Huafang University Slope Sustainable Development Research Center (HUSSDRC) has set up a meteorological station equipped with many sensors to provide early warning for landslides in Taiwan. Since the amount of data collected will soon become very large, there is a need to implement strong parallel frameworks containing information from the meteorological station and the displacement of tiltmeters required to predict the landslides caused by rainfall. Apache Spark (AS) is a general framework that contains the parallel process engine for data analytics. In this study, a hybrid method is utilized to predict rainfall-induced landslides. The proposed method combines support vector regression (SVR) with an artificial bee colony (ABC) algorithm on the parallel platform of AS. For the proposed method, the RMSE is 0.562, and it is the best value among these compared approaches. Methods: The SVR together with an ABC algorithm is applied to predict rainfall-induced landslides on AS. The AS can perform parallel data analytics in memory to speed up performance. However, it is hard to set up the best parameters for SVR. Thereafter, the ABC algorithm is utilized to search for the best parameters for SVR. Results: Compared with other methods, the proposed method results provide the smallest root mean square error (RMSE) for predicting rainfall-induced landslides. Conclusion: A hybrid method is proposed to predict rainfall-induced landslides. The proposed hybrid method is based on the parallel platform of AS in which SVR predicts the rainfall-induced landslides, and the ABC algorithm adjusts the best values of parameters for SVR. The comparison of RMSE for the method with existing approaches shows that the method indeed has the best value among compared approaches.

Determination of support vector regression parameters using African buffalo optimization algorithm

<span lang="EN-US">The use of support vector regression (SVR) for regression tasks has been on increase over the past few years. Unfortunately, the practical application of SVR for regression task is limited due to its dependence on proper setting of its hyper-parameters and associated kernel parameter. Therefore, it become imperative to device a reliable and fast mechanism of determining the value of these parameters that could guarantee lowest generalization error. This paper presents SVR parameter optimization approaches using African buffalo optimisation (ABO) algorithm, i.e. SVR-ABO. The SVR parameters are optimized by using African buffalo optimisation algorithm. Results obtained from several experiments performed has shown that the proposed ABO algorithm has the capability of determining SVR hyper-parameters which most of time has to be done through estimation.</span>