Least Squares Support Vector Machine Research Articles

Discrimination of New and Aged Seeds Based on On-Line Near-Infrared Spectroscopy Technology Combined with Machine Learning

The harvest year of maize seeds has a significant impact on seed vitality and maize yield. Therefore, it is vital to identify new seeds. In this study, an on-line near-infrared (NIR) spectra collection device (899–1715 nm) was designed and employed for distinguishing maize seeds harvested in different years. Compared with least squares support vector machine (LS-SVM), k-nearest neighbor (KNN), and extreme learning machine (ELM), the partial least squares discriminant analysis (PLS-DA) model has the optimal recognition performance for maize seed harvest years. Six different preprocessing methods, including Savitzky–Golay smoothing (SGS), standard normal variate transformation (SNV), multiplicative scatter correction (MSC), Savitzky–Golay 1 derivative (SG-D1), Savitzky–Golay 2 derivative (SG-D2), and normalization (Norm), were used to improve the quality of the spectra. The Monte Carlo cross-validation uninformative variable elimination (MC-UVE), competitive adaptive reweighted sampling (CARS), bootstrapping soft shrinkage (BOSS), successive projections algorithm (SPA), and their combinations were used to obtain effective wavelengths and decrease spectral dimensionality. The MC-UVE-BOSS-PLS-DA model achieved the classification with an accuracy of 88.75% using 93 features based on Norm preprocessed spectral data. This study showed that the self-designed NIR collection system could be used to identify the harvested years of maize seed.

Non-Destructive Detection of Cerasus Humilis Fruit Quality by Hyperspectral Imaging Combined with Chemometric Method

Cerasus Humilis fruit is susceptible to rapid color changes post-harvest, which degrades its quality. This research utilized hyperspectral imaging technology to detect and visually analyze the soluble solid content (SSC) and firmness of the fruit, aiming to improve quality and achieve optimal pricing. Four maturity stages (color turning stage, coloring stage, maturity stage, and fully ripe stage) of Cerasus Humilis fruit were examined using hyperspectral images (895–1700 nm) alongside data collection on SSC and firmness. These samples were divided into a calibration set and a validation set with a ratio of 3:1 by sample set partitioning based on the joint X-Y distances (SPXY) method. The original spectral data was processed by a spectral preprocessing method. Multiple linear regression (MLR) and nonlinear least squares support vector machine (LS-SVM) detection models were established using feature wavelengths selected by the successive projections algorithm (SPA), competitive adaptive reweighted sampling (CARS), uninformative variable elimination (UVE), and two combined downscaling algorithms (UVE-SPA and UVE-CARS), respectively. For SSC and firmness detection, the best models were the SNV-SPA-LS-SVM model with 18 feature wavelengths and the original spectra-UVE-CARS-LS-SVM model with eight feature wavelengths, respectively. For SSC, the correlation coefficient of prediction (Rp) was 0.8526, the root mean square error of prediction (RMSEP) was 0.9703, and the residual prediction deviation (RPD) was 1.9017. For firmness, Rp was 0.7879, RMSEP was 1.1205, and RPD was 2.0221. Furthermore, the optimal model was employed to retrieve the distribution of SSC and firmness within Cerasus Humilis fruit. This retrieved information facilitated visual inspection, enabling a more intuitive and comprehensive assessment of SSC and firmness at each pixel level. These findings demonstrated the effectiveness of hyperspectral imaging technology for determining SSC and firmness in Cerasus Humilis fruit. This paves the way for online monitoring of fruit quality, ultimately facilitating timely harvesting.

Non-destructive prediction of anthocyanin concentration in whole eggplant peel using hyperspectral imaging

Accurately detecting the anthocyanin content in eggplant peel is essential for effective eggplant breeding. The present study aims to present a method that combines hyperspectral imaging with advanced computational analysis to rapidly, non-destructively, and precisely measure anthocyanin content in eggplant fruit. For this purpose, hyperspectral images of the fruits of 20 varieties with diverse colors were collected, and the content of the anthocyanin were detected using high performance liquid chromatography (HPLC) methods. In order to minimize background noise in the hyperspectral images, five preprocessing algorithms were utilized on average reflectance spectra: standard normalized variate (SNV), autoscales (AUT), normalization (NOR), Savitzky–Golay convolutional smoothing (SG), and mean centering (MC). Additionally, the competitive adaptive reweighted sampling (CARS) method was employed to reduce the dimensionality of the high-dimensional hyperspectral data. In order to predict the cyanidin, petunidin, delphinidin, and total anthocyanin content of eggplant fruit, two models were constructed: partial least squares regression (PLSR) and least squares support vector machine (LS-SVM). The HPLC results showed that eggplant peel primarily contains three types of anthocyanins. Furthermore, there were significant differences in the average reflectance rates between 400–750 nm wavelength ranges for different colors of eggplant peel. The prediction model results indicated that the model based on NOR CARS LS-SVM achieved the best performance, with a squared coefficient of determination (R2) greater than 0.98, RMSEP and RMSEC less than 0.03 for cyanidin, petunidin, delphinidin, and total anthocyanin predication. These results suggest that hyperspectral imaging is a rapid and non-destructive technique for assessing the anthocyanin content of eggplant peel. This approach holds promise for facilitating the more effective eggplant breeding.

Multi-step carbon emissions forecasting model for industrial process based on a new strategy and machine learning methods

The rising industrial sector capacity increases carbon emissions, necessitating a low-carbon transformation for global sustainability. Accurate multi-step forecasting of industrial carbon emissions is crucial for optimizing production, reducing energy consumption, improving efficiency, and achieving decarbonization. However, current forecasting faces challenges like model uncertainty and low accuracy with multi forecasting steps. To address these issues, this study proposed a multi-step carbon emissions forecasting model for industrial processes. Firstly, a new multi-step forecasting strategy framework was proposed. Secondly, SHapley Additive exPlanations (SHAP) and lagged autocorrelation analysis were used to extract key features affecting industrial carbon emissions. On this basis, the grey model, autoregressive moving average (ARMA) model, and least squares support vector machine (LSSVM) method were used to build forecasting models separately. The weights of the three models were solved using the induced ordered weighted average operator and the Monte Carlo search tree (MCST) method. The final forecasting results were obtained by using the weighted summation method. The data collected from the real industry were used to validate the proposed model. The results showed that the proposed model could accurately forecast industrial carbon emissions within 12 steps and its MAPE is less than 10%. The proposed multi-step industrial carbon emissions forecasting model can provide data support for industrial energy saving, carbon reduction, and green and sustainable development.

Double decomposition with enhanced least-squares support vector machine to predict water level

Double decomposition with enhanced least-squares support vector machine to predict water level

Cutting-edge tool wear monitoring in AISI4140 steel hard turning using least square-support vector machine

ABSTRACT This research addresses the critical challenge of tool wear monitoring in AISI4140 steel hard turning through the innovative application of a Least Square-Support Vector Machine (LS-SVM) prediction model. While acknowledging the growing significance of hard turning over conventional grinding techniques, the background also recognizes the challenges posed by accelerated tool wear and decreased productivity. The main goal is to create a reliable tool wear prediction model that is tailored to harsh turning circumstances. Material selection, cutting force measurement, acceleration measurement, and accurate tool wear measurement are all included in the experimental procedures. Using time and frequency domain analyses, the research methodically examines how cutting force and acceleration affect tool wear. For feature selection, non-linear regression is used to determine which parameters have the greatest influence on wear. A comprehensive training and validation procedure, structural clarification, and a detailed mathematical foundation are used in the development of the LS-SVM-based tool wear prediction model. The presentation of the findings and related discussions explores the impact of acceleration and cutting force on wear. The LS-SVM model’s successful application for precise tool wear prediction in AISI4140 steel hard turning is highlighted in the conclusions, demonstrating the model’s potential to improve tool lifespan and manufacturing efficiency.

Forecasting ionospheric TEC using least squares support vector machine and moth-flame optimization methods in China

The total electron content (TEC) of the ionosphere is an important parameter to describe the ionosphere, and it is a great significance to monitor and predict it accurately. In this paper, a hybrid ionospheric TEC prediction model based on the least squares support vector machine (LSSVM) and the Moth-Flame Optimization (MFO) algorithm is proposed. The parameters of the LSSVM model are optimized by the MFO algorithm. We use observation data of 15 GNSS stations from the Crustal Movement Observation Network of China (CMONOC) to extract ionospheric TEC from 2012 to 2019. The ionospheric TEC is forecasted using solar and geomagnetic activity indices in both the low solar activity year (2019) and the high solar activity year (2015). The results show that the prediction performance of the MFO_LSSVM model is significantly better than that of the IRI model, SVM model, and LSSVM model. Compared with the other three models, there are more stable prediction results in the low and high solar activity years. At the same time, the predicted value of the MFO_LSSVM model has a good correlation with the measured value, and it also has good prediction potential in areas with active geomagnetic activity. The comparison with the Long Short-Term Memory (LSTM) model shows that the MFO_LSSVM model has better performance than the single LSTM model. In conclusion, the MFO_LSSVM model can accurately predict ionospheric TEC in China, and has better accuracy than traditional long-term and short-term models.

Numerical solutions to one dimensional linear Volterra-Fredholm integral equations based on LS-SVM model

This paper introduces a novel numerical approach using least squares support vector machine (LS-SVM) to handle one dimensional linear Volterra-Fredholm integral equations. This method can also handle weak singular kernel Fredholm/Volterra integral equations and linear systems of Volterra-Fredholm integral equations. By minimizing errors and utilizing least squares support vector machines, the approach derives continuous closed-form solutions to the origin problem. Ultimately, the method offers an efficient numerical approximation for solving Volterra-Fredholm integral equations through the resolution of linear equations. The paper includes multiple numerical examples that demonstrate the effectiveness and superiority of the proposed method.

Intelligence modeling of the flow boiling heat transfer of nanorefrigerant for integrated energy system

To promote the application of nanorefrigerant in Organic Rankine Cycle and Integrated Energy System a reliable model with simple structure and favorable accuracy for predicting the flow boiling heat transfer coefficient (HTC) of nanorefrigerant is essential. In this work, four intelligence models—the radial basis function (RBF), multilayer perceptron (MLP), least squares support vector machine (LSSVM), and adaptive neuro fuzzy inference system (ANFIS)—were developed to predict the flow boiling heat transfer coefficient using nanorefrigerants, based on 765 experimental samples. The performances of these artificial intelligence models were comprehensively evaluated through accuracy analysis, variation trend analysis, and sensitivity analysis. Results indicated that the comprehensive performance of the RBF model was superior than those of other intelligence models and the existing empirical models. The RBF model accurately captured the variation trend of the output as the input variables were varied. Meanwhile, the impact degrees of all input variables in decreasing order were nanoparticle concentration (φ), mass flux (G), thermal conductivity of nanoparticle (kp), and vapor quality (x).

Comparing visible and near infrared ‘point’ spectroscopy and hyperspectral imaging techniques to visualize the variability of apple firmness

In this work, visible and near-infrared ‘point’ (Vis-NIR) spectroscopy and hyperspectral imaging (Vis-NIR-HSI) techniques were applied on three different apple cultivars to compare their firmness prediction performances based on a large intra-variability of individual fruit, and develop rapid and simple models to visualize the variability of apple firmness on three apple cultivars. Apples with high degree of intra-variability can strongly affect the prediction model performances. The apple firmness prediction accuracy can be improved based on the large intra-variability samples with the coefficient variation (CV) values over 10%. The least squares-support vector machine (LS-SVM) models based on Vis-NIR-HSI spectra had better performances for firmness prediction than that of Vis-NIR spectroscopy, with the with the Rc2 over 0.84. Finally, The Vis-NIR-HSI technique combined with least squares-support vector machine (LS-SVM) models were successfully applied to visualize the spatial the variability of apple firmness.

Apparent Resistivity Variation Imaging Method Based on Magnetic Field Gradient by NGO-LSSVM for the Ground-Airborne Frequency-Domain Electromagnetic Method

Apparent resistivity imaging is a typical rapid imaging method in the ground-airborne frequency-domain electromagnetic method. At present, the apparent resistivity is typically calculated by the measured magnetic field, however, this imaging method exhibits limited capability in recognizing the center of three-dimensional anomalies. Therefore, this paper proposed the calculation of apparent resistivity using magnetic field gradients. To solve the problem of random artificial anomalies that existed during the calculated process, this paper presents a hybrid least square support vector machine (LSSVM) and Northern Goshawk optimization (NGO) to establish the mapping relationship between the magnetic field gradient and apparent resistivity variation. This approach enables accurate prediction of apparent resistivity variations and effectively resolves the challenge of correcting background resistivity. Furthermore, three typical theoretical models and field examples are used to predict the apparent resistivity variation, the imaging results demonstrate that the proposed NGO-LSSVM algorithm is a feasible and efficient tool for predicting the apparent resistivity variation with high accuracy. This study provides a novel and efficient imaging method, which facilitates the application of ground-airborne frequency-domain electromagnetics for high-resolution detection requirements, such as mineral exploration.

Research on blasting vibration prediction based on BFO-LSSVM and its engineering application

In order to realize the accurate prediction of blasting vibration, the LS-SVM optimization model based on BFO algorithm is constructed with the help of bacterial foraging algorithm (BFO) and least squares support vector machine (LS-SVM) theory. 30 groups of blasting data are used as training samples to test the prediction accuracy of the model, and the main factors affecting the propagation of blasting vibration are selected as the input factors, such as single shot charge, blasting center distance, elevation difference, blockage, hole depth and other factors as the input factors, and blasting vibration as the output factor of the prediction model. The results show that the prediction accuracy of BFO-LSSVM model is higher than that of LS-SVM model under the same sample size. Taking the measured vibration data of excavation blasting of Wuqiangxi power station as an example, the average error of BFO-LSSVM model is 5.57%, which verifies the feasibility and practicability of the prediction model.

Online prediction of the enzymatic hydrolysis efficiency of crop straw

The extent of removal of lignin and hemicellulose are crucial indicators for evaluating the efficiency of enzymatic hydrolysis of crop straw. Numerous factors influence these two indices. Establishing a quantitative model that correlates these factors with hydrolysis efficiency is essential, as it can guide efficient hydrolysis. In this study, a predictive method for enzymatic hydrolysis efficiency in crop straw was proposed using Grey relational analysis (GRA), Kernel principal component analysis (KPCA), and a least squares support vector machine (LSSVM). The authors collected a dataset from actual production data and developed an efficiency predictive model using GRA for variable selection, KPCA for dimensionality reduction, and LSSVM for model training. This model allows for the direct estimation of the final enzymatic hydrolysis efficiency based on production condition variables, which can include enzyme amount, temperatures, pH, time, agitation, and straw dimensions. Extensive experimental testing validated the effectiveness of the proposed method, resulting in minimal errors, a high degree of fit, and exceptional performance. The methodology described in this study can serve as a foundation for optimising the design of efficient enzymatic hydrolysis production processes for crop straw. Additionally, it offers valuable soft measurements to support efficient control of the enzymatic hydrolysis process.

Sparse L0-norm least squares support vector machine with feature selection

Least squares support vector machine (LSSVM) is a powerful classification tool based on hyperplanes. But the classical LSSVM does not perform well on small sample size data sets (SSS) because it lacks feature selection capability. To address this issue, we introduce an L0-norm regularization term into the objective function of LSSVM, and propose a new sparse LSSVM model called L0-LSSVM. However, the introduction of the L0-norm makes the resulting optimization problem nonconvex and nonsmooth. To overcome these challenges, instead of using the traditional convex or non-convex approximation of the L0-norm, we design an efficient algorithm for L0-LSSVM based on alternating direction method of multipliers (ADMM) where the L0-norm is handled by employing the proximity operator. Numerical results demonstrate that L0-LSSVM not only exhibits excellent generalization performance and feature selection capability but also offers a substantial improvement in computational speed.

Quantitative measurement of internal quality of carrots using hyperspectral imaging and multivariate analysis

The study aimed to measure the carotenoid (Car) and pH contents of carrots using hyperspectral imaging. A total of 300 images were collected using a hyperspectral imaging system, covering 472 wavebands from 400 to 1000 nm. Regions of interest (ROIs) were defined to extract average spectra from the hyperspectral images (HIS). We developed two models: least squares support vector machine (LS-SVM) and partial least squares regression (PLSR) to establish a quantitative analysis between the pigment amounts and spectra. The spectra and pigment contents were predicted and correlated using these models. The selection of EWs for modeling was done using the Successive Projections Algorithm (SPA), regression coefficients (RC) from PLSR models, and LS-SVM. The results demonstrated that hyperspectral imaging could effectively evaluate the internal attributes of carrot cortex and xylem. Moreover, these models accurately predicted the Car and pH contents of the carrot parts. This study provides a valuable approach for variable selection and modeling in hyperspectral imaging studies of carrots.

A Hybrid Soft Sensor Model for Measuring the Oxygen Content in Boiler Flue Gas.

As an indispensable component of coal-fired power plants, boilers play a crucial role in converting water into high-pressure steam. The oxygen content in the flue gas is a crucial indicator, which indicates the state of combustion within the boiler. The oxygen content not only affects the thermal efficiency of the boiler and the energy utilization of the generator unit, but also has adverse impacts on the environment. Therefore, accurate measurement of the flue gas's oxygen content is of paramount importance in enhancing the energy utilization efficiency of coal-fired power plants and reducing the emissions of waste gas and pollutants. This study proposes a prediction model for the oxygen content in the flue gas that combines the whale optimization algorithm (WOA) and long short-term memory (LSTM) networks. Among them, the whale optimization algorithm (WOA) was used to optimize the learning rate, the number of hidden layers, and the regularization coefficients of the long short-term memory (LSTM). The data used in this study were obtained from a 350 MW power generation unit in a coal-fired power plant to validate the practicality and effectiveness of the proposed hybrid model. The simulation results demonstrated that the whale optimization algorithm-long short-term memory (WOA-LSTM) model achieved an MAE of 0.16493, an RMSE of 0.12712, an MAPE of 2.2254%, and an R2 value of 0.98664. The whale optimization algorithm-long short-term memory (WOA-LSTM) model demonstrated enhancements in accuracy compared with the least squares support vector machine (LSSVM), long short-term memory (LSTM), particle swarm optimization-least squares support vector machine (PSO-LSSVM), and particle swarm optimization-long short-term memory (PSO-LSTM), with improvements of 4.93%, 4.03%, 1.35%, and 0.49%, respectively. These results indicated that the proposed soft sensor model exhibited more accurate performance, which can meet practical requirements of coal-fired power plants.

Biochar-enhanced concrete mixes: Pioneering multi-objective optimization

The incorporation of biochar (BC) as a partial substitute for cement in concrete formulations provides a promising pathway for mitigating the environmental impacts associated with carbon dioxide emissions during cement production. To achieve optimal composition of BC-enhanced concrete, multiple objectives including mechanical strength, economic factors, and embodied CO2 must be balanced while considering a multitude of variables constrained by complex non-linear relationships. Here, we introduced an intelligent hybrid optimization algorithm that combines Particle Swarm Optimization (PSO), Least Squares Support Vector Machine (LSSVM), and Non-dominated Sorting Genetic Algorithm II (NSGAII) to predict the performance of BC-enhanced concrete and optimize its mix proportions for multiple objectives. Our results demonstrate that the PSO optimization algorithm for searching LSSVM hyper parameters outperforms other optimization algorithms, exhibiting higher generalization performance and improved overall accuracy (R2 = 0.95). Furthermore, the proposed model framework effectively presents a complete Pareto front for the BC-enhanced concrete mix ratio. This triangular model system for concrete mix ratio can determine the optimal solution, tailored to the preferences of the owner's unit. Ultimately, PSO-LSSVM-NSGAII intelligent hybrid optimization algorithm enhances the efficiency of mix proportion design for BC-enhanced concrete.

Crater-Spectrum Feature Fusion Method for Panax notoginseng Cadmium Detection Using Laser-Induced Breakdown Spectroscopy.

Panax notoginseng (P. notoginseng) is a valuable herbal medicine, as well as a dietary food supplement known for its satisfactory clinical efficacy in alleviating blood stasis, reducing swelling, and relieving pain. However, the ability of P. notoginseng to absorb and accumulate cadmium (Cd) poses a significant environmental pollution risk and potential health hazards to humans. In this study, we employed laser-induced breakdown spectroscopy (LIBS) for the rapid detection of Cd. It is important to note that signal uncertainty can impact the quantification performance of LIBS. Hence, we proposed the crater-spectrum feature fusion method, which comprises ablation crater morphology compensation and characteristic peak ratio correction (CPRC), to explore the feasibility of signal uncertainty reduction. The crater morphology compensation method, namely, adding variables using multiple linear regression (MLR) analysis, decreased the root-mean-square error of the prediction set (RMSEP) from 7.0233 μg/g to 5.4043 μg/g. The prediction results were achieved after CPRC pretreatment using the calibration curve model with an RMSEP of 3.4980 μg/g, a limit of detection of 1.92 μg/g, and a limit of quantification of 6.41 μg/g. The crater-spectrum feature fusion method reached the lowest RMSEP of 2.8556 μg/g, based on a least-squares support vector machine (LSSVM) model. The preliminary results suggest the effectiveness of the crater-spectrum feature fusion method for detecting Cd. Furthermore, this method has the potential to be extended to detect other toxic metals in addition to Cd, which significantly contributes to ensuring the quality and safety of agricultural production.

Estimating the natural gas compressibility factor using a statistical correlations and machine learning approaches

Gas compressibility factor plays an critical role in petroleum engineering applications such as gas metering, pipeline design, reserve estimation, gas flow rate, material balance calculations, and many other significant tasks. Therefore, it is crucial to accurately estimate the gas compressibility factor. There have been a lot of studies on calculating the gas compressibility factor from laboratory data, which can be summarized into two main approaches: statistical correlations and machine learning algorithms. In this study, on statistical correlations the authors implement explicit and implicit method while on machine learning algorithms, we use Artificial Neural Network (ANN) and Least-Squares Support Vector Machine (LS-SVM). The data was collected from open literature. Implementing the two approaches mentioned above and comparing statistical parameters such as Mean Squared Error (MSE), Root Mean Squared Error (RMSE), and Coefficient of Determination (R2 ) found that machine learning algorithms give much more accurate estimation results than statistical correlations, and besides, the ANN algorithm has the most accurate prediction results with the lowest MSE and RMSE (0.000002 and 0.0016) and the highest R2 (0.9999). The high-precision calculation results show that the ANN algorithm mentioned above can be applied to estimate other real gas compressibility factor data sets. On the other hand, this study can be extended to another subset of machine learning algorithms, such as deep learning and ensemble learning.

Study on detecting main ingredients of silicone rubber based on terahertz spectrum

AbstractThe authors investigated the ingredient detection technique of silicone rubber based on the Terahertz spectrum. For this purpose, 18 diverse high‐temperature vulcanised silicone rubber (HTVSR) formulations were customised, 8 of which are used as calibration set while the rest 10 as prediction set. Based on the Beer‐Lambert Law, the partial‐least‐square (PLS) regression model and the least‐squares support‐vector machines (LS‐SVM) regression model were used to yield the relationships between the absorption spectrums and the content percentages of polydimethylsiloxane (PDMS), alumina trihydrate (ATH), and silica in HTVSR. The results showed that for the formulations tested, the prediction accuracy of all three main ingredients by the PLS regression model could be improved by changing the spectrum range from 0.2–4 to 0.5–2 THz. If the data were pre‐processed by the Savitzky–Golay smoothing method or multiplicative scatter correction method, the prediction accuracy of PDMS could be further enhanced. However, this would lead to a slight decrease in the prediction accuracy of ATH. For the LS‐SVM regression model, the radial basis function (RBF) kernel and the linear kernel were studied. It was found that the prediction accuracy of both kernels was better than that of the PLS regression model. With the LS‐SVM regression model using the RBF kernel, the correlated coefficients of PDMS and ATH in the prediction set could be up to 0.9915 and 0.9742, respectively.