Least Squares Support Vector Machine Research Articles

Lithium-Ion Battery Health State Estimation Based on Feature Reconstruction and Optimized Least Squares Support Vector Machine

Abstract The state of health (SOH) of a battery is the main indicator of battery life. In order to improve the SOH estimation accuracy, a model framework for lithium-ion battery health state estimation with feature reconstruction and improved least squares support vector machine is proposed. First, the indirect health features (HF) are obtained by processing multiple health features extracted from the charging and discharging phases through principal component analysis to remove the information redundancy among multiple features. Subsequently, multiple smooth component subsequences of different frequencies are obtained by using variational modal decomposition to efficiently capture the overall downtrend and regeneration fluctuations of the data. Then, use the sparrow search algorithm to optimize the least squares support vector machine to build an estimation model, predict and superimpose the reconstructed fusion features of multiple feature subsequences. Finally, use the mapping relationship between the reconstructed HF and the SOH for the estimation. The NASA battery dataset and the University of Maryland battery dataset (CACLE) are used to perform validation tests on multiple batteries with different cycle intervals. The results show that the mean absolute error and root mean square error are less than 1% and the method has high-estimation accuracy and robustness.

Dynamic internal resistance modeling and thermal characteristics of lithium-ion batteries for electric vehicles by considering state of health

Attempting to solve the problem of inconsistent dynamic thermal characteristics caused by transient changes in internal resistance of lithium-ion batteries (LIBs) for electric vehicles (EVs) under service conditions, taking a 9.4Ah prismatic LIB as the study object, the internal resistance data under different state of health (SOH), state of charge (SOC), temperature (T), charge/discharge rates of LIB are obtained through the mixed-rate hybrid pulse power characterization (MR-HPPC) test. Based on this, a dynamic internal resistance model (DIRM) considering the SOH is proposed by the prediction of the least squares support vector machines (LS-SVM) model. In this study, a thermoelectric coupling model and a resistance-thermal co-simulation of the LIB are established based on DIRM, and the temperature rise characteristics under constant rates and dynamic operating conditions are investigated at different SOH states. The maximum DIRM error (DIRME) between DIRM-based simulated maximum transient temperature (Tmax-tra) and test Tmax-tra is 0.88 °C at constant charge/discharge rate operating conditions, while the maximum DIRME between DIRM-based simulated Tmax-tra and test Tmax-tra is 0.21 °C under dynamic operating conditions. The results can provide a theoretical support for improving the modeling precision of the heat generation of LIBs with different aging levels for accurate thermal management design.

Rapid monitoring of the spatial distribution of soil organic matter using unmanned aerial vehicle imaging spectroscopy

ABSTRACT An existing technique for quickly obtaining the spatial distribution data of soil organic matter (SOM) involves combining an unmanned aerial vehicle (UAV) platform and imaging spectroscopy technology; this technique is suitable for precision agricultural management and real-time monitoring. In this study, the average spectral data were first extracted via circular regions of interest (ROIs) of different radii and modelled using the measured SOM to determine the optimal extraction range for the spectral data. Partial least-squares regression (PLSR) and support vector machine (SVM) models were constructed based on the raw spectra, standard normal transform spectra, multiple scattering-corrected spectra, and first-order differential spectra. The difference index, ratio index, and normalized index were calculated and analysed for their correlation with SOM content, and the spectral indices were screened to establish the SOM prediction model. Finally, the accuracy of the model was evaluated, and we selected the optimal model to map the spatial distribution of SOM. The results of our study show that 1) the radius of the ROI significantly affects the model’s accuracy; 2) the accuracy of the nonlinear SVM model is much higher than that of the linear PLSR model; 3) the prediction model based on spectral indices is better than full-band model. This study can serve as a model for the application of UAV imaging spectroscopy technology to field-scale SOM estimations and rapid monitoring, as well as provide technical support for precision agriculture and climate change studies.

A Realistic Method for Diagnosing Bearing Faults of Three-Phase Induction Motor using Advanced Support Vector Machine Algorithm

Bearings are one of the most crucial components of any induction motor. The faults or failure of bearings can lead to high maintenance and operational costs. To ensure the induction motor operates consistently, it is crucial to identify and diagnose bearing faults at an early stage. In this perspective, this manuscript presents a method based on least square support vector machine (LSSVM) to identify the bearing defects of an induction motor. The IM parameters, such as stator currents, input voltage, and rotor speed, were extracted using experimental setup at different loads and health conditions of bearing. Then these parameters were used to train and validate the LSSVM algorithm in MATLAB to diagnose the bearing defects. The proposed method provides 97.14% fault prediction accuracy with an RBF kernel.

Effective approach to assess higher heating value of biomass from ultimate and proximate analysis

AbstractFor proper design and operation of biomass‐based energy systems, it is important to determine the higher heating value (HHV) of biomass. In this paper, two machine learning (ML) approaches, namely extra trees (ET) and least squares support vector machine (LSSVM), are used to predict the value of HHV associated with biofuels. The data required for HHV calculation, including proximate and ultimate analyses datasets, were collected from the literature. The performances of these two ML approaches for predicting biomass HHV were then compared with other smart models available in the literature. Even though the available empirical models can predict the biomass HHV with acceptable precision, it was found that our proposed ML techniques have a superior performance based on the error analysis; the proposed approaches also consider all key biomass characteristics in the developed models. In addition, the ET model proved to be slightly more accurate compared to the LSSVM model. Additionally, the developed proximate‐based ET model showed better performance compared to the ultimate‐based ET model. The most influential parameters in the developed ET models for the proximate and ultimate approaches were determined to be ash fraction and carbon fraction, respectively. Finally, it was concluded that the smart modelling techniques can be utilized as a robust and reliable alternative predictive methodology to replace direct laboratory measurement of the biomass HHV.

Numerical solutions to one dimensional linear Volterra–Fredholm integral equations based on LS-SVM model

This paper introduces a novel numerical approach using least squares support vector machine (LS-SVM) to handle one dimensional linear Volterra–Fredholm integral equations. This method can also handle weak singular kernel Fredholm/Volterra integral equations and linear systems of Volterra–Fredholm integral equations. By minimizing errors and utilizing least squares support vector machines, the approach derives continuous closed-form solutions to the origin problem. Ultimately, the method offers an efficient numerical approximation for solving Volterra–Fredholm integral equations through the resolution of linear equations. The paper includes multiple numerical examples that demonstrate the effectiveness and superiority of the proposed method.

Discrimination of New and Aged Seeds Based on On-Line Near-Infrared Spectroscopy Technology Combined with Machine Learning

The harvest year of maize seeds has a significant impact on seed vitality and maize yield. Therefore, it is vital to identify new seeds. In this study, an on-line near-infrared (NIR) spectra collection device (899–1715 nm) was designed and employed for distinguishing maize seeds harvested in different years. Compared with least squares support vector machine (LS-SVM), k-nearest neighbor (KNN), and extreme learning machine (ELM), the partial least squares discriminant analysis (PLS-DA) model has the optimal recognition performance for maize seed harvest years. Six different preprocessing methods, including Savitzky–Golay smoothing (SGS), standard normal variate transformation (SNV), multiplicative scatter correction (MSC), Savitzky–Golay 1 derivative (SG-D1), Savitzky–Golay 2 derivative (SG-D2), and normalization (Norm), were used to improve the quality of the spectra. The Monte Carlo cross-validation uninformative variable elimination (MC-UVE), competitive adaptive reweighted sampling (CARS), bootstrapping soft shrinkage (BOSS), successive projections algorithm (SPA), and their combinations were used to obtain effective wavelengths and decrease spectral dimensionality. The MC-UVE-BOSS-PLS-DA model achieved the classification with an accuracy of 88.75% using 93 features based on Norm preprocessed spectral data. This study showed that the self-designed NIR collection system could be used to identify the harvested years of maize seed.

Non-Destructive Detection of Cerasus Humilis Fruit Quality by Hyperspectral Imaging Combined with Chemometric Method

Cerasus Humilis fruit is susceptible to rapid color changes post-harvest, which degrades its quality. This research utilized hyperspectral imaging technology to detect and visually analyze the soluble solid content (SSC) and firmness of the fruit, aiming to improve quality and achieve optimal pricing. Four maturity stages (color turning stage, coloring stage, maturity stage, and fully ripe stage) of Cerasus Humilis fruit were examined using hyperspectral images (895–1700 nm) alongside data collection on SSC and firmness. These samples were divided into a calibration set and a validation set with a ratio of 3:1 by sample set partitioning based on the joint X-Y distances (SPXY) method. The original spectral data was processed by a spectral preprocessing method. Multiple linear regression (MLR) and nonlinear least squares support vector machine (LS-SVM) detection models were established using feature wavelengths selected by the successive projections algorithm (SPA), competitive adaptive reweighted sampling (CARS), uninformative variable elimination (UVE), and two combined downscaling algorithms (UVE-SPA and UVE-CARS), respectively. For SSC and firmness detection, the best models were the SNV-SPA-LS-SVM model with 18 feature wavelengths and the original spectra-UVE-CARS-LS-SVM model with eight feature wavelengths, respectively. For SSC, the correlation coefficient of prediction (Rp) was 0.8526, the root mean square error of prediction (RMSEP) was 0.9703, and the residual prediction deviation (RPD) was 1.9017. For firmness, Rp was 0.7879, RMSEP was 1.1205, and RPD was 2.0221. Furthermore, the optimal model was employed to retrieve the distribution of SSC and firmness within Cerasus Humilis fruit. This retrieved information facilitated visual inspection, enabling a more intuitive and comprehensive assessment of SSC and firmness at each pixel level. These findings demonstrated the effectiveness of hyperspectral imaging technology for determining SSC and firmness in Cerasus Humilis fruit. This paves the way for online monitoring of fruit quality, ultimately facilitating timely harvesting.

Non-destructive prediction of anthocyanin concentration in whole eggplant peel using hyperspectral imaging

Accurately detecting the anthocyanin content in eggplant peel is essential for effective eggplant breeding. The present study aims to present a method that combines hyperspectral imaging with advanced computational analysis to rapidly, non-destructively, and precisely measure anthocyanin content in eggplant fruit. For this purpose, hyperspectral images of the fruits of 20 varieties with diverse colors were collected, and the content of the anthocyanin were detected using high performance liquid chromatography (HPLC) methods. In order to minimize background noise in the hyperspectral images, five preprocessing algorithms were utilized on average reflectance spectra: standard normalized variate (SNV), autoscales (AUT), normalization (NOR), Savitzky–Golay convolutional smoothing (SG), and mean centering (MC). Additionally, the competitive adaptive reweighted sampling (CARS) method was employed to reduce the dimensionality of the high-dimensional hyperspectral data. In order to predict the cyanidin, petunidin, delphinidin, and total anthocyanin content of eggplant fruit, two models were constructed: partial least squares regression (PLSR) and least squares support vector machine (LS-SVM). The HPLC results showed that eggplant peel primarily contains three types of anthocyanins. Furthermore, there were significant differences in the average reflectance rates between 400–750 nm wavelength ranges for different colors of eggplant peel. The prediction model results indicated that the model based on NOR CARS LS-SVM achieved the best performance, with a squared coefficient of determination (R2) greater than 0.98, RMSEP and RMSEC less than 0.03 for cyanidin, petunidin, delphinidin, and total anthocyanin predication. These results suggest that hyperspectral imaging is a rapid and non-destructive technique for assessing the anthocyanin content of eggplant peel. This approach holds promise for facilitating the more effective eggplant breeding.

Multi-step carbon emissions forecasting model for industrial process based on a new strategy and machine learning methods

The rising industrial sector capacity increases carbon emissions, necessitating a low-carbon transformation for global sustainability. Accurate multi-step forecasting of industrial carbon emissions is crucial for optimizing production, reducing energy consumption, improving efficiency, and achieving decarbonization. However, current forecasting faces challenges like model uncertainty and low accuracy with multi forecasting steps. To address these issues, this study proposed a multi-step carbon emissions forecasting model for industrial processes. Firstly, a new multi-step forecasting strategy framework was proposed. Secondly, SHapley Additive exPlanations (SHAP) and lagged autocorrelation analysis were used to extract key features affecting industrial carbon emissions. On this basis, the grey model, autoregressive moving average (ARMA) model, and least squares support vector machine (LSSVM) method were used to build forecasting models separately. The weights of the three models were solved using the induced ordered weighted average operator and the Monte Carlo search tree (MCST) method. The final forecasting results were obtained by using the weighted summation method. The data collected from the real industry were used to validate the proposed model. The results showed that the proposed model could accurately forecast industrial carbon emissions within 12 steps and its MAPE is less than 10%. The proposed multi-step industrial carbon emissions forecasting model can provide data support for industrial energy saving, carbon reduction, and green and sustainable development.

Modeling and Optimization of an Enhanced Soft Sensor for the Fermentation Process of Pichia pastoris.

This paper proposes a novel soft sensor modeling approach, MIC-TCA-INGO-LSSVM, to address the decline in performance of soft sensor models during the fermentation process of Pichia pastoris, caused by changes in working conditions. Initially, the transfer component analysis (TCA) method is utilized to minimize the differences in data distribution across various working conditions. Subsequently, a least squares support vector machine (LSSVM) model is constructed using the dataset adapted by TCA, and strategies for improving the northern goshawk optimization (INGO) algorithm are proposed to optimize the parameters of the LSSVM model. Finally, to further enhance the model's generalization ability and prediction accuracy, considering the transfer of knowledge from multiple-source working conditions, a sub-model weighted ensemble scheme is proposed based on the maximum information coefficient (MIC) algorithm. The proposed soft sensor model is employed to predict cell and product concentrations during the fermentation process of Pichia pastoris. Simulation results indicate that the RMSE of the INGO-LSSVM model in predicting cell and product concentrations is reduced by 47.3% and 42.1%, respectively, compared to the NGO-LSSVM model. Additionally, TCA significantly enhances the model's adaptability when working conditions change. Moreover, the soft sensor model based on TCA and the MIC-weighted ensemble method achieves a reduction of 41.6% and 31.3% in the RMSE for predicting cell and product concentrations, respectively, compared to the single-source condition transfer model TCA-INGO-LSSVM. These results demonstrate the high reliability and predictive performance of the proposed soft sensor method under varying working conditions.

Double decomposition with enhanced least-squares support vector machine to predict water level

ABSTRACT As global climates undergo changes, the frequency of water-related disasters rises, leading to significant economic losses and safety hazards. During flood events, river water levels exhibit unpredictable fluctuations, introducing considerable noise that poses challenges for accurate prediction. A prediction of water level by using existing water level data makes a major contribution to forecasting flood. Enhanced least-squares support vector machine (ELSSVM) is utilized by integrating an additional extra bias error control term. In this study, least-squares support vector machine (LSSVM) and ELSSVM optimized by the genetic algorithm (GA) were chosen to be compared with the help of data decomposition methods to improve daily water level prediction accuracy. Double empirical mode decomposition (DEMD) will be integrated with LSSVM and ELSSVM. Thus, the models are named LSSVM-GA, ELSSVM-GA, empirical mode decomposition (EMD)-LSSVM-GA, EMD-ELSSVM-GA, DEMD-LSSVM-GA, and DEMD-ELSSVM-GA. The proposed models are used in forecasting the water level of Klang River in Sri Muda, Malaysia. The behavior proposed models are investigated and compared based on several performance metrics. The results demonstrated that the DEMD-ELSSVM-GA model outperformed the other models based on the performance analysis in forecasting the water level with RMSE = 0.2536 m and R2 = 0.8596 for testing data that indicate the forecasting accuracy.

Cutting-edge tool wear monitoring in AISI4140 steel hard turning using least square-support vector machine

ABSTRACT This research addresses the critical challenge of tool wear monitoring in AISI4140 steel hard turning through the innovative application of a Least Square-Support Vector Machine (LS-SVM) prediction model. While acknowledging the growing significance of hard turning over conventional grinding techniques, the background also recognizes the challenges posed by accelerated tool wear and decreased productivity. The main goal is to create a reliable tool wear prediction model that is tailored to harsh turning circumstances. Material selection, cutting force measurement, acceleration measurement, and accurate tool wear measurement are all included in the experimental procedures. Using time and frequency domain analyses, the research methodically examines how cutting force and acceleration affect tool wear. For feature selection, non-linear regression is used to determine which parameters have the greatest influence on wear. A comprehensive training and validation procedure, structural clarification, and a detailed mathematical foundation are used in the development of the LS-SVM-based tool wear prediction model. The presentation of the findings and related discussions explores the impact of acceleration and cutting force on wear. The LS-SVM model’s successful application for precise tool wear prediction in AISI4140 steel hard turning is highlighted in the conclusions, demonstrating the model’s potential to improve tool lifespan and manufacturing efficiency.

Forecasting ionospheric TEC using least squares support vector machine and moth-flame optimization methods in China

The total electron content (TEC) of the ionosphere is an important parameter to describe the ionosphere, and it is a great significance to monitor and predict it accurately. In this paper, a hybrid ionospheric TEC prediction model based on the least squares support vector machine (LSSVM) and the Moth-Flame Optimization (MFO) algorithm is proposed. The parameters of the LSSVM model are optimized by the MFO algorithm. We use observation data of 15 GNSS stations from the Crustal Movement Observation Network of China (CMONOC) to extract ionospheric TEC from 2012 to 2019. The ionospheric TEC is forecasted using solar and geomagnetic activity indices in both the low solar activity year (2019) and the high solar activity year (2015). The results show that the prediction performance of the MFO_LSSVM model is significantly better than that of the IRI model, SVM model, and LSSVM model. Compared with the other three models, there are more stable prediction results in the low and high solar activity years. At the same time, the predicted value of the MFO_LSSVM model has a good correlation with the measured value, and it also has good prediction potential in areas with active geomagnetic activity. The comparison with the Long Short-Term Memory (LSTM) model shows that the MFO_LSSVM model has better performance than the single LSTM model. In conclusion, the MFO_LSSVM model can accurately predict ionospheric TEC in China, and has better accuracy than traditional long-term and short-term models.

Hyperspectral imaging features for structural stress state assessment: An experimental study

To explore the feasibility of hyperspectral machine vision for detecting stress states of underground structures, this study utilized a hyperspectral camera to acquire spectral datasets from the surfaces of concrete and sandstone specimens under different stress conditions. Machine learning models were established to predict stress states based on raw spectral data and data pre-processed using the Savitzky-Golay (S-G) method. The results indicated that satisfactory outcomes were obtained with no pre-processing and S-G pre-processing. In addition, the hyperspectral response characteristics of concrete and sandstone under different stress states were investigated. The hyperspectral dataset of sandstone was observed to yield higher predictive accuracy than that of concrete. Finally, a comprehensive analysis of the performances of the principal component regression, partial least squares regression, and least-squares support vector machine models was performed over various datasets in terms of computed model evaluation metrics.

Intelligence modeling of the flow boiling heat transfer of nanorefrigerant for integrated energy system

To promote the application of nanorefrigerant in Organic Rankine Cycle and Integrated Energy System a reliable model with simple structure and favorable accuracy for predicting the flow boiling heat transfer coefficient (HTC) of nanorefrigerant is essential. In this work, four intelligence models—the radial basis function (RBF), multilayer perceptron (MLP), least squares support vector machine (LSSVM), and adaptive neuro fuzzy inference system (ANFIS)—were developed to predict the flow boiling heat transfer coefficient using nanorefrigerants, based on 765 experimental samples. The performances of these artificial intelligence models were comprehensively evaluated through accuracy analysis, variation trend analysis, and sensitivity analysis. Results indicated that the comprehensive performance of the RBF model was superior than those of other intelligence models and the existing empirical models. The RBF model accurately captured the variation trend of the output as the input variables were varied. Meanwhile, the impact degrees of all input variables in decreasing order were nanoparticle concentration (φ), mass flux (G), thermal conductivity of nanoparticle (kp), and vapor quality (x).

Comparing visible and near infrared ‘point’ spectroscopy and hyperspectral imaging techniques to visualize the variability of apple firmness

In this work, visible and near-infrared ‘point’ (Vis-NIR) spectroscopy and hyperspectral imaging (Vis-NIR-HSI) techniques were applied on three different apple cultivars to compare their firmness prediction performances based on a large intra-variability of individual fruit, and develop rapid and simple models to visualize the variability of apple firmness on three apple cultivars. Apples with high degree of intra-variability can strongly affect the prediction model performances. The apple firmness prediction accuracy can be improved based on the large intra-variability samples with the coefficient variation (CV) values over 10%. The least squares-support vector machine (LS-SVM) models based on Vis-NIR-HSI spectra had better performances for firmness prediction than that of Vis-NIR spectroscopy, with the with the Rc2 over 0.84. Finally, The Vis-NIR-HSI technique combined with least squares-support vector machine (LS-SVM) models were successfully applied to visualize the spatial the variability of apple firmness.

Apparent Resistivity Variation Imaging Method Based on Magnetic Field Gradient by NGO-LSSVM for the Ground-Airborne Frequency-Domain Electromagnetic Method

Apparent resistivity imaging is a typical rapid imaging method in the ground-airborne frequency-domain electromagnetic method. At present, the apparent resistivity is typically calculated by the measured magnetic field, however, this imaging method exhibits limited capability in recognizing the center of three-dimensional anomalies. Therefore, this paper proposed the calculation of apparent resistivity using magnetic field gradients. To solve the problem of random artificial anomalies that existed during the calculated process, this paper presents a hybrid least square support vector machine (LSSVM) and Northern Goshawk optimization (NGO) to establish the mapping relationship between the magnetic field gradient and apparent resistivity variation. This approach enables accurate prediction of apparent resistivity variations and effectively resolves the challenge of correcting background resistivity. Furthermore, three typical theoretical models and field examples are used to predict the apparent resistivity variation, the imaging results demonstrate that the proposed NGO-LSSVM algorithm is a feasible and efficient tool for predicting the apparent resistivity variation with high accuracy. This study provides a novel and efficient imaging method, which facilitates the application of ground-airborne frequency-domain electromagnetics for high-resolution detection requirements, such as mineral exploration.

Research on blasting vibration prediction based on BFO-LSSVM and its engineering application

In order to realize the accurate prediction of blasting vibration, the LS-SVM optimization model based on BFO algorithm is constructed with the help of bacterial foraging algorithm (BFO) and least squares support vector machine (LS-SVM) theory. 30 groups of blasting data are used as training samples to test the prediction accuracy of the model, and the main factors affecting the propagation of blasting vibration are selected as the input factors, such as single shot charge, blasting center distance, elevation difference, blockage, hole depth and other factors as the input factors, and blasting vibration as the output factor of the prediction model. The results show that the prediction accuracy of BFO-LSSVM model is higher than that of LS-SVM model under the same sample size. Taking the measured vibration data of excavation blasting of Wuqiangxi power station as an example, the average error of BFO-LSSVM model is 5.57%, which verifies the feasibility and practicability of the prediction model.

Online prediction of the enzymatic hydrolysis efficiency of crop straw

The extent of removal of lignin and hemicellulose are crucial indicators for evaluating the efficiency of enzymatic hydrolysis of crop straw. Numerous factors influence these two indices. Establishing a quantitative model that correlates these factors with hydrolysis efficiency is essential, as it can guide efficient hydrolysis. In this study, a predictive method for enzymatic hydrolysis efficiency in crop straw was proposed using Grey relational analysis (GRA), Kernel principal component analysis (KPCA), and a least squares support vector machine (LSSVM). The authors collected a dataset from actual production data and developed an efficiency predictive model using GRA for variable selection, KPCA for dimensionality reduction, and LSSVM for model training. This model allows for the direct estimation of the final enzymatic hydrolysis efficiency based on production condition variables, which can include enzyme amount, temperatures, pH, time, agitation, and straw dimensions. Extensive experimental testing validated the effectiveness of the proposed method, resulting in minimal errors, a high degree of fit, and exceptional performance. The methodology described in this study can serve as a foundation for optimising the design of efficient enzymatic hydrolysis production processes for crop straw. Additionally, it offers valuable soft measurements to support efficient control of the enzymatic hydrolysis process.