Squares-support Vector Machine Research Articles

Copper Price Forecasting Based on Improved Least Squares Support Vector Machine with Butterfly Optimization Algorithm

Copper Price Forecasting Based on Improved Least Squares Support Vector Machine with Butterfly Optimization Algorithm

Cutting-edge tool wear monitoring in AISI4140 steel hard turning using least square-support vector machine

ABSTRACT This research addresses the critical challenge of tool wear monitoring in AISI4140 steel hard turning through the innovative application of a Least Square-Support Vector Machine (LS-SVM) prediction model. While acknowledging the growing significance of hard turning over conventional grinding techniques, the background also recognizes the challenges posed by accelerated tool wear and decreased productivity. The main goal is to create a reliable tool wear prediction model that is tailored to harsh turning circumstances. Material selection, cutting force measurement, acceleration measurement, and accurate tool wear measurement are all included in the experimental procedures. Using time and frequency domain analyses, the research methodically examines how cutting force and acceleration affect tool wear. For feature selection, non-linear regression is used to determine which parameters have the greatest influence on wear. A comprehensive training and validation procedure, structural clarification, and a detailed mathematical foundation are used in the development of the LS-SVM-based tool wear prediction model. The presentation of the findings and related discussions explores the impact of acceleration and cutting force on wear. The LS-SVM model’s successful application for precise tool wear prediction in AISI4140 steel hard turning is highlighted in the conclusions, demonstrating the model’s potential to improve tool lifespan and manufacturing efficiency.

Estimating Soil Erodible Fraction Using Multivariate Regression and Proximal Sensing Data in Arid Lands, South Egypt

Estimating soil erodible fraction based on basic soil properties in arid lands is a valuable research topic in the field of soil science and land management. The Proximal Sensing (PS) technique offers a non-destructive and efficient method to assess wind erosion potential in arid regions. By using Partial Least Squares Regression (PLSR) and Support Vector Machine (SVM) models and combining soil texture and chemical properties, determined through Visible-Near Infrared (vis-NIR) spectroscopy in 96 soil samples, this study aims to predict soil erodibility, soil organic matter (SOM), and calcium carbonate equivalent (CaCO3) in arid lands located in Elkobaneyya Valley, Aswan Governorate, Egypt. Results showed that the soil erodibility fraction (EF-Factor) had the highest values and possessed a strong relationship between slope and SOM of 0.01% in determining soil erodibility. The PLSR model performed better than SVM for estimating SOM, CaCO3, and EF-Factor. Furthermore, the results showed that the spectral responses of CaCO3 were observed in separate places in the wavelengths of 570, 649, 802, 1161, 1421, 1854, and 2362 nm, and the wavelengths with SOM parameter were 496, 658, 779, 1089, 1417, 1871, and 2423 nm. The EF-factor shows the highest significant correlation with spectral reflectance values at 526, 688, 744, 1418, 1442, 2292, and 2374 nm. The accuracy and performance of the PLSR model in estimating the EF-Factor using spectral reflectance data and the distribution of data points for both the calibration and validation data-sets indicate a good accuracy of the PLSR model, with RMSE values of 0.0921 and 0.0836 Mg h MJ−1 mm−1, coefficient of determination (R2) values of 0.931 and 0.76, and RPD values of 2.168 and 2.147, respectively.

Comparing visible and near infrared ‘point’ spectroscopy and hyperspectral imaging techniques to visualize the variability of apple firmness

In this work, visible and near-infrared ‘point’ (Vis-NIR) spectroscopy and hyperspectral imaging (Vis-NIR-HSI) techniques were applied on three different apple cultivars to compare their firmness prediction performances based on a large intra-variability of individual fruit, and develop rapid and simple models to visualize the variability of apple firmness on three apple cultivars. Apples with high degree of intra-variability can strongly affect the prediction model performances. The apple firmness prediction accuracy can be improved based on the large intra-variability samples with the coefficient variation (CV) values over 10%. The least squares-support vector machine (LS-SVM) models based on Vis-NIR-HSI spectra had better performances for firmness prediction than that of Vis-NIR spectroscopy, with the with the Rc2 over 0.84. Finally, The Vis-NIR-HSI technique combined with least squares-support vector machine (LS-SVM) models were successfully applied to visualize the spatial the variability of apple firmness.

Biochar-enhanced concrete mixes: Pioneering multi-objective optimization

The incorporation of biochar (BC) as a partial substitute for cement in concrete formulations provides a promising pathway for mitigating the environmental impacts associated with carbon dioxide emissions during cement production. To achieve optimal composition of BC-enhanced concrete, multiple objectives including mechanical strength, economic factors, and embodied CO2 must be balanced while considering a multitude of variables constrained by complex non-linear relationships. Here, we introduced an intelligent hybrid optimization algorithm that combines Particle Swarm Optimization (PSO), Least Squares Support Vector Machine (LSSVM), and Non-dominated Sorting Genetic Algorithm II (NSGAII) to predict the performance of BC-enhanced concrete and optimize its mix proportions for multiple objectives. Our results demonstrate that the PSO optimization algorithm for searching LSSVM hyper parameters outperforms other optimization algorithms, exhibiting higher generalization performance and improved overall accuracy (R2 = 0.95). Furthermore, the proposed model framework effectively presents a complete Pareto front for the BC-enhanced concrete mix ratio. This triangular model system for concrete mix ratio can determine the optimal solution, tailored to the preferences of the owner's unit. Ultimately, PSO-LSSVM-NSGAII intelligent hybrid optimization algorithm enhances the efficiency of mix proportion design for BC-enhanced concrete.

Low-abundance proteins-based label-free SERS approach for high precision detection of liver cancer with different stages

BackgroundSurface-enhanced Raman scattering (SERS) technology have unique advantages of rapid, simple, and highly sensitive in the detection of serum, it can be used for the detection of liver cancer. However, some protein biomarkers in body fluids are often present at ultra-low concentrations and severely interfered with by the high-abundance proteins (HAPs), which will affect the detection of specificity and accuracy in cancer screening based on the SERS immunoassay. Clearly, there is a need for an unlabeled SERS method based on low abundance proteins, which is rapid, noninvasive, and capable of high precision detection and screening of liver cancer. ResultsSerum samples were collected from 60 patients with liver cancer (27 patients with stage T1 and T2 liver cancer, 33 patients with stage T3 and T4 liver cancer) and 40 healthy volunteers. Herein, immunoglobulin and albumin were separated by immune sorption and Cohn ethanol fractionation. Then, the low abundance protein (LAPs) was enriched, and high-quality SERS spectral signals were detected and obtained. Finally, combined with the principal component analysis-linear discriminant analysis (PCA-LDA) algorithm, the SERS spectrum of early liver cancer (T1-T2) and advanced liver cancer (T3-T4) could be well distinguished from normal people, and the accuracy rate was 98.5% and 100%, respectively. Moreover, SERS technology based on serum LAPs extraction combined with the partial least square-support vector machine (PLS-SVM) successfully realized the classification and prediction of normal volunteers and liver cancer patients with different tumor (T) stages, and the diagnostic accuracy of PLS-SVM reached 87.5% in the unknown testing set. SignificanceThe experimental results show that the serum LAPs SERS detection combined with multivariate statistical algorithms can be used for effectively distinguishing liver cancer patients from healthy volunteers, and even achieved the screening of early liver cancer with high accuracy (T1 and T2 stage). These results showed that serum LAPs SERS detection combined with a multivariate statistical diagnostic algorithm has certain application potential in early cancer screening.

Crashworthiness Analysis and Optimization of Thin-Walled Structures Based on the TSSA-LSSVM Surrogate Model

Thin-Walled Structures (TWS) play a crucial role in enhancing both the collision safety and lightweight characteristics of vehicles. Structural design and optimization have demonstrated significant potential in improving their crashworthiness and overall weight reduction. Several interconnected factors, including the cross-sectional shape and parameters of distinctive structural characteristics (known as induction grooves), impact the TWS’ resistance to collisions. Another critical aspect in the optimization of TWS design is striking the delicate balance between the surrogate model’s effectiveness and precision. Taking all these factors into account, this paper conducts an in-depth investigation into the cross-sectional shape, grooves, and other geometric attributes of various TWSs through a comparative analysis. It reveals that the thin-walled structure with a Double-Ribbed Rectangle cross-section (DR-TWS) proves to be the optimal choice, particularly in low-speed axial impact scenarios. Furthermore, we present an enhanced Least Squares Support Vector Machine (LSSVM) method, augmented with an adaptive [Formula: see text]-distribution Sparrow Search Algorithm (TSSA), referred to as the TSSA-LSSVM surrogate model. The optimized design of the DR-TWS is realized through the integration of the TSSA-LSSVM surrogate model with the adaptive hybrid multi-objective particle swarm optimization (AHMOPSO) algorithm. This paper not only provides substantial theoretical support but also offers valuable guidelines for the application of TWSs in the automotive industry.

Antenna Shape Modeling based on Histogram of Oriented Gradients Feature

A least square support vector machine (SVM) model is proposed for shape modeling of slot antennas. The slot image is mapped into the electromagnetic response by the SVM model. A modified shape-changing technique is also proposed to describe the antenna geometry by the quadratic uniform B-spline curve and generate the slot images. In the model, the histogram of oriented gradients feature is extracted from the slot images to show the appearance and shape of the slot. The relationship between the histogram of oriented gradient features and the electromagnetic responses is preliminarily built on SVM and the transfer function. Then a radial basis function network is used for error correction. The effectiveness of the proposed model is confirmed with an example of a tri-band microstrip-fed slot antenna. Compared with the convolutional neural network (CNN), the feature extracted by CNN is substituted by the histogram of oriented gradients feature, and the proposed model shows the same accuracy and the improvement of training efficiency.

Prediction of Depth-Averaged Velocity for Flow Though Submerged Vegetation Using Least Squares Support Vector Machine with Bayesian Optimization

Prediction of Depth-Averaged Velocity for Flow Though Submerged Vegetation Using Least Squares Support Vector Machine with Bayesian Optimization

Improved Least Squares Support Vector Machine Model Based on Grey Wolf Optimizer Algorithm for Predicting CO2–Crude Oil Minimum Miscibility Pressure

The minimum miscibility pressure (MMP) is an important reference parameter in the study of CO2 oil drive systems. In response to the problems of time‐consuming and costly prediction of MMP by conventional experimental methods, an improved least squares support vector machine (LSSVM) model based on grey wolf optimizer (GWO) algorithm is proposed to predict the CO2–crude oil MMP. Based on Pearson correlation analysis, reservoir temperature, C5+ molecular weight, intermediate component mole fraction, and volatile component mole fraction are selected as independent variables of the model, and MMP is the dependent variable. A total of 51 MMP experimental data are collected, of which 35 are used to fine‐tune the model's parameters and 16 are used to verify the model's reliability. The high leverage point method is used to detect anomalies in all experimental data to check the reliability of the model, and the abnormality of only one piece of experimental data is identified. Finally, a comparison of the model with other intelligent models is found. The absolute relative deviation of the GWO‐LSSVM model is 2.24% for the training data and 3.48% for the test data, which provides high adaptability and accuracy.

Research on the method of identifying upper and lower limb coordinated movement intentions based on surface EMG signals.

Rehabilitation robots have gained considerable focus in recent years, aiming to assist immobilized patients in regaining motor capabilities in their limbs. However, most current rehabilitation robots are designed specifically for either upper or lower limbs. This limits their ability to facilitate coordinated movement between upper and lower limbs and poses challenges in accurately identifying patients' intentions for multi-limbs coordinated movement. This research presents a multi-postures upper and lower limb cooperative rehabilitation robot (U-LLCRR) to address this gap. Additionally, the study proposes a method that can be adjusted to accommodate multi-channel surface electromyographic (sEMG) signals. This method aims to accurately identify upper and lower limb coordinated movement intentions during rehabilitation training. By using genetic algorithms and dissimilarity evaluation, various features are optimized. The Sine-BWOA-LSSVM (SBL) classification model is developed using the improved Black Widow Optimization Algorithm (BWOA) to enhance the performance of the Least Squares Support Vector Machine (LSSVM) classifier. Discrete movement recognition studies are conducted to validate the exceptional precision of the SBL classification model in limb movement recognition, achieving an average accuracy of 92.87%. Ultimately, the U-LLCRR undergoes online testing to evaluate continuous motion, specifically the movements of "Marching in place with arm swinging". The results show that the SBL classification model maintains high accuracy in recognizing continuous motion intentions, with an average identification rate of 89.25%. This indicates its potential usefulness in future rehabilitation robot-active training methods, which will be a promising tool for a wide range of applications in the fields of healthcare, sports, and beyond.

A dual-scale hybrid prediction model for UAV demand power: Based on VMD and SSA optimization algorithm

The prediction of power demand for unmanned aerial vehicles (UAV) is an essential basis to ensure the rational distribution of the energy system and stable economic flight. In order to accurately predict the demand power of oil-electric hybrid UAV, a method based on variational mode decomposition (VMD) and Sparrow Search Algorithm (SSA) is proposed to optimize the hybrid prediction model composed of long-short term memory (LSTM) and Least Squares Support Vector Machine (LSSVM). Firstly, perform VMD decomposition on the raw demand power data and use the sample entropy method to classify the feature-distinct mode components into high-frequency and low-frequency categories. Then, each modality component was separately input into the mixed model for rolling prediction. The LSSVM model and LSTM model were used to process low-frequency and high-frequency components, respectively. Finally, the predicted values for each modal component are linearly combined to obtain the final predicted value for power demand. Compared with the current models, the prediction model constructed in this paper stands out for its superior ability to track the changing trends of power demand and achieve the highest level of prediction accuracy.

Genetic algorithm based detection of breast cancer using least square-support vector machine classifier

Breast tumors are a dangerous disease among women worldwide. They are the second leading cause of death among all forms of cancers in women. Their early detection is critical to increasing the survival rate of women. Mammography is a reliable screening technique in the early detection of abnormal breast tissue severity. Radiologist abnormalities in the breast tissue, radiologists employ mammography. However, detecting breast abnormalities through digital diagnostic techniques by a radiologist could be time consuming. Consequently, computerized studying of digital mammography has emerged via the development of CAD systems. Several CAD systems have been developed for breast cancer detection. However, obtaining a satisfactory performance of CAD systems is a challenging task. We propose a CAD architecture for the classification of breast tissues as either benign or malignant using an LS-SVM classifier with various kernels namely linear, quadratic, polynomial, MLP, and RBF kernels. From the experimental outputs, it is clear that GA based LS-SVM classifier with RBF kernel outputs classification accuracy of 94.59% for normal/abnormal case classification is better, when it is compared with all other kernels. It is also stated that GA based LS-SVM classifier with RBF kernel produces a better classification accuracy of 98.26% for benign/malignant case classification when it is compared with other reported works.

Line Laser Scanning Combined with Machine Learning for Fish Head Cutting Position Identification.

Fish head cutting is one of the most important processes during fish pre-processing. At present, the identification of cutting positions mainly depends on manual experience, which cannot meet the requirements of large-scale production lines. In this paper, a fast and contactless identification method of cutting position was carried out by using a constructed line laser data acquisition system. The fish surface data were collected by a linear laser scanning sensor, and Principal Component Analysis (PCA) was used to reduce the dimensions of the dorsal and abdominal boundary data. Based on the dimension data, Least Squares Support Vector Machines (LS-SVMs), Particle Swarm Optimization-Back Propagation (PSO-BP) networks, and Long and Short Term Memory (LSTM) neural networks were applied for fish head cutting position identification model establishment. According to the results, the LSTM model was considered to be the best prediction model with a determination coefficient (R2) value, root mean square error (RMSE), mean absolute error (MAE), and residual predictive deviation (RPD) of 0.9480, 0.2957, 0.1933, and 3.1426, respectively. This study demonstrated the reliability of combining line laser scanning techniques with machine learning using LSTM to identify the fish head cutting position accurately and quickly. It can provide a theoretical reference for the development of intelligent processing and intelligent cutting equipment for fish.

Least square-support vector machine based brain tumor classification system with multi model texture features

Radiologists confront formidable challenges when confronted with the intricate task of classifying brain tumors through the analysis of MRI images. Our forthcoming manuscript introduces an innovative and highly effective methodology that capitalizes on the capabilities of Least Squares Support Vector Machines (LS-SVM) in tandem with the rich insights drawn from Multi-Scale Morphological Texture Features (MMTF) extracted from T1-weighted MR images. Our methodology underwent meticulous evaluation on a substantial dataset encompassing 139 cases, consisting of 119 cases of aberrant tumors and 20 cases of normal brain images. The outcomes we achieved are nothing short of extraordinary. Our LS-SVM-based approach vastly outperforms competing classifiers, demonstrating its dominance with an exceptional accuracy rate of 98.97%. This represents a substantial 3.97% improvement over alternative methods, accompanied by a notable 2.48% enhancement in Sensitivity and a substantial 10% increase in Specificity. These results conclusively surpass the performance of traditional classifiers such as Support Vector Machines (SVM), Radial Basis Function (RBF), and Artificial Neural Networks (ANN) in terms of classification accuracy. The outstanding performance of our model in the realm of brain tumor diagnosis signifies a substantial leap forward in the field, holding the promise of delivering more precise and dependable tools for radiologists and healthcare professionals in their pivotal role of identifying and classifying brain tumors using MRI imaging techniques.

Prediction of the Productivity Ratio of Perforated Wells Using Least Squares Support Vector Machine with Particle Swarm Optimization

The productivity ratio is a vital metric for assessing the efficiency of perforated completions. Accurate and rapid prediction of this ratio is essential for optimizing the perforation design. In this study, we propose a novel approach that combines three-dimensional finite element numerical simulation and machine learning techniques to predict the productivity ratio of perforated wells. Initially, we obtain the productivity ratio of perforated wells under various perforation parameters using three-dimensional finite element numerical simulation. This generates a sample set for machine learning. Subsequently, we employ the least squares support vector machine (LSSVM) algorithm to establish a prediction model for the productivity ratio of perforated wells. To optimize the parameters of the LSSVM algorithm, we utilize the particle swarm optimization (PSO) algorithm. We compare our proposed PSO-LSSVM model with that established based on other parameter optimization methods and machine learning algorithms, such as Grid search-LSSVM, PSO-ANN, and PSO-RF. Our results demonstrate that the PSO-LSSVM model exhibits rapid convergence, high prediction accuracy, and strong generalization ability in predicting the productivity ratio of perforated wells. This research provides a valuable reference and guidance for optimizing perforation design. Additionally, it offers new insights into predicting the productivity of complex completions.

PREDICTION OF EPILEPSY BASED ON EEMD AND LSSVM DOUBLE CLASSIFICATION

Epilepsy seizures are caused by abnormal, excessive, or synchronized neuronal activity in the brain, which is difficult to treat and is extremely stubborn. Therefore, studying the activity of epilepsy can greatly contribute to its diagnosis and treatment. The original signal is decomposed into IMFs and residual by ensemble empirical mode decomposition (EEMD), and then the first three intrinsic mode functions (IMF) are selected to replace the original signal, and the nonlinear and non-stationary problems of the original signal are solved. The Least Squares Support Vector Machine (LSSVM) was used as the classifier, its parameters (gam and sig2) are optimized by Particle Swarm Optimization (PSO). The experiment used the EEG database published by the University of Bonn (UoB) to realize the classification of normal, interictal and ictal periods. When PSO was employed, the recognition accuracy of the test set was 93.33%, with a classification time of 0.035 s and the Information Transfer Rate (ITR) of 3.77 bpm in training 70 classes with 100 samples each. In contrast, without PSO, the recognition accuracy of the test set was 92%, with a classification time of 0.039 s and the ITR of 2.88 bpm without PSO in training 70 classes with 100 samples each. The experimental results show that EEMD and LSSVM can effectively implement the three-classification problem and provide an effective means for the onset prediction of epilepsy patients.

A novel and intelligent chemometric-electrochemical-enzymatic biosensing procedure and mimicking a clinical condition environment to trick the red blood cells for counting them under physiological conditions: A new connection among chemometry, electrochemistry and hematology

Here, a novel electrochemical biosensing procedure has been developed for determination of the number of red blood cells (RBCs) under physiochemical conditions based on chemometric modeling of hydrodynamic differential pulse voltammetric (HDPV), and amperometric data as responses of a modified edge plane pyrolytic graphite electrode (EPPGE). In order to obtain a good sensitivity from the EPPGE, its surface was modified with a thin layer of multiwalled carbon nanotubes-ionic liquid (MWCNTs-IL). Catalase (CAT) was immobilized onto the surface of MWCNTs-IL/EPPGE with help of nafion. The response of the biosensor was based on electrochemical reduction of oxygen of the blood samples which was enhanced by a trick based on addition of hydrogen peroxide (H2O2) to blood samples which can be reduced by the CAT to produce extra oxygen. Prior to experiments, the solution in electrochemical cell was bubbled with pure N2 to purge the oxygen in the solution, but in order to increase the selectivity of the biosensor towards detection of the oxygen obtained from the red blood cells, voltammetric responses of the biosensor were modeled by multivariate chemometric calibration methods with the help of radial basis function-partial least squares (RBF-PLS), least squares-support vector machines (LS-SVM), recursive weighted partial least squares (rPLS), ant colony optimization-mathematical pre-processing selection by genetic algorithm-sample selection through a distance-based procedure-partial least squares-1 (ACO-GA-SS-PLS1), and radial basis function-artificial neural networks (RBF-ANN) to select the best method for determination of the number of the RBCs. The results confirmed the amperometric methods modeled by RBF-ANN showed the best performance for supporting the biosensor in determination of the number of the RBCs with a performance which had an excellent compatibility with the results of a hemocytometer. The results of this study as the newest application of chemometric-electrochemical methods can make a strong connection among electrochemists, chemometricians and hematologists to expand their collaborations on determination of blood factors.

Predicting Sugarcane Yield via the Use of an Improved Least Squares Support Vector Machine and Water Cycle Optimization Model

As a raw material for sugar, ethanol, and energy, sugarcane plays an important role in China’s strategic material reserves, economic development, and energy production. To guarantee the sustainable growth of the sugarcane industry and boost sustainable energy reserves, it is imperative to forecast the yield in the primary sugarcane production regions. However, due to environmental differences caused by regional differences and changeable climate, the accuracy of traditional models is generally low. In this study, we counted the environmental information and yield of the main sugarcane-producing areas in the past 15 years, adopted the LSSVM algorithm to construct the environmental information and sugarcane yield model, and combined it with WCA to optimize the parameters of LSSVM. To verify the validity of the proposed model, WCA-LSSVM is applied to two instances based on temporal differences and geographical differences and compared with other models. The results show that the accuracy of the WCA-LSSVM model is much better than that of other yield prediction models. The RMSE of the two instances are 5.385 ton/ha and 5.032 ton/ha, respectively, accounting for 7.65% and 6.92% of the average yield. And the other evaluation indicators MAE, R2, MAPE, and SMAPE are also ahead of the other models to varying degrees. We also conducted a sensitivity analysis of environmental variables at different growth stages of sugarcane and found that in addition to the main influencing factors (temperature and precipitation), soil humidity at different depths had a significant impact on crop yield. In conclusion, this study presents a highly precise model for predicting sugarcane yield, a useful tool for planning sugarcane production, enhancing yield, and advancing the field of agricultural production prediction.

Comparison of Machine Learning Algorithms for Species Family Classification using DNA Barcode

Classifying plant species within the Liliaceae and Amaryllidaceae families presents inherent challenges due to the complex genetic diversity and overlapping morphological traits among species. This study explores the difficulties in accurate classification by comparing 11 supervised learning algorithms applied to DNA barcode data, aiming to enhance the precision of species family classification in these taxonomically intricate plant families. The ribulose-1,5-bisphosphate carboxylase-oxygenase large sub-unit (rbcL) gene, selected as a DNA barcode locus for plants, is used to represent species within the Amaryllidaceae and Liliaceae families. The experimental results demonstrate that nearly all tested models achieve accurate species classification into the appropriate families, with an accuracy rate exceeding 97%, except for the Naïve Bayes model. Regarding computational time, the Random Forest model requires significantly more time for training than other models. Regarding memory usage, the Least Squares Support Vector Machine with a polynomial kernel, and Regularized Logistic Regression consume more memory than other models. These machine learning models exhibit strong concordance with NCBI's classifications when predicting families using the test dataset, effectively categorizing species into the Amaryllidaceae and Liliaceae families.