Support Vector Machine Regression Research Articles

Non-Destructive Inspection of Tile Debonding by DWT and MFCC of Tile-Tapping Sound with Machine versus Deep Learning Models

One of the essential processes of construction quality control is tile bonding inspection. Hollows beneath tile tessellation can lead to unbounded or completely broken tiles. An interior inspector typically used a hollowsounding technique. However, it relies on skill and judgment that greatly vary among individuals. Moreover, equipment and interpretation are difficult to calibrate and standardize. This paper addresses these issues by employing machine-learning strategies for tile-tapping sound classification. Provided that a tapping signal was digitally acquired, the proposed method was fully computerized. Firstly, the signal was analyzed and its wavelets and MFCC were extracted. The corresponding spectral features were then classified by SVM, k-NN, Naïve Bayes, and Logistic Regression algorithm, in turn. The results were subsequently compared against those from a previous works that employed a deep learning strategy. It was revealed that when the proposed method was properly configured, it required much less computing resources than the deep learning based one, while being able to distinguish dull from hollow sounding tiles with 93.67% accuracy.

Decoding Diagnostic Precision: Evaluating Error Implications with Random Forest and Support Vector Regression Machine Learning Models

Decoding Diagnostic Precision: Evaluating Error Implications with Random Forest and Support Vector Regression Machine Learning Models

COVID-19 detection from chest X-ray images using CLAHE-YCrCb, LBP, and machine learning algorithms

BackgroundCOVID-19 is a disease that caused a contagious respiratory ailment that killed and infected hundreds of millions. It is necessary to develop a computer-based tool that is fast, precise, and inexpensive to detect COVID-19 efficiently. Recent studies revealed that machine learning and deep learning models accurately detect COVID-19 using chest X-ray (CXR) images. However, they exhibit notable limitations, such as a large amount of data to train, larger feature vector sizes, enormous trainable parameters, expensive computational resources (GPUs), and longer run-time.ResultsIn this study, we proposed a new approach to address some of the above-mentioned limitations. The proposed model involves the following steps: First, we use contrast limited adaptive histogram equalization (CLAHE) to enhance the contrast of CXR images. The resulting images are converted from CLAHE to YCrCb color space. We estimate reflectance from chrominance using the Illumination–Reflectance model. Finally, we use a normalized local binary patterns histogram generated from reflectance (Cr) and YCb as the classification feature vector. Decision tree, Naive Bayes, support vector machine, K-nearest neighbor, and logistic regression were used as the classification algorithms. The performance evaluation on the test set indicates that the proposed approach is superior, with accuracy rates of 99.01%, 100%, and 98.46% across three different datasets, respectively. Naive Bayes, a probabilistic machine learning algorithm, emerged as the most resilient.ConclusionOur proposed method uses fewer handcrafted features, affordable computational resources, and less runtime than existing state-of-the-art approaches. Emerging nations where radiologists are in short supply can adopt this prototype. We made both coding materials and datasets accessible to the general public for further improvement. Check the manuscript’s availability of the data and materials under the declaration section for access.

Enhancing Solar Radiation Forecasting in Diverse Moroccan Climate Zones: A Comparative Study of Machine Learning Models with Sugeno Integral Aggregation

Hourly solar radiation (SR) forecasting is a vital stage in the efficient deployment of solar energy management systems. Single and hybrid machine learning (ML) models have been predominantly applied for precise hourly SR predictions based on the pattern recognition of historical heterogeneous weather data. However, the integration of ML models has not been fully investigated in terms of overcoming irregularities in weather data that may degrade the forecasting accuracy. This study investigated a strategy that highlights interactions that may exist between aggregated prediction values. In the first investigation stage, a comparative analysis was conducted utilizing three different ML models including support vector machine (SVM) regression, long short-term memory (LSTM), and multilayer artificial neural networks (MLANN) to provide insights into their relative strengths and weaknesses for SR forecasting. The comparison showed the proposed LSTM model had the greatest contribution to the overall prediction of six different SR profiles from numerous sites in Morocco. To validate the stability of the proposed LSTM, Taylor diagrams, violin plots, and Kruskal–Wallis (KW) tests were also utilized to determine the robustness of the model’s performance. Secondly, the analysis found coupling the models outputs with aggregation techniques can significantly improve the forecasting accuracy. Accordingly, a novel aggerated model that integrates the forecasting outputs of LSTM, SVM, MLANN with Sugeno λ-measure and Sugeno integral named (SLSM) was proposed. The proposed SLSM provides spatially and temporary interactions of information that are characterized by uncertainty, emphasizing the importance of the aggregation function in mitigating irregularities associated with SR data and achieving an hourly time scale forecasting accuracy with improvement of 11.7 W/m2.

A kernel-based approximate dynamic programming approach: Theory and application

This article proposes a novel kernel-based Dynamic Programming (DP) approximation method to tackle the typical curse of dimensionality of stochastic DP problems over the finite time horizon. Such a method utilizes kernel functions in combination with Support Vector Machine (SVM) regression to determine an approximate cost function for the entire state space of the underlying Markov Decision Process (MDP), by leveraging cost function computed for selected representative states. Kernel functions are used to define the so-called kernel matrix, while the parameter vector of the given kernel-based cost function approximation is computed by moving backwards in time from the terminal condition and by applying SVM regression. This way, the difficulty of selecting a proper set of features is also tackled. The proposed method is then extended to the infinite time horizon case. To show the effectiveness of the proposed approach, the resulting Recursive Residual Approximate Dynamic Programming (RR-ADP) algorithm is applied to the sensor scheduling design in multi-process remote state estimation problems.

Mean period prediction models for Mexican interplate and intermediate-depth intraslab earthquake ground motions

The aim of this paper is to predict the mean period, Tm, as a measure of the frequency content of interplate and intermediate-depth intraslab earthquake ground motions recorded at rock sites due to subduction earthquakes in Mexico. For this purpose, both Ground Motion Prediction Models (GMPMs), which use a parametric regression, and Support Vector Machine (SVM) regression, a type of machine learning algorithm used for regression analysis, are employed in this investigation. Therefore, two databases which include 484 and 300 earthquake ground motions recorded during interplate and intraslab historical Mexican earthquakes were assembled in this study. It is shown that Tm estimates depend on the type of earthquake (i.e., interplate or intraslab). While the SVM regression yields the lowest total standard deviation in predicting Tm, the GMPM still yields an acceptable total standard deviation similar to that reported in other studies. A comparison of the GMPM for intraslab earthquakes in Mexico with another GMPMs for predicting Tm recently introduced in the literature showed differences, which suggests that GMPMs for predicting Tm should be developed for specific regions.

Comparative analysis of machine learning algorithms for breast cancer prediction

Breast cancer is a global health concern, and early diagnosis is crucial for successful treatment. The objective of this paper is to conduct a comparative analysis of machine-learning algorithms for the prediction of breast cancer. This study used the Wisconsin Diagnostic Breast Cancer Dataset. Data preparation, technique selection, and performance evaluation are included in the study. The inquiry begins by comparing malignant and benign instances according to input factors and diagnostic outcomes. Finding components having an inverse relationship to the diagnosis is prioritized. Next, a careful approach is used to choose attributes to improve the dataset for model construction. The preprocessed data trains and optimizes four well-known machine learning algorithms: Random Forest, Support Vector Machine, K-Nearest Neighbor, and Logistic Regression. The models are evaluated for accuracy, precision, recall, F1-score, and ROC curve. This study aimed to evaluate numerous breast cancer prediction systems to determine their strengths and weaknesses. To provide openness and replicability, the study uses the Jupyter Notebook platform, Python, and data analytic tools. The logistic regression model has a test accuracy percentage of 99.26%, surpassing all other models examined in this study. Furthermore, it has a minimum false positive rate (FPR) of 1 and a false negative rate (FNR) of 4. The model exhibits a higher level of precision in comparison to the studies examined in the literature review. This study is crucial for early diagnosis and therapy development. The effects include lower healthcare expenses, better patient outcomes, and better diagnostics. Machine learning has shown promise in fighting breast cancer, boosting its relevance in healthcare.

Water Quality Prediction of Small-Micro Water Body Based on the Intelligent-Algorithm-Optimized Support Vector Machine Regression Method and Unmanned Aerial Vehicles Multispectral Data

Accurate prediction of spatial variation in water quality in small microwaters remains a challenging task due to the complexity and inherent limitations of the optical properties of small microwaters. In this paper, based on unmanned aerial vehicles (UAV) multispectral images and a small amount of measured water quality data, the performance of seven intelligent algorithm-optimized SVR models in predicting the concentration of chlorophyll (Chla), total phosphorus (TP), ammonia nitrogen (NH3-N), and turbidity (TUB) in small and micro water bodies were compared and analyzed. The results show that the Gray Wolf optimized SVR model (GWO-SVR) has the highest comprehensive performance, with R2 of 0.915, 0.827, 0.838, and 0.800, respectively. In addition, even when dealing with limited training samples and different data in different periods, the GWO-SVR model also shows remarkable stability and portability. Finally, according to the forecast results, the influencing factors of water pollution were discussed. This method has practical significance in improving the intelligence level of small and micro water body monitoring.

Prediction of Autumn Ozone Concentration in the Pearl River Delta Based on Machine Learning

Based on the observation data of the daily maximum 8-hour ozone (O3) average concentration[MDA8-O3, ρ(O3-8h)] and meteorological reanalysis data in the Pearl River Delta Region from 2015 to 2022, four machine learning methods, i.e., support vector machine regression (SVR), random forest (RF), multi-layer perceptron (MLP), and lightweight gradient boosting machine (LG) were used to establish MDA8-O3 prediction models. The results showed that the SVR model had the best prediction performance on MDA8-O3 during the whole year, the coefficient of determination (R2) reached 0.86, and the root mean square error (RMSE) and mean absolute error (MAE) were 16.3 μg·m-3 and 12.3 μg·m-3, respectively. The prediction performance of the SVR model in autumn was still slightly better than that of LG and MLP, with R2,RMSE,and MAE values of 0.88, 19.8 μg·m-3,and 16.1 μg·m-3, respectively. The RF model performed the worst in the autumn prediction. In addition, the models trained by data from the whole year had better prediction ability on autumn MDA8-O3 than that of those only trained by autumn data, and the R2 differed 0.08-0.14.

Remote Sensing Model for Estimating Atmospheric PM2.5 Concentration in the Guangdong-Hong Kong-Macao Greater Bay Area

PM2.5 is extremely harmful to the atmospheric environment and human health, and a timely and accurate understanding of PM2.5 with high spatial and temporal resolution plays an important role in the prevention and control of air pollution. Based on multi-angle implementation of atmospheric correction algorithm (MAIAC), 1 km AOD products, ERA5 meteorological data, and pollutant concentrations (CO, O3, NO2, SO2, PM10, and PM2.5) in the Guangdong-Hong Kong-Macao Greater Bay Area during 2015-2020, a geographically and temporally weighted regression model (GTWR), BP neural network model (BPNN), support vector machine regression model (SVR), and random forest model (RF) were established, respectively, to estimate PM2.5 concentration. The results showed that the estimation ability of the RF model was better than that of the BPNN, SVR, and GTWR models. The correlation coefficients of the BPNN, SVR, GTWR, and RF models were 0.922, 0.920, 0.934, and 0.981, respectively. The RMSE values were 7.192, 7.101, 6.385, and 3.670 μg·m-3. The MAE values were 5.482, 5.450, 4.849, and 2.323 μg·m-3, respectively. The RF model had the best effect during winter, followed by that during summer, and again during spring and autumn, with correlation coefficients above 0.976 in the prediction of different seasons. The RF model could be used to predict the PM2.5 concentration in the Greater Bay Area. In terms of time, the daily ρ(PM2.5) of cities in the Greater Bay Area showed a trend of "decreasing first and then increasing" in 2021, with the highest values ranging from 65.550 μg·m-3 to 112.780 μg·m-3 and the lowest values ranging from 5.000 μg·m-3 to 7.899 μg·m-3. The monthly average concentration showed a U-shaped distribution, and the concentration began to decrease in January and gradually increased after reaching a trough in June. Seasonally, it was characterized by the highest concentration during winter, the lowest during summer, and the transition during spring and autumn. The annual average ρ(PM2.5) of the Greater Bay Area was 28.868 μg·m-3, which was lower than the secondary concentration limit. Spatially, there was a "northwest to southeast" decreasing distribution of PM2.5 in 2021, and the high-pollution areas clustered in the central part of the Greater Bay Area, represented by Foshan. Low concentration areas were mainly distributed in the eastern part of Huizhou, Hong Kong, Macao, Zhuhai, and other coastal areas. The spatial distribution of PM2.5 in different seasons also showed heterogeneity and regionality. The RF model estimated the PM2.5 concentration with high accuracy, which provides a scientific basis for the health risk assessment associated with PM2.5 pollution in the Greater Bay Area.

Machine learning-driven web-post buckling resistance prediction for high-strength steel beams with elliptically-based web openings

The use of periodical elliptically-based web (EBW) openings in high strength steel (HSS) beams has been increasingly popular in recent years mainly because of the high strength-to-weight ratio and the reduction in the floor height as a result of allowing different utility services to pass through the web openings. However, these sections are susceptible to web-post buckling (WPB) failure mode and therefore it is imperative that an accurate design tool is made available for prediction of the web-post buckling capacity. Therefore, the present paper aims to implement the power of various machine learning (ML) methods for prediction of the WPB capacity in HSS beams with (EBW) openings and to assess the performance of existing analytical design model. For this purpose, a numerical model is developed and validated with the aim of conducting a total of 10,764 web-post finite element models, considering S460, S690 and S960 steel grades. This data is employed to train and validate different ML algorithms including Artificial Neural Networks (ANN), Support Vector Machine Regression (SVR) and Gene Expression Programming (GEP). Finally, the paper proposes new design models for WPB resistance prediction. The results are discussed in detail, and they are compared with the numerical models and the existing analytical design method. The proposed design models based on the machine learning predictions are shown to be powerful, reliable and efficient design tools for capacity predictions of the WPB resistance of HSS beams with periodical (EBW) openings.

Construction and evaluation of endometriosis diagnostic prediction model and immune infiltration based on efferocytosis-related genes.

Background: Endometriosis (EM) is a long-lasting inflammatory disease that is difficult to treat and prevent. Existing research indicates the significance of immune infiltration in the progression of EM. Efferocytosis has an important immunomodulatory function. However, research on the identification and clinical significance of efferocytosis-related genes (EFRGs) in EM is sparse. Methods: The EFRDEGs (differentially expressed efferocytosis-related genes) linked to datasets associated with endometriosis were thoroughly examined utilizing the Gene Expression Omnibus (GEO) and GeneCards databases. The construction of the protein-protein interaction (PPI) and transcription factor (TF) regulatory network of EFRDEGs ensued. Subsequently, machine learning techniques including Univariate logistic regression, LASSO, and SVM classification were applied to filter and pinpoint diagnostic biomarkers. To establish and assess the diagnostic model, ROC analysis, multivariate regression analysis, nomogram, and calibration curve were employed. The CIBERSORT algorithm and single-cell RNA sequencing (scRNA-seq) were employed to explore immune cell infiltration, while the Comparative Toxicogenomics Database (CTD) was utilized for the identification of potential therapeutic drugs for endometriosis. Finally, immunohistochemistry (IHC) and reverse transcription quantitative polymerase chain reaction (RT-qPCR) were utilized to quantify the expression levels of biomarkers in clinical samples of endometriosis. Results: Our findings revealed 13 EFRDEGs associated with EM, and the LASSO and SVM regression model identified six hub genes (ARG2, GAS6, C3, PROS1, CLU, and FGL2). Among these, ARG2, GAS6, and C3 were confirmed as diagnostic biomarkers through multivariate logistic regression analysis. The ROC curve analysis of GSE37837 (AUC = 0.627) and GSE6374 (AUC = 0.635), along with calibration and DCA curve assessments, demonstrated that the nomogram built on these three biomarkers exhibited a commendable predictive capacity for the disease. Notably, the ratio of nine immune cell types exhibited significant differences between eutopic and ectopic endometrial samples, with scRNA-seq highlighting M0 Macrophages, Fibroblasts, and CD8 Tex cells as the cell populations undergoing the most substantial changes in the three biomarkers. Additionally, our study predicted seven potential medications for EM. Finally, the expression levels of the three biomarkers in clinical samples were validated through RT-qPCR and IHC, consistently aligning with the results obtained from the public database. Conclusion: we identified three biomarkers and constructed a diagnostic model for EM in this study, these findings provide valuable insights for subsequent mechanistic research and clinical applications in the field of endometriosis.

EVALUATION OF SPECTRAL INDICES FOR DETECTION OF BURNED AREAS IN AN ENVIRONMENTAL PROTECTION AREA USING SPOT-5 IMAGES

The Cerrado biome has great importance in ecological biodiversity, but deforestation has accelerated in recent decades. The Rio Preto-BA Environmental Preservation Area, known for the high agricultural activity of grains, continually suffers from forest fires and loss of native vegetation. Satellite remote sensing is proposed as an alternative to accurately locate and quantify fire-affected surfaces and their impacts on the landscape. With the recent free availability of SPOT-5 images, it has made it possible to detect burned areas with considerable spatial and spectral resolution. The objective of the present study was to determine the ideal spectral index for detection of the burned area inserted in the APA Rio Preto through two SPOT-5 scenes and the application of the Support Vector Machines (SVM) model. The burned areas detected were submitted to the calculation of five spectral indices, BAI, BAIM, NBR, NDVI and EVI2. The ability of each index to discriminate burned areas was estimated by comparing them with each other using a statistical separability index, SVM regression and accuracy analysis. BAIM was identified as the index with the greatest potential for discriminating burnt areas with maximum separability and classification accuracy above 90%, while the NDVI and EVI2 indices had low performance. It is hoped that these results can be used to evaluate and prioritize monitoring areas, contribute to the implementation of a fire management plan in the APA and to support subsequent studies on fire dynamics in forest systems integrated with advanced computational technologies.

Fault location of distribution network with distributed generation based on Karrenbauer transform and support vector machine regression

Fault location of distribution network with distributed generation based on Karrenbauer transform and support vector machine regression

Rapid quantitative authentication and analysis of camellia oil adulterated with edible oils by electronic nose and FTIR spectroscopy

Camellia oil, recognized as a high-quality edible oil endorsed by the Food and Agriculture Organization, is confronted with authenticity issues arising from fraudulent adulteration practices. These practices not only pose health risks but also lead to economic losses. This study proposes a novel machine learning framework, referred to as a transformer encoder backbone with a support vector machine regressor (TES), coupled with an electronic nose (E-nose), for detecting varying adulteration levels in camellia oil. Experimental results indicate that the proposed TES model exhibits the best performance in identifying the adulterated concentration of camellia oi, compared with five other machine learning models (the support vector machine, random forest, XGBoost, K-nearest neighbors, and backpropagation neural network). The results obtained by E-nose detection are verified by complementary Fourier transform infrared (FTIR) spectroscopy analysis for identifying functional groups, ensuring accuracy and providing a comprehensive assessment of the types of adulterants. The proposed TES model combined with E-nose offers a rapid, effective, and practical tool for detecting camellia oil adulteration. This technique not only safeguards consumer health and economic interests but also promotes the application of E-nose in market supervision.

Accurate estimation of prefabricated building construction cost based on support vector machine regression

Accurate estimation of prefabricated building construction cost based on support vector machine regression

Reducing soil and leaf shadow interference in UAV imagery for cotton nitrogen monitoring.

Individual leaves in the image are partly veiled by other leaves, which create shadows on another leaf. To eliminate the interference of soil and leaf shadows on cotton spectra and create reliable monitoring of cotton nitrogen content, one classification method to unmanned aerial vehicle (UAV) image pixels is proposed. In this work, green light (550 nm) is divided into 10 levels to limit soil and leaf shadows (LS) on cotton spectrum. How many shadow has an influence on cotton spectra may be determined by the strong correlation between the vegetation index (VI) and leaf nitrogen content (LNC). Several machine learning methods were utilized to predict LNC using less disturbed VI. R-Square (R 2), root mean square error (RMSE), and mean absolute error (MAE) were used to evaluate the performance of the model. (i) after the spectrum were preprocessed by gaussian filter (GF), SG smooth (SG), and combination of GF and SG (GF&SG), the significant relationship between VI and LNC was greatly improved, so the Standard deviation of datasets was also decreased greatly; (ii) the image pixels were classified twice sequentially. Following the first classification, the influence of soil on vegetation index (VI) decreased. Following secondary classification, the influence of soil and LS to VI can be minimized. The relationship between the VI and LNC had improved significantly; (iii) After classifying the image pixels, the VI of 2-3, 2-4, and 2-5 have a stronger relationship with LNC accordingly. Correlation coefficients (r) can reach to 0.5. That optimizes monitoring performance when combined with GF&SG to predict LNC, support vector machine regression (SVMR) has the better performance, R 2, RMSE, and MAE up to 0.86, 1.01, and 0.71, respectively. The UAV image classification technique in this study can minimize the negative effects of soil and LS on cotton spectrum, allowing for efficient and timely predict LNC.

Accurate estimation of prefabricated building construction cost based on support vector machine regression

Accurate estimation of prefabricated building construction cost based on support vector machine regression

Exploring the machine learning approach to the cultural and ecological sustainable development of Fuzhou tea picking opera

Abstract The article introduces machine learning based on a support vector machine to illustrate the scenario of Fuzhou Tea Casting Opera, a folkloric non-heritage research and ecologically sustainable development, from the perspective of economic return prediction. Fine-grained information recognition and extraction of massive, unstructured UGC data are used for data collection preprocessing in this paper. Mostly, the relationship is established by analyzing the training samples to establish the connection between input and output data. The limited sample information is used to find the best compromise between the model’s complexity and learning ability. Then, search for the parameters that make the geometric interval the largest so as to construct the function and obtain the optimal hyperplane. In this paper, the kernel function is introduced using a ɛ -insensitive loss function. To obtain the decision function in different cases, two cases are modeled using support vector machine regression. Finally, the support vector machine model is used to predict the economic benefits of the Fuzhou tea-picking operation. The SVM prediction model’s prediction error of the economic benefits of tea-picking opera for the nine years from 2010 to 2018 is always maintained at a safe value below 0.035. The accuracy and stability of the prediction effect of the decision tree model and the gray prediction model are not as good as this paper’s model. It shows that the model presented in this paper is more suitable for predicting the benefits of the cultural and ecological sustainable development of Fuzhou tea-picking opera.

Inversion model of soil salinity in alfalfa covered farmland based on sensitive variable selection and machine learning algorithms.

Timely and accurate monitoring of soil salinity content (SSC) is essential for precise irrigation management of large-scale farmland. Uncrewed aerial vehicle (UAV) low-altitude remote sensing with high spatial and temporal resolution provides a scientific and effective technical means for SSC monitoring. Many existing soil salinity inversion models have only been tested by a single variable selection method or machine learning algorithm, and the influence of variable selection method combined with machine learning algorithm on the accuracy of soil salinity inversion remain further studied. Firstly, based on UAV multispectral remote sensing data, by extracting the spectral reflectance of each sampling point to construct 30 spectral indexes, and using the pearson correlation coefficient (PCC), gray relational analysis (GRA), variable projection importance (VIP), and support vector machine-recursive feature elimination (SVM-RFE) to screen spectral index and realize the selection of sensitive variables. Subsequently, screened and unscreened variables as model input independent variables, constructed 20 soil salinity inversion models based on the support vector machine regression (SVM), back propagation neural network (BPNN), extreme learning machine (ELM), and random forest (RF) machine learning algorithms, the aim is to explore the feasibility of different variable selection methods combined with machine learning algorithms in SSC inversion of crop-covered farmland. To evaluate the performance of the soil salinity inversion model, the determination coefficient (R2), root mean square error (RMSE) and performance deviation ratio (RPD) were used to evaluate the model performance, and determined the best variable selection method and soil salinity inversion model by taking alfalfa covered farmland in arid oasis irrigation areas of China as the research object. The variable selection combined with machine learning algorithm can significantly improve the accuracy of remote sensing inversion of soil salinity. The performance of the models has been improved markedly using the four variable selection methods, and the applicability varied among the four methods, the GRA variable selection method is suitable for SVM, BPNN, and ELM modeling, while the PCC method is suitable for RF modeling. The GRA-SVM is the best soil salinity inversion model in alfalfa cover farmland, with Rv 2 of 0.8888, RMSEv of 0.1780, and RPD of 1.8115 based on the model verification dataset, and the spatial distribution map of soil salinity can truly reflect the degree of soil salinization in the study area. Based on our findings, the variable selection combined with machine learning algorithm is an effective method to improve the accuracy of soil salinity remote sensing inversion, which provides a new approach for timely and accurate acquisition of crops covered farmland soil salinity information.