Support Vector Machine Regression Research Articles

ENSEMBLE RESAMPLING SUPPORT VECTOR MACHINE, MULTINOMIAL REGRESSION TO MULTICLASS IMBALANCED DATA

Imbalanced data is a commonly encountered issue in classification analysis. This issue gives rise to prediction errors in the classification process, which in turn affects the sensitivity, particularly in the minority class. Resampling techniques can be employed as a means to mitigate the issue of Imbalanced data. Furthermore, ensemble approaches are Utilized in the classification procedure to augment the performance of classification. The present study assesses the efficacy of the bagging ensemble approach in conjunction with ADASYN as a means of addressing the aforementioned issue. The dataset Utilized in this work comprises Imbalanced Glass Identification data, Imbalanced Iris data, and Imbalanced synthetic data. The study Centres on the Utilization of Support Vector Machines (SVM) with parameter optimization using repeated cross-validation (k = 10) and the application of multinomial regression. The evaluation of classification outcomes involves a comparison between the ensemble technique and multinomial regression. This comparison is conducted under pre- and post-resampling conditions, with the evaluation metrics being accuracy, sensitivity, and specificity. The analysis of classification outcomes across the three datasets suggests that the ensemble resampling SVM approach and multinomial regression exhibit superior performance compared to the ensemble SVM and multinomial regression approaches when applied to non-resampled data. Resampling of data has been observed to enhance sensitivity, particularly in the minority class.

Lateral safety evaluation of autonomous trucks in overtaking maneuvers and adverse weather: Exploratory comparison of different lateral control modes

As the detrimental impact of the commonly recommended centered driving mode for autonomous trucks on road longevity is gaining attention, more lateral control modes are being proposed to enhance road sustainability. However, there is currently a lack of research on the lateral safety analysis of autonomous trucks with different lateral control modes, especially in complex driving scenarios (such as overtaking) and adverse weather conditions. Therefore, this study developed a safety assessment framework to comparatively analyze the risk probability differences in lateral accidents during overtaking maneuvers by autonomous trucks with different lateral control modes under adverse weather conditions. Based on aerodynamics and vehicle dynamics simulations to capture the multifactorial influences on truck lateral deviation, the results are used for model validation and training. In the reliability approach, Support Vector Machine Regression (SVR) is introduced to establish the SVR response surface model with optimal predictive performance, and combined with Monte Carlo simulations for safety assessment, quantifying safety indices. The results indicate that trucks being overtaken during overtaking maneuvers are more prone to lateral accidents under crosswind influences. The overall impact of lateral control modes on the lateral safety trends is minor. Compared to other lateral control modes, following the centered zero-drift mode is generally safer. However, in conditions of low wind speeds (below 20 km/h) or on highly slippery road surfaces (road friction coefficient below 0.1), autonomous trucks following a uniform distribution mode can better maintain a low-risk level. This study provides crucial insights for future considerations integrating road longevity and truck safety in a collaborative manner, and the proposed methodology has broad applications.

Identification and interpretation of gait analysis features and foot conditions by explainable AI

Clinical gait analysis is a crucial step for identifying foot disorders and planning surgery. Automating this process is essential for efficiently assessing the substantial amount of gait data. In this study, we explored the potential of state-of-the-art machine learning (ML) and explainable artificial intelligence (XAI) algorithms to automate all various steps involved in gait analysis for six specific foot conditions. To address the complexity of gait data, we manually created new features, followed by recursive feature elimination using Support Vector Machines (SVM) and Random Forests (RF) to eliminate low-variance features. SVM, RF, K-nearest Neighbor (KNN), and Logistic Regression (LREGR) were compared for classification, with a Majority Voting (MV) model combining trained models. KNN and MV achieved mean balanced accuracy, recall, precision, and F1 score of 0.87. All models were interpreted using Local Interpretable Model-agnostic Explanation (LIME) method and the five most relevant features were identified for each foot condition. High success scores indicate a strong relationship between selected features and foot conditions, potentially indicating clinical relevance. The proposed ML pipeline, adaptable for other foot conditions, showcases its potential in aiding experts in foot condition identification and planning surgeries.

Exploring the Role of First-Person Singular Pronouns in Detecting Suicidal Ideation: A Machine Learning Analysis of Clinical Transcripts.

Linguistic features, particularly the use of first-person singular pronouns (FPSPs), have been identified as potential indicators of suicidal ideation. Machine learning (ML) and natural language processing (NLP) have shown potential in suicide detection, but their clinical applicability remains underexplored. This study aimed to identify linguistic features associated with suicidal ideation and develop ML models for detection. NLP techniques were applied to clinical interview transcripts (n = 319) to extract relevant features, including four cases of FPSP (subjective, objective, dative, and possessive cases) and first-person plural pronouns (FPPPs). Logistic regression analyses were conducted for each linguistic feature, controlling for age, gender, and depression. Gradient boosting, support vector machine, random forest, decision tree, and logistic regression were trained and evaluated. Results indicated that all four cases of FPSPs were associated with depression (p < 0.05) but only the use of objective FPSPs was significantly associated with suicidal ideation (p = 0.02). Logistic regression and support vector machine models successfully detected suicidal ideation, achieving an area under the curve (AUC) of 0.57 (p < 0.05). In conclusion, FPSPs identified during clinical interviews might be a promising indicator of suicidal ideation in Chinese patients. ML algorithms might have the potential to aid clinicians in improving the detection of suicidal ideation in clinical settings.

Experimental analysis of forming forces in incremental forming and its prediction by AI-based methods

Single point incremental forming (SPIF) is an emerging approach to manufacture the user-specific parts of greater strength economically without involving dedicated tools and dies. In this study, peak deforming loads have been measured and estimated in order to determine the size and capacity of forming machinery for manufacturing components, using the SPIF process, for designed process conditions on AA7075-O sheets. Estimation of maximum deforming loads has been accomplished with the help of hybrid artificial neural network (HANN) approach by taking experimental load values as the input dataset. The load values, estimated by HANN approach, have been compared with the load values estimated by two state-of-art regression approaches, that is, Support Vector Machine (SVM) and Gaussian Process Regression (GPR). Results show that the regression methods (SVM and GPR) are outperformed by the HANN model with an accuracy of 99.80%. HANN model estimated force values very close to experimental results. The forming forces were found to be greater when the flat-end tools were used as a forming agent in place of hemispherical-end tool. The proposed study would help the researchers and scientists to assess the capacity the machines used in SPIF process to prepare a particular sheet-part and to prevent the failure of hardware during the SPIF process.

Estimating Winter Wheat Plant Nitrogen Content by Combining Spectral and Texture Features Based on a Low-Cost UAV RGB System throughout the Growing Season

As prior information for precise nitrogen fertilization management, plant nitrogen content (PNC), which is obtained timely and accurately through a low-cost method, is of great significance for national grain security and sustainable social development. In this study, the potential of the low-cost unmanned aerial vehicle (UAV) RGB system was investigated for the rapid and accurate estimation of winter wheat PNC across the growing season. Specifically, texture features were utilized as complements to the commonly used spectral information. Five machine learning regression algorithms, including support vector machines (SVMs), classification and regression trees, artificial neural networks, K-nearest neighbors, and random forests, were employed to establish the bridge between UAV RGB image-derived features and ground-truth PNC, with multivariate linear regression serving as the reference. The results show that both spectral and texture features had significant correlations with ground-truth PNC, indicating the potential of low-cost UAV RGB images to estimate winter wheat PNC. The H channel, S4O6, and R_SE and R_EN had the highest correlation among the spectral indices, Gabor texture features, and grey level co-occurrence matrix texture features, with absolute Pearson’s correlation coefficient values of 0.63, 0.54, and 0.69, respectively. When the texture features were used together with spectral indices, the PNC estimation accuracy was enhanced, with the root mean square error (RMSE) decreasing from 2.56 to 2.24 g/kg, for instance, when using the SVM regression algorithm. The SVM regression algorithm with validation achieved the highest estimation accuracy, with a coefficient of determination (R2) of 0.62 and an RMSE of 2.15 g/kg based on the optimal feature combination of B_CON, B_M, G_DIS, H, NGBDI, R_EN, R_M, R_SE, S3O7, and VEG. Overall, this study demonstrated that the low-cost UAV RGB system could be successfully used to map the PNC of winter wheat across the growing season.

Exploring the application and challenges of fNIRS technology in early detection of Parkinson's disease.

Parkinson's disease (PD) is a prevalent neurodegenerative disorder that significantly benefits from early diagnosis for effective disease management and intervention. Despite advancements in medical technology, there remains a critical gap in the early and non-invasive detection of PD. Current diagnostic methods are often invasive, expensive, or late in identifying the disease, leading to missed opportunities for early intervention. The goal of this study is to explore the efficiency and accuracy of combining fNIRS technology with machine learning algorithms in diagnosing early-stage PD patients and to evaluate the feasibility of this approach in clinical practice. Using an ETG-4000 type near-infrared brain function imaging instrument, data was collected from 120 PD patients and 60 healthy controls. This cross-sectional study employed a multi-channel mode to monitor cerebral blood oxygen changes. The collected data were processed using a general linear model and β values were extracted. Subsequently, four types of machine learning models were developed for analysis: Support vector machine (SVM), K-nearest neighbors (K-NN), random forest (RF), and logistic regression (LR). Additionally, SHapley Additive exPlanations (SHAP) technology was applied to enhance model interpretability. The SVM model demonstrated higher accuracy in differentiating between PD patients and control group (accuracy of 85%, f1 score of 0.85, and an area under the ROC curve of 0.95). SHAP analysis identified the four most contributory channels (CH) as CH01, CH04, CH05, and CH08. The model based on the SVM algorithm exhibited good diagnostic performance in the early detection of PD patients. Future early diagnosis of PD should focus on the Frontopolar Cortex (FPC) region.

Advancing grape chemical analysis through machine learning and multi-sensor spectroscopy

Chemical testing of grapes is essential for wine-making, allowing informed decisions about grape composition and potential wine characteristics. However, current invasive laboratory methods to identify the key components as total soluble solid contents and acidity, present challenges in terms of time and cost. To address these issues, non-invasive techniques using Visible-Near-Infrared (Vis-NIR) and Raman spectroscopy are explored for rapid and accurate grape chemical analysis. Various machine learning methods are deployed in this study to address the challenges of grape chemical analysis and enhance estimation accuracy. The contributions of this research include pioneering a direct comparison between Vis-NIR and Raman spectroscopy, establishing a regression model benchmark, and providing an open-source dataset for grape composition analysis. We identify Gaussian Process Regression (GPR) and Support Vector Machine Regression (SVMR) as the most effective regression models, with GPR achieving an RMSE of 0.977 °Birx for sugar content estimation in French Colombard grapes and SVMR achieving 0.780 °Brix for Cabernet grapes. For pH estimations, GPR and SVMR also perform exceptionally well.

Predicting soil organic carbon with different approaches and spatial resolutions for the southern Iberian Peninsula, Spain

Quantification and monitoring of soil organic carbon (SOC) stocks across local-to-global scales are needed to assess soil resource management practices and adapt environmental policies. Multiple SOC estimates are available worldwide; however, verification and validation are required to quantify the discrepancies and provide improved estimates. Here, we evaluated four different digital soil mapping (DSM) approaches (i.e., linear models, support vector machine, random forest, and quantile regression forest) to estimate SOC concentration (SOCc) and SOC stocks (SOCs) in the Region of Murcia (11,313 km2), a complex topographic and climatic area in the southern Iberian Peninsula, at three spatial resolutions (100, 250, and 1000 m). We estimated SOC spatially using a local harmonized database of 255 soil profiles for modeling and 1100 topsoils for external validation. We found that the quantile regression forest (QRF) approach had the best data-model agreement at 100 m spatial resolution, with the highest accuracy percentage (79%), external validation (correlation coefficient of 52%), and spatial interpretability of patterns, especially for SOCc. The QRF model showed a mean SOCc of 12.18 g/kg with an overall uncertainty of 10.54 g/kg and an accuracy percentage of 79%, whereas the total SOCs was 27,572 GgC with an uncertainty of 0.016 GgC. Our results showed that using local environmental covariates and local soil information to predict SOC within this region resulted in a relative improvement in the prediction accuracy of ∼40% for SOCc and ∼ 65% for SOCs compared to the SOC products derived from national and global databases. Our results showed a large discrepancy between the national and global estimates for reporting SOC locally. Consequently, local-to-regional efforts are needed to describe SOC spatial variability better to reduce uncertainty and improve the assessment of soil resources. We provide the resulting SOC maps with associated spatial uncertainty on the public Environmental Data Initiative Repository at https://portal.edirepository.org/nis/mapbrowse?packageid=edi.1238.2.

Comprehensive empirical investigation for prioritizing the pipeline of using feature selection and data resampling techniques

The contemporary real-world datasets often suffer from the problem of class imbalance as well as high dimensionality. For combating class imbalance, data resampling is a commonly used approach whereas for tackling high dimensionality feature selection is used. The aforesaid problems have been studied extensively as independent problems in the literature but the possible synergy between them is still not clear. This paper studies the effects of addressing both the issues in conjunction by using a combination of resampling and feature selection techniques on binary-class imbalance classification. In particular, the primary goal of this study is to prioritize the sequence or pipeline of using these techniques and to analyze the performance of the two opposite pipelines that apply feature selection before or after resampling techniques i.e., F + S or S + F. For this, a comprehensive empirical study is carried out by conducting a total of 34,560 tests on 30 publicly available datasets using a combination of 12 resampling techniques for class imbalance and 12 feature selection methods, evaluating the performance on 4 different classifiers. Through the experiments we conclude that there is no specific pipeline that proves better than the other and both the pipelines should be considered for obtaining the best classification results on high dimensional imbalanced data. Additionally, while using Decision Tree (DT) or Random Forest (RF) as base learner the predominance of S + F over F + S is observed whereas in case of Support Vector Machine (SVM) and Logistic Regression (LR), F + S outperforms S + F in most cases. According to the mean ranking obtained from Friedman test the best combination of resampling and feature selection techniques for DT, SVM, LR and RF are SMOTE + RFE (Synthetic Minority Oversampling Technique and Recursive Feature Elimination), Least Absolute Shrinkage and Selection Operator (LASSO) + SMOTE, SMOTE + Embedded feature selection using RF and SMOTE + RFE respectively.

Performance of different machine learning algorithms in identifying undiagnosed diabetes based on nonlaboratory parameters and the influence of muscle strength: A cross-sectional study.

Machine learning algorithms based on the artificial neural network (ANN), support vector machine, naive Bayesian or logistic regression model are commonly used to identify diabetes. This study investigated which approach performed the best and whether muscle strength provided any incremental benefit in identifying undiagnosed diabetes in Chinese adults. This cross-sectional study enrolled 4,482 eligible participants from eight provinces in China, who were randomly divided into the training dataset (n = 3,586) and the testing dataset (n = 896). Muscle strength was assessed by handgrip strength and the number of chair stands in the 30-s chair stand test. An oral glucose tolerance test was used to ascertain undiagnosed diabetes. The areas under the curve (AUCs) were calculated accordingly and compared with each other. Of the included participants, 233 had newly diagnosed diabetes. All the four machine learning algorithms, which were developed based on nonlaboratory parameters, showed acceptable discriminative ability in identifying undiagnosed diabetes (all AUCs >0.70), with the ANN approach performing the best (AUC 0.806). Adding handgrip strength or the 30-s chair stand test to this approach did not increase the AUC further (P = 0.39 and 0.26, respectively). Furthermore, compared with the New Chinese Diabetes Risk Score, the ANN approach showed a larger AUC in identifying undiagnosed diabetes (Pcomparison < 0.01), regardless of the addition of handgrip strength or the 30-s chair stand test. The ANN approach performed the best in identifying undiagnosed diabetes in Chinese adults; however, the addition of muscle strength might not improve its efficacy.

Using mixed kernel support vector machine to improve the predictive accuracy of genome selection1

The advantages of genome selection (GS) in animal and plant breeding are self-evident. Traditional parametric models have disadvantage in better fit the increasingly large sequencing data and capture complex effects accurately. Machine learning models have demonstrated remarkable potential in addressing these challenges. In this study, we introduced the concept of mixed kernel functions to explore the performance of support vector machine regression (SVR) in GS. Six single kernel functions (SVR_L, SVR_C, SVR_G, SVR_P, SVR_S, SVR_L) and four mixed kernel functions (SVR_GS, SVR_GP, SVR_LS, SVR_LP) were used to predict genome breeding values. The prediction accuracy, mean squared error (MSE) and mean absolute error (MAE) were used as evaluation indicators to compare with two traditional parametric models (GBLUP, BayesB) and two popular machine learning models (RF, KcRR). The results indicate that in most cases, the performance of the mixed kernel function model significantly outperforms that of GBLUP, BayesB and single kernel function. For instance, for T1 in the pig dataset, the predictive accuracy of SVR_GS is improved by 10% compared to GBLUP, and by approximately 4.4 and 18.6% compared to SVR_G and SVR_S respectively. For E1 in the wheat dataset, SVR_GS achieves 13.3% higher prediction accuracy than GBLUP. Among single kernel functions, the Laplacian and Gaussian kernel functions yield similar results, with the Gaussian kernel function performing better. The mixed kernel function notably reduces the MSE and MAE when compared to all single kernel functions. Furthermore, regarding runtime, SVR_GS and SVR_GP mixed kernel functions run approximately three times faster than GBLUP in the pig dataset, with only a slight increase in runtime compared to the single kernel function model. In summary, the mixed kernel function model of SVR demonstrates speed and accuracy competitiveness, and the model such as SVR_GS has important application potential for GS.

Estimation model of potassium content in cotton leaves based on hyperspectral information of multileaf position

Potassium (K) is a highly mobile nutrient element that continuously adjusts its demand strategy among and within cotton leaves through redistribution. This indirectly leads to variations in the leaf potassium content (LKC, %) at different leaf positions. However, owing to the interaction between light and leaf age, leaf sensitivity at different positions to this change varies, including the reflection and absorption of the spectrum. How to selecting the optimal monitoring leaf position is an important factor in quickly and accurately evaluation of cotton LKC using spectral remote sensing technology. Therefore, this study proposes a comprehensive multileaf position estimation model based on the vertical distribution characteristics of LKC from top to bottom. This is aimed at achieving an accurate estimation of cotton LKC and optimizing the strategy for selecting the monitored leaf position. Between 2020 and 2021, we collected hyperspectral imaging data of the main stem leaves at different positions from top to bottom (Li, i=1, 2, 3, …, n), during the cotton budding, flowering, and boll setting stages. Vertical distribution characteristics, sensitivity differences, and spectral correlations of LKC at different leaf positions were investigated. Additionally, the optimal range of the dominant leaf position for monitoring was determined. Partial least squares regression (PLSR), random forest regression (RFR), support vector machine regression (SVR), and the entropy weight method (EWM) were used to establish LKC estimation models for single leaf and multileaf positions. The results showed a vertical heterogeneous distribution of cotton LKC, with LKC initially increasing and then gradually decreasing from top to bottom, and the average LKC of cotton reaches its maximum value at flowering stage. The upper leaf position demonstrated greater sensitivity to K and exhibited a stronger correlation with the spectrum. The selected dominant leaf positions for the three growth stages were L1–L5, L1–L4, and L1–L2, respectively. Based on the dominant leaf position monitoring range, the optimal single leaf position models for estimating LKC during the three growth stages were PLSR-L4, PLSR-L1, and SVR-L2, with The coefficient of determination of the validation set (R2val) of 0.786, 0.580, and 0.768, and the root-mean-square error of the validation set (RMSEval) of 0.168, 0.197, and 0.191, respectively. The multileaf position LKC estimation model was constructed by EWM with R2val of 0.887, 0.728, and 0.703, and RMSEval of 0.134, 0.172, and 0.209, respectively. In contrast, the newly developed multileaf position comprehensive estimation model yielded superior results, improving the stability of the model on the basis of high accuracy, especially during the budding and flowering stages. These findings hold significant importance for investigating cotton LKC spectral models and selecting suitable leaf positions for field monitoring.

Reliable paths prediction with intelligent data plane monitoring enabled reinforcement learning in SD-IoT

Legacy routing with conventional distributed networking in the Internet-of-Things (IoT) networks needs to work on efficiently handling service requests, leading to compromised Quality of Service (QoS) for user demands. In this research, we introduce Reliable routing based on Reinforcement learning in SD-IoT Networks (RRSN), an intelligent routing technique leveraging Software-Defined Networking (SDN) in IoT networks. RRSN utilizes a hybrid mechanism that combines Machine Learning (ML) and Reinforcement Learning (RL) within SDN’s centralized control to optimize QoS-aware reliable routing. In addition, network telemetry is utilized for intelligent network monitoring in the data plane to get the underlying network’s status efficiently. The proposed approach consists of three main modules: a Support Vector Regression (SVR) machine learning algorithm to predict link reliability, a traffic classifier for QoS-based traffic classification, and a reliability-aware reinforcement learning algorithm to compute optimal routing paths for IoT sensors. SVR algorithm has a high prediction accuracy, is lightweight, less susceptible to noisy data, and its computational complexity is independent of the dimensions of the input space. RRSN leverages intelligent network monitoring with RL, global view, and centralized SDN control to compute and implement optimal routes in data plane switches efficiently. We conduct extensive Proof-Of-Concept (POC) experimental evaluations, comparing RRSN with state-of-the-art models, including POC experiments in real Internet topologies. The results demonstrate that RRSN outperforms existing schemes in network performance metrics such as throughput, jitter, packet loss ratio, and delay, showcasing its effectiveness in improved QoS for IoT networks.

Early prediction of chronic heart disease with recursive feature elimination and supervised learning techniques

&lt;p&gt;Chronic heart disease (CHD) is a common complication among patients suffering in the cardiological intensive care unit, often resulting in poor prognosis and high mortality. Early prediction of CHD can reduce mortality by preventing the severity of the disease. This study evaluated the efficacy of on recursive feature elimination for predicting CHD using supervised learning techniques for predicting CHD. The study employed 1190 Cleveland Hungarian CHD dataset. Different supervised learning techniques (support vector machine, decision tree, k-nearest neighbor, Naive Bayes, stochastic gradient descent, adaptive boosting, and multilayer perceptron) were used to study the efficacy of the recursive feature elimination. Chest pain type, sex, blood sugar level, angina, depression, and slope were associated with CHD occurrence. The accuracy of the K-nearest neighbor and decision tree model was 89.91% for the feature-selected dataset indicating good predictive ability. Ultimately, the support vector machine and logistic regression with the selected features exhibited good discriminatory ability for early prediction of CHD. Thus, the recursive feature elimination is a good approach to develop a a model with higher accuracy to predict CHD.&lt;/p&gt;

Performance Comparison of different Disease Detection using Stacked Ensemble Learning Model

Malignancy risks and genetic disorders have long been challenging due to procedures that lack precision and predictability, thereby complicating the precise identification of diseases and their root causes. Machine learning classifiers have emerged as more suitable and effective tools. Various machine learning classifiers have been utilized to examine different genetic disorders, and the results from these classifiers have been further compared to determine their superiority. In this study, a variety of classifiers, including the SVM, KNN, decision tree, random forest, and logistic regression algorithms, are examined. These classifiers utilize specific training variables to analyze how input values correspond to the respective class. After successfully implementing each classifier, we proceeded to employ Stacking, an ensemble machine learning technique that aggregates predictions from individual classifiers on the same dataset. Four datasets, including the breast cancer, diabetes, Parkinson’s, and genomic datasets, were successfully implemented using the aforementioned methods, and the results obtained showed how the input values correspond to the class using a few training variables. SVM classifier was shown to be the most effective of the five described classifiers, having the highest accuracy in most of the cases. It provided accuracies of 97.43%, 97.46%, 97.45%, and 97.44% for each of the genome cancer, diabetes, Parkinson’s, and breast cancer datasets. The KNN and Random Forest models also came out to be very effective, with accuracy around 95% and 91%, respectively, for various disease datasets. The Logistic Regression and Decision Tree models also worked well. However, the ensemble method of Stacking proved to be highly efficient above all other base models and generated accuracies above 97.5% for all the aforementioned diseases.

High-density forest AGB estimation in tropical forest integrated with PolInSAR multidimensional features and optimized machine learning algorithms

Accurately estimating the above-ground biomass (AGB) of high-density tropical rainforests is a challenging issue. In this study, airborne multi-baseline PolInSAR data were used to estimate the tropical rainforest AGB in Gabon, Africa. The most suitable baseline combination of the PolInSAR data was initially determined through baseline selection, and the PolInSAR parameters related to forest height were obtained based on the forest canopy height estimation theory and microwave penetration depth theory. The height parameter, baseline parameter, and observation geometry parameter were then used as independent variables to construct the AGB regression model. Support vector regression (SVR) was chosen as the AGB estimation model, and the global best particle swarm algorithm (GLB-PSO) was used to optimize the SVR model’s parameters. The results show that the RFECV variable selection method is superior to the Pearson method. The GLB-PSO algorithm can also further improve the saturation point of the SVR model—the estimation results show that the saturation point of AGB estimation of PolInSAR multidimensional features combined with the SVR machine learning algorithm is up to 500 Mg/ha, while this saturation point can be increased to 650 Mg/ha when using the GLB-PSO-SVR algorithm.

Predicting the RUL of Li-Ion Batteries in UAVs Using Machine Learning Techniques

Over the past decade, Unmanned Aerial Vehicles (UAVs) have begun to be increasingly used due to their untapped potential. Li-ion batteries are the most used to power electrically operated UAVs for their advantages, such as high energy density and the high number of operating cycles. Therefore, it is necessary to estimate the Remaining Useful Life (RUL) and the prediction of the Li-ion batteries’ capacity to prevent the UAVs’ loss of autonomy, which can cause accidents or material losses. In this paper, the authors propose a method of prediction of the RUL for Li-ion batteries using a data-driven approach. To maximize the performance of the process, the performance of three machine learning models, Support Vector Machine for Regression (SVMR), Multiple Linear Regression (MLR), and Random Forest (RF), were compared to estimate the RUL of Li-ion batteries. The method can be implemented within UAVs’ Predictive Maintenance (PdM) systems.

"Predictive Modelling of Air Quality Index (AQI) Across Diverse Cities and States of India using Machine Learning: Investigating the Influence of Punjab's Stubble Burning on AQI Variability"

Air pollution is a common and serious problem nowadays and it cannot be ignored as it has harmful impacts on human health. To address this issue proactively, people should be aware of their surroundings, which means the environment where they survive. With this motive, this research has predicted the AQI based on different air pollutant concentrations in the atmosphere. The dataset used for this research has been taken from the official website of CPCB. The dataset has the air pollutant concentration from 22 different monitoring stations in different cities of Delhi, Haryana, and Punjab. This data is checked for null values and outliers. But, the most important thing to note is the correct understanding and imputation of such values rather than ignoring or doing wrong imputation. The time series data has been used in this research which is tested for stationarity using The Dickey-Fuller test. Further different ML models like CatBoost, XGBoost, Random Forest, SVM regressor, time series model SARIMAX, and deep learning model LSTM have been used to predict AQI. For the performance evaluation of different models, I used MSE, RMSE, MAE, and R2. It is observed that Random Forest performed better as compared to other models.

KinPred-RNA—kinase activity inference and cancer type classification using machine learning on RNA-seq data

Kinases as important enzymes can transfer phosphate groups from high-energy and phosphate-donating molecules to specific substrates and play essential roles in various cellular processes. Existing algorithms for kinase activity from phosphorylated proteomics data are often costly, requiring valuable samples. Moreover, methods to extract kinase activities from bulk RNA sequencing data remain undeveloped. In this study, we propose a computational framework KinPred-RNA to derive kinase activities from bulk RNA-sequencing data in cancer samples. KinPred-RNA framework, using the extreme gradient boosting (XGBoost) regression model, outperforms random forest regression, multiple linear regression, and support vector machine regression models in predicting kinase activities from cancer-related RNA sequencing data. Efficient gene signatures from the LINCS-L1000 dataset were used as inputs for KinPred-RNA. The results highlight its potential to be related to biological function. In conclusion, KinPred RNA constitutes a significant advance in cancer research by potentially facilitating the identification of cancer.