Combination Of Support Vector Machine Research Articles

Adrenal indeterminate nodules: CT-based radiomics analysis of different machine learning models for predicting adrenal metastases in lung cancer patients.

There is a paucity of research using different machine learning algorithms for distinguishing between adrenal metastases and benign tumors in lung cancer patients with adrenal indeterminate nodules based on plain and biphasic-enhanced CT radiomics. This study retrospectively enrolled 292 lung cancer patients with adrenal indeterminate nodules (training dataset, 205 (benign, 96; metastases, 109); testing dataset, 87 (benign, 42; metastases, 45)). Radiomics features were extracted from the plain, arterial, and portal CT images, respectively. The independent risk radiomics features selected by least absolute shrinkage and selection operator (LASSO) and multivariate logistic regression (LR) were used to construct the single-phase and combined-phase radiomics models, respectively, by support vector machine (SVM), decision tree (DT), random forest (RF), and LR. The independent clinical-pathological and radiological risk factors for predicting adrenal metastases selected by using univariate and multivariate LR were used to develop the traditional model. The optimal model was selected by ROC curve, and the models' clinical values were estimated by decision curve analysis (DCA). In the testing dataset, all SVM radiomics models showed the best robustness and efficiency, and then RF, LR, and DT models. The combined radiomics model had the best ability in predicting adrenal metastases (AUC=0.938), and then the plain (AUC=0.935), arterial (AUC=0.870), and portal radiomics model (AUC=0.851). Besides, compared to clinical-pathological-radiological model (AUC=0.870), the discriminatory capability of the plain and combined radiomics model were further improved. All radiomics models had good calibration curves and DCA showed the plain and combined radiomics models had more optimal clinical efficacy compared to other models, with the combined radiomics model having the largest net benefit. The combined SVM radiomics model can non-invasively and efficiently predict adrenal metastatic nodules in lung cancer patients. In addition, the plain radiomics model with high predictive performance provides a convenient and accurate new method for patients with contraindications in enhanced CT.

Effective methods for quantifying complexity based on improved ordinal partition networks: Topological dispersion entropy and weighted topological dispersion entropy

Topological permutation entropy is based on ordinal partition networks (OPNs) to approximate topological entropy of low-dimensional chaotic systems. But the ordinal patterns of OPN ignore the magnitude of the amplitude value. To solve the problem, we propose topological dispersion entropy (TDE) and weighted topological dispersion entropy (WTDE) based on dispersion patterns to characterize the complexity of a system. Furthermore, WTDE strengthens the topological structure analysis of complex networks by weighting the adjacency matrix of the improved ordinal partition networks, thereby more accurately capturing the dynamic evolution of time series. The proposed methods are comprehensively evaluated by numerical experiments. The results show that the performance of both TDE and WTDE is significantly better than TPE. Especially, WTDE has good stability to parameters, data length, and noise. Finally, combining support vector machines and K-Nearest Neighbor, TDE and WTDE are applied to the classification of physiological data and mechanical failure data.

Analysis of Big Data Network Security Defense Mechanism Application of Artificial Intelligence

In the context of the close integration of computer network technology and daily life, big data network security faces many challenges. With its powerful information processing ability, this AI can effectively identify and handle potential threats in the network, thereby improving network security. This paper discusses the application of artificial intelligence (AI) in enhancing big data network security defense, especially in the threat detection link. This paper proposes a detection algorithm that combines support vector machine (SVM) and K nearest neighbor (KNN), namely SVM-KNN algorithm, for network attack detection and defense. When the hazard data is 60 under the test sample, the detection accuracy of KNN, SVM, and SVM-KNN is 86.88%, 89.51%, and 96.75% respectively; when the hazard data is 60 under the experimental sample, the detection accuracy of KNN, SVM, and SVM-KNN is 82.70%, 83.88%, and 89.26% respectively.response.

Coronary Artery Disease Detection Based on a Novel Multi-Modal Deep-Coding Method Using ECG and PCG Signals.

Coronary artery disease (CAD) is an irreversible and fatal disease. It necessitates timely and precise diagnosis to slow CAD progression. Electrocardiogram (ECG) and phonocardiogram (PCG), conveying abundant disease-related information, are prevalent clinical techniques for early CAD diagnosis. Nevertheless, most previous methods have relied on single-modal data, restricting their diagnosis precision due to suffering from information shortages. To address this issue and capture adequate information, the development of a multi-modal method becomes imperative. In this study, a novel multi-modal learning method is proposed to integrate both ECG and PCG for CAD detection. Along with deconvolution operation, a novel ECG-PCG coupling signal is evaluated initially to enrich the diagnosis information. After constructing a modified recurrence plot, we build a parallel CNN network to encode multi-modal information, involving ECG, PCG and ECG-PCG coupling deep-coding features. To remove irrelevant information while preserving discriminative features, we add an autoencoder network to compress feature dimension. Final CAD classification is conducted by combining support vector machine and optimal multi-modal features. The experiment is validated on 199 simultaneously recorded ECG and PCG signals from non-CAD and CAD subjects, and achieves high performance with accuracy, sensitivity, specificity and f1-score of 98.49%, 98.57%,98.57% and 98.89%, respectively. The result demonstrates the superiority of the proposed multi-modal method in overcoming information shortages of single-modal signals and outperforming existing models in CAD detection. This study highlights the potential of multi-modal deep-coding information, and offers a wider insight to enhance CAD diagnosis.

Comprehensive Analysis of Bile Medicines Based on UHPLC-QTOF-MSE and Machine Learning.

Based on UHPLC-QTOF-MSE analysis and quantized processing, combined with machine learning algorithms, data modeling was carried out to realize digital identification of bear bile powder (BBP), chicken bile powder (CIBP), duck bile powder (DBP), cow bile powder (CBP), sheep bile powder (SBP), pig bile powder (PBP), snake bile powder (SNBP), rabbit bile powder (RBP), and goose bile powder (GBP). First, 173 batches of bile samples were analyzed by UHPLC-QTOF-MSE to obtain the retention time-exact mass (RTEM) data pair to identify bile acid-like chemical components. Then, the data were modeled by combining support vector machine (SVM), random forest (RF), artificial neural network (ANN), gradient boosting (GB), AdaBoost (AB), and Naive Bayes (NB), and the models were evaluated by the parameters of accuracy (Acc), precision (P), and area under the curve (AUC). Finally, the bile medicines were digitally identified based on the optimal model. The results showed that the RF model constructed based on the identified 12 bile acid-like chemical constituents and random forest algorithm is optimal with ACC, P, and AUC > 0.950. In addition, the accuracy of external identification verification of 42 batches of bile medicines detected at different times is 100.0%. So based on UHPLC-QTOF-MSE analysis and combined with the RF algorithm, it can efficiently and accurately realize the digital identification of bile medicines, which can provide reference and assistance for the quality control of bile medicines. In addition, hyodeoxycholic acid, glycohyodeoxycholic acid, and taurochenodeoxycholic acid, and so forth are the most important bile acid constituents for the identification of nine bile medicines.

A hybrid detection model for acute lymphocytic leukemia using support vector machine and particle swarm optimization (SVM-PSO).

Leukemia, a hematological disease affecting the bone marrow and white blood cells (WBCs), ranks among the top ten causes of mortality worldwide. Delays in decision-making often hinder the timely application of suitable medical treatments. Acute lymphoblastic leukemia (ALL) is one of the primary forms, constituting approximately 25% of childhood cancer cases. However, automated ALL diagnosis is challenging. Recently, machine learning (ML) has emerged as an important tool for building detection models. In this study, we present a hybrid detection model that improves the accuracy of the detection process by combining support vector machine (SVM) and particle swarm optimization (PSO) approaches to automatically identify ALL. We use SVM to represent a two-dimensional image and complete the classification process. PSO is employed to enhance the performance of the SVM model, reducing error rates and enhancing result accuracy. The input images are obtained from two public datasets (ALL-IDB1 and ALL-IDB2), and public online datasets are utilized for training and testing the proposed model. The results indicate that our hybrid SVM-PSO model has high accuracy, outperforming stand-alone algorithms and demonstrating superior performance, an enhanced confusion matrix, and a higher detection rate. This advancement holds promise for enhancing the quality of technical software in the medical field using machine learning.

Developing a crash severity model based on multi objective evolutionary feature selection approaches

The main purpose of this article is assessing the capability of multiobjective optimisation evolutionary algorithms (MOEAs) along with machine learning method on predicting the crash injury severity with the approach of reducing input variables. Dataset of crashes which were occurred in Iran was analysed over the period of 2016–2020. The data were classified into two classes in terms of injury severity: fatal and non-fatal datasets. At first, general prediction models were created by inserting 31 available input variables into support vector machine (SVM) method based on two imbalanced and obtained balanced datasets. A cluster based under sampling technique was used to obtained balanced data. Then evolutionary algorithms of two objectives optimisation algorithms namely non-dominated sorting genetic algorithm (NSGA-II), multi-objective evolutionary algorithm based on decomposition (MOEA/D), and pareto envelope-based selection algorithm (PESA-II) along with SVM were used to select features that significantly affect the severity of crashes and developed the simplified models. Then the simplified developed model was compared to the model which was prepared with random forest (RF) method in feature selection. It is shown that the simplified model developed by combined MOEAs and SVM is more appropriate to accurately predict the crash severity, considering the number of input variables in comparison to RF.

A New Hybrid Classification Framework in Childhoods Allergies with Dataset Slicing Method

Childhood allergies, particularly food allergies, are growing more frequent. Their major influence on children's health and well-being has piqued the interest of worldwide public health officials. The increased prevalence of childhood allergies in Turkey, where these patterns are also relevant, adds urgency to the need for effective classification and management options. This study addresses the shortcomings of simple classification algorithms in obtaining high accuracy by presenting a novel hybrid classification methodology. The research creates a novel method where three different prediction models are built by combining Support Vector Machine and Decision Tree classifiers. This method improves the classification process by taking into account instances that have been incorrectly classified as possible sources of useful information instead of just being noise. This instance filtering-based hybrid classification algorithm that is used in this study maintains the simplicity of interpreting learning outcomes while achieving comparatively high accuracy. Extensive experiments on the allergy dataset show the effectiveness of this hybrid approach, with an impressive accuracy of 0.906. This greatly outperforms the fundamental classification algorithms. The experimental outputs have important implications for medical professionals. This study might add a valuable contribution to the literature by giving a fresh solution to childhood allergy classification.

Fault analysis in clustered microgrids utilizing SVM-CNN and differential protection

The integration of distributed generation, microgrids, and renewable energy sources has significantly enhanced the resilience of modern electrical grids. However, this transition presents challenges in control, stability, safety, and protection due to low fault currents from renewables. This paper addresses these challenges by proposing novel methodologies to enhance fault detection, classification, and localization in microgrids. The literature review highlights a shift towards intelligent learning methods in microgrid protection systems, improving fault response times and identifying electrical faults, including high impedance faults. Nonetheless, existing methods often neglect high impedance fault detection and the integration of differential protection in clustered microgrids. To fill these gaps, this study presents a methodology combining support vector machines and convolutional neural networks for fault detection in microgrids, integrating differential protection for high impedance fault detection. The paper also proposes approaches to optimize protection in clustered microgrid systems. The effectiveness of the methodology is validated using Opal-RT through comparative analyses of signal decomposition techniques, performance and accuracy of support vector machines and convolutional neural networks, K-Fold validation, and sensitivity analysis. Results demonstrate robustness and high performance, achieving up to 100 % accuracy in fault detection and classification.

Novel Artificial Intelligence Combining Convolutional Neural Network and Support Vector Machine to Predict Colorectal Cancer Prognosis and Mutational Signatures From Hematoxylin and Eosin Images

Reducing recurrence following radical resection of colon cancer without overtreatment or undertreatment remains a challenge. Postoperative adjuvant chemotherapy (Adj) is currently administered based solely on pathologic TNM stage. However, prognosis can vary significantly among patients with the same disease stage. Therefore, novel classification systems in addition to the TNM are necessary to inform decision-making regarding postoperative treatment strategies, especially stage II and III disease, and minimize overtreatment and undertreatment with Adj. We developed a prognostic prediction system for colorectal cancer using a combined convolutional neural network and support vector machine approach to extract features from hematoxylin and eosin staining images. We combined the TNM and our artificial intelligence (AI)–based classification system into a modified TNM-AI classification system with high discriminative power for recurrence-free survival. Furthermore, the cancer cell population recognized by this system as low risk of recurrence exhibited the mutational signature SBS87 as a genetic phenotype. The novel AI-based classification system developed here is expected to play an important role in prognostic prediction and personalized treatment selection in oncology.

Novel Approach Combining Shallow Learning and Ensemble Learning for the Automated Detection of Swallowing Sounds in a Clinical Database.

Cervical auscultation is a simple, noninvasive method for diagnosing dysphagia, although the reliability of the method largely depends on the subjectivity and experience of the evaluator. Recently developed methods for the automatic detection of swallowing sounds facilitate a rough automatic diagnosis of dysphagia, although a reliable method of detection specialized in the peculiar feature patterns of swallowing sounds in actual clinical conditions has not been established. We investigated a novel approach for automatically detecting swallowing sounds by a method wherein basic statistics and dynamic features were extracted based on acoustic features: Mel Frequency Cepstral Coefficients and Mel Frequency Magnitude Coefficients, and an ensemble learning model combining Support Vector Machine and Multi-Layer Perceptron were applied. The evaluation of the effectiveness of the proposed method, based on a swallowing-sounds database synchronized to a video fluorographic swallowing study compiled from 74 advanced-age patients with dysphagia, demonstrated an outstanding performance. It achieved an F1-micro average of approximately 0.92 and an accuracy of 95.20%. The method, proven effective in the current clinical recording database, suggests a significant advancement in the objectivity of cervical auscultation. However, validating its efficacy in other databases is crucial for confirming its broad applicability and potential impact.

Enhancing Student Performance Prediction Using a Combined SVM-Radial Basis Function Approach

This research aims to improve student performance predictions using a combined SVM (Support Vector Machine) and radial basis function (RBF) approach. The developed model utilizes a combination of the strengths of SVM in handling class separation and the ability of RBF to capture complex patterns in data. Student assessment data, including math, reading, and writing scores, is used as a feature to predict student performance on tests. Preprocessing steps, including feature normalization and label encoding, are applied to prepare the data for model training. Next, the SVM model with the RBF kernel is initialized and optimized using GridSearchCV to find the best parameters. Model evaluation was carried out using the R2 metric to evaluate how well the model predicts student performance. Experimental results show that the combined SVM-RBF approach can improve student performance predictions with fairly accurate prediction results of 88%. The practical implication of this research is the development of a more accurate model for predicting student performance, which can be used as a tool to improve educational interventions and decision-making in educational institutions.

Voting based ensemble for detecting visual faults in photovoltaic modules using AlexNet features

This study proposes a novel approach utilizing a voting-based ensemble technique to diagnose visible faults in photovoltaic (PV) modules from aerial images captured by unmanned aerial vehicles (UAVs), leveraging AlexNet features. The proposed method focuses on classifying commonly occurring visual faults such as glass breakage, snail trails, burn marks, delamination and discoloration. Two voting-based ensemble models, a two-class ensemble (combining support vector machines and k-nearest neighbor) and a three-class ensemble (integrating support vector machines, J48, and k-nearest neighbor) were developed and evaluated against individual machine learning classifiers. Results indicate that the two-class ensemble outperforms the three-class ensemble and other individual classifiers, achieving an accuracy of 98.30%. This approach not only enhances fault diagnosis accuracy but also reduces inspection costs and instrument monitoring efforts contributing to the sustainable and efficient operation of PV systems.

Abstract 5651: Personalized transcriptomic profiling for advanced prostate cancer: Guiding second-generation hormonal drug selection

Abstract Introduction: Second-generation hormonal drugs have demonstrated significant efficacy in extending the survival of patients with advanced prostate cancer. These drugs operate through two distinct molecular mechanisms: inhibition of androgen biosynthesis and blockade of the androgen receptor. However, due to concerns of side effects, concurrent usage of multiple drugs is not recommended. A notable challenge is the eventual development of drug resistance, rendering all second-generation hormonal therapies ineffective. Currently, there is a lack of guidelines for helping patients choose the most suitable drug. In the context of pharmacogenomics, genetic differences can influence drug susceptibility and efficacy, with variations in genomic sequences and regulatory mechanisms impacting drug response at the transcriptional and translational levels. Considered the rapid processing capabilities of Affymetrix transcriptomic microarrays, we hypothesized that distinct gene signatures in patients who respond well or poorly to second-generation hormonal drugs could be identified and could act as a companion diagnostic tool. Methods: We enrolled 180 advanced prostate cancer patients, who fulfilled Taiwan national health insurance criteria of using second-generation hormonal drugs, from seven medical centers or regional hospitals in Taiwan at 3 time points: prior to drug administration, 3 months after treatment started and drug resistance developed. The RNA expression data and clinical parameters were analyzed, and classification models were built using IPA and R. Good or poor responders were defined by 3-month prostate-specific antigen (PSA) lowered by 90 percent. Results:: Differential expression and enrichment analyses post-treatment highlighted the activation of NF-kappa B signaling and various immune cell pathways. Notably, pathways related to primary immunodeficiency and IL-17 became prominent following the development of drug resistance. At the initial stages, distinct alterations in cell cycle pathways, particularly G1/S and G2/M, were observed between good and poor responders. This was elucidated through principal component analysis and subsequent dbscan clustering. To further distinguish between these responder groups, we utilized an integrative approach for feature selection, combining support vector machine, random forest classifier, and lasso regression. Despite the innovative approach, the model's error rate stood at approximately 15%, attributed mainly to the limited number of cases. Conclusion: Our study highlights the potential of using transcriptomic analysis to predict responses to second-generation hormonal drugs in advanced prostate cancer, paving the way for personalized treatment strategies. However, the need for larger cohort studies is evident to refine these predictive models and enhance their accuracy. Citation Format: Li-Hsin Chang, Hao-Han Chang, Xin-Yi Lin, Shu-Chi Wang, Chih-Pin Chuu, Deng-Neng Chen, Shu-Pin Huang, Chia-Yang Li. Personalized transcriptomic profiling for advanced prostate cancer: Guiding second-generation hormonal drug selection [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2024; Part 1 (Regular Abstracts); 2024 Apr 5-10; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2024;84(6_Suppl):Abstract nr 5651.

ENSEMBLE MACHINE LEARNING METHOD FOR DETECTING DEEP FAKES IN SOCIAL PLATFORM

With the rise of deep fake technology, the detection of manipulated media has become crucial in maintaining the integrity of social platforms. In this study, we propose an ensemble machine learning approach combining Support Vector Machines (SVM), Artificial Neural Networks (ANN), k-Nearest Neighbors (KNN), and Decision Trees (DT) for deep fake detection. Our contribution lies in the development of a robust ensemble method that leverages the strengths of multiple algorithms to enhance detection accuracy and resilience against evolving deep fake techniques. Through experimentation on a diverse dataset, our ensemble model demonstrated superior performance compared to individual models, achieving high accuracy and robustness in detecting deep fakes on social platforms. Keywords: Deep fakes, Ensemble learning, Machine learning, Social platforms, Detection.

Air quality forecasting‐driven cloud resource allocation for sustainable energy consumption: An ensemble classifier approach

AbstractIn recent times, air quality prediction is turned out to be one of the important research topics among research communities to prevent lives from negative health impacts. Random fluctuations of PM2.5 level brought about by frequent variations in meteorological factors create difficulties air pollution management. Forecasting the quality of air using time series data serves as a defense mechanism against threatening hazards by providing immense support to take preventive measures. Besides, handling dynamic real time workloads, forecasted by the prediction model requires appropriate computing resources to distribute workloads based on demands. To achieve this goal, this paper proposes a new Air Quality Prediction‐enabled Resource Allocation scheme for cloud‐based software services, which offers dynamic adjustment of resources based on workload demands with high energy efficiency. The proposed system is a two phase system that executes both air quality prediction and resource allocation processes consecutively. A new weighted average ensemble classifier is designed by combining support vector machine (SVM), artificial neural network (ANN), and gradient boosting machine (GBM) techniques to measure PM2.5 level on time series information of Beijing PM2.5 dataset. The system then dynamically allocates appropriate computing resources using crossover particle swarm optimization (CPSO) algorithm based on the forecasted results of PM2.5 level. This system has the potential to contribute significantly to reducing energy consumption and improving air quality in cities worldwide. The experimental results conducted to determine the efficiency of the proposed system in terms of different metrics proves that it achieves greater performance with less error functions for PM2.5 level prediction as well as minimizes energy consumption for resource allocation when compared with existing methods.

Efficient Fragility Analysis of Cross-Fault Hydraulic Tunnels Combining Support Vector Machine and Improved Cloud Method

ABSTRACT One of the primary concerns in the field of seismic risk assessment for underground structures is establishing an accurate connection between seismic intensity and structural responses. The objective of this work is to conduct a rational support vector machine (SVM) model for generating mass data and improved fragility curves of cross-fault hydraulic tunnels (CFHTs). The results highlight that the 900 sets, multiple earthquake intensity measures, and cubic polynomial kernel function of the SVM model can improve reliability in evaluating structural performance. Additionally, the improved Cloud analysis method is more suitable for seismic performance than the typical Cloud analysis.

Deep learning based on 68Ga-PSMA-11 PET/CT for predicting pathological upgrading in patients with prostate cancer.

To explore the feasibility and importance of deep learning (DL) based on 68Ga-prostate-specific membrane antigen (PSMA)-11 PET/CT in predicting pathological upgrading from biopsy to radical prostatectomy (RP) in patients with prostate cancer (PCa). In this retrospective study, all patients underwent 68Ga-PSMA-11 PET/CT, transrectal ultrasound (TRUS)-guided systematic biopsy, and RP for PCa sequentially between January 2017 and December 2022. Two DL models (three-dimensional [3D] ResNet-18 and 3D DenseNet-121) based on 68Ga-PSMA-11 PET and support vector machine (SVM) models integrating clinical data with DL signature were constructed. The model performance was evaluated using area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, and specificity. Of 109 patients, 87 (44 upgrading, 43 non-upgrading) were included in the training set and 22 (11 upgrading, 11 non-upgrading) in the test set. The combined SVM model, incorporating clinical features and signature of 3D ResNet-18 model, demonstrated satisfactory prediction in the test set with an AUC value of 0.628 (95% confidence interval [CI]: 0.365, 0.891) and accuracy of 0.727 (95% CI: 0.498, 0.893). A DL method based on 68Ga-PSMA-11 PET may have a role in predicting pathological upgrading from biopsy to RP in patients with PCa.

A location-based model using GIS with machine learning, and a human-based approach for demining a post-war region

ABSTRACT Locating and removing landmines and other ERW (Explosive Remnants of War) is dangerous, hazardous, and time-consuming. It requires implementing multilevel on-site surveys: general non-technical surveys to mark the areas affected and technical surveys to determine the perimeter of related minefields. This paper introduces a landmine location-based prediction model, combining military experience with machine-learning techniques and spatiotemporal data, by introducing a new approach for area selection and adding military-based features for context modelling and model training. Besides predicting landmine’s location areas, this model classifies the affected regions by priority and difficulty of clearance, in such a way as to minimise the long time needed by surveys and reduce the danger related to that task, thus providing the clearance organisations with a good resource allocation for their operations. We applied several machine learning techniques that combine Support Vector Machine (SVM), Random Forest (RF), and Extreme Gradient Boosting (XGBOOST), taking into consideration the imbalanced data problem and tweaking for the best performance and accuracy. The experimental results show that the model has the potential to provide reliable predictions and valuable services for demining operations on the field.

A study on the application of an improved adaptive neural network in prestressed bridge engineering inspection

Abstract In recent years, there have been mixed evaluations of the performance of pre-stressed bridges in society. Based on this, this study proposes to integrate adaptive neural networks with BP networks to build a bridge tolerance detection model and combines support vector machines and radial basis function networks to build a bridge wind vibration detection model. The results showed that in the detection results of angle adjustment and detachment, Sample 1 was the closest to the true value, with a difference of only 0.01. As the number of samples increased, the difference became larger, and the difference in sample 5 reached its maximum value of 0.3. The turbulence level of 0.5% had the lowest initial vibration wind speed at a wind attack angle of 10°, with a maximum value of 21m/s. This indicates that the proposed combination model should be more accurate in detecting the tolerance of bridges and more timely in detecting wind-induced vibration risks. In general, research methods have a significant technical value for the safety maintenance of bridge engineering.