Kernel Support Vector Machine Research Articles

Leveraging Quantum Kernel Support Vector Machine for breast cancer diagnosis from Digital Breast Tomosynthesis images

Leveraging Quantum Kernel Support Vector Machine for breast cancer diagnosis from Digital Breast Tomosynthesis images

Improving Sentiment Analysis in Digital Marketplaces through SVM Kernel Fine-Tuning

Improving Sentiment Analysis in Digital Marketplaces through SVM Kernel Fine-Tuning

Electroencephalographic Classification Reveals Atypical Speech Motor Planning in Stuttering Adults.

This study explores speech motor planning in adults who stutter (AWS) and adults who do not stutter (ANS) by applying machine learning algorithms to electroencephalographic (EEG) signals. In this study, we developed a technique to holistically examine neural activity differences in speaking and silent reading conditions across the entire cortical surface. This approach allows us to test the hypothesis that AWS will exhibit lower separability of the speech motor planning condition. We used the silent reading condition as a control condition to isolate speech motor planning activity. We classified EEG signals from AWS and ANS individuals into speaking and silent reading categories using kernel support vector machines. We used relative complexities of the learned classifiers to compare speech motor planning discernibility for both classes. AWS group classifiers require a more complex decision boundary to separate speech motor planning and silent reading classes. These findings indicate that the EEG signals associated with speech motor planning are less discernible in AWS, which may result from altered neuronal dynamics in AWS. Our results support the hypothesis that AWS exhibit lower inherent separability of the silent reading and speech motor planning conditions. Further investigation may identify and compare the features leveraged for speech motor classification in AWS and ANS. These observations may have clinical value for developing novel speech therapies or assistive devices for AWS.

Enhancing microalgae classification accuracy in marine ecosystems through convolutional neural networks and support vector machines

Accurately classifying microalgae species is vital for monitoring marine ecosystems and managing the emergence of marine mucilage, which is crucial for monitoring mucilage phenomena in marine environments. Traditional methods have been inadequate due to time-consuming processes and the need for expert knowledge. The purpose of this article is to employ convolutional neural networks (CNNs) and support vector machines (SVMs) to improve classification accuracy and efficiency. By employing advanced computational techniques, including MobileNet and GoogleNet models, alongside SVM classification, the study demonstrates significant advancements over conventional identification methods. In the classification of a dataset consisting of 7820 images using four different SVM kernel functions, the linear kernel achieved the highest success rate at 98.79 %. It is followed by the RBF kernel at 98.73 %, the polynomial kernel at 97.84 %, and the sigmoid kernel at 97.20 %. This research not only provides a methodological framework for future studies in marine biodiversity monitoring but also highlights the potential for real-time applications in ecological conservation and understanding mucilage dynamics amidst climate change and environmental pollution.

EEG-based driving intuition and collision anticipation using joint temporal-frequency multi-layer dynamic brain network.

Intuition plays a crucial role in human driving decision-making, and this rapid and unconscious cognitive process is essential for improving traffic safety. We used the first proposed multi-layer network analysis method, "Joint Temporal-Frequency Multi-layer Dynamic Brain Network" (JTF-MDBN), to study the EEG data from the initial and advanced phases of driving intuition training in the theta, alpha, and beta bands. Additionally, we conducted a comparative study between these two phases using multi-layer metrics as well as local and global metrics of single layers. The results show that brain region activity is more stable in the advanced phase of intuition training compared to the initial phase. Particularly in the alart state task, the JTF-MDBN demonstrated stronger connection strength. Multi-layer network analysis indicates that modularity is significantly higher for the non-alert state task than the alert state task in the alpha and beta bands. In the W4 time window (1 second before a collision), we identified significant features that can differentiate situations where a car collision is imminent from those where no collision occurs. Single-layer network analysis also revealed statistical differences in node strength and local efficiency for some EEG channels in the alpha and beta bands during the W4 and W5 time windows. Using these biomarkers to predict vehicle collision risk, the classification accuracy of a linear kernel SVM reached up to 87.5%, demonstrating the feasibility of predicting driving collisions through brain network biomarkers. These findings are important for the study of human intuition and the development of brain-computer interface-based intelligent driving hazard perception assistance systems.

A novel temporal-frequency combination pattern optimization approach based on information fusion for motor imagery BCIs

Motor imagery (MI) stands as a powerful paradigm within Brain-Computer Interface (BCI) research due to its ability to induce changes in brain rhythms detectable through common spatial patterns (CSP). However, the raw feature sets captured often contain redundant and invalid information, potentially hindering CSP performance. Methodology-wise, we propose the Information Fusion for Optimizing Temporal-Frequency Combination Pattern (IFTFCP) algorithm to enhance raw feature optimization. Initially, preprocessed data undergoes simultaneous processing in both time and frequency domains via sliding overlapping time windows and filter banks. Subsequently, we introduce the Pearson-Fisher combinational method along with Discriminant Correlation Analysis (DCA) for joint feature selection and fusion. These steps aim to refine raw electroencephalogram (EEG) features. For precise classification of binary MI problems, an Radial Basis Function (RBF)-kernel Support Vector Machine classifier is trained. To validate the efficacy of IFTFCP and evaluate it against other techniques, we conducted experimental investigations using two EEG datasets. Results indicate a notably superior classification performance, boasting an average accuracy of 78.14% and 85.98% on dataset 1 and dataset 2, which is better than other methods outlined in this article. The study’s findings suggest potential benefits for the advancement of MI-based BCI strategies, particularly in the domain of feature fusion.

Combination of static and dynamic neural imaging features to distinguish sensorineural hearing loss: a machine learning study.

Sensorineural hearing loss (SNHL) is the most common form of sensory deprivation and is often unrecognized by patients, inducing not only auditory but also nonauditory symptoms. Data-driven classifier modeling with the combination of neural static and dynamic imaging features could be effectively used to classify SNHL individuals and healthy controls (HCs). We conducted hearing evaluation, neurological scale tests and resting-state MRI on 110 SNHL patients and 106 HCs. A total of 1,267 static and dynamic imaging characteristics were extracted from MRI data, and three methods of feature selection were computed, including the Spearman rank correlation test, least absolute shrinkage and selection operator (LASSO) and t test as well as LASSO. Linear, polynomial, radial basis functional kernel (RBF) and sigmoid support vector machine (SVM) models were chosen as the classifiers with fivefold cross-validation. The receiver operating characteristic curve, area under the curve (AUC), sensitivity, specificity and accuracy were calculated for each model. SNHL subjects had higher hearing thresholds in each frequency, as well as worse performance in cognitive and emotional evaluations, than HCs. After comparison, the selected brain regions using LASSO based on static and dynamic features were consistent with the between-group analysis, including auditory and nonauditory areas. The subsequent AUCs of the four SVM models (linear, polynomial, RBF and sigmoid) were as follows: 0.8075, 0.7340, 0.8462 and 0.8562. The RBF and sigmoid SVM had relatively higher accuracy, sensitivity and specificity. Our research raised attention to static and dynamic alterations underlying hearing deprivation. Machine learning-based models may provide several useful biomarkers for the classification and diagnosis of SNHL.

Valuation of Svm Kernel Performance in Organic and Non-Organic Waste Classification

Valuation of Svm Kernel Performance in Organic and Non-Organic Waste Classification

Two-step machine learning-assisted label-free surface-enhanced Raman spectroscopy for reliable prediction of dissolved furfural in transformer oil

Accurate detection of dissolved furfural in transformer oil is crucial for real-time monitoring of the aging state of transformer oil-paper insulation. While label-free surface-enhanced Raman spectroscopy (SERS) has demonstrated high sensitivity for dissolved furfural in transformer oil, challenges persist due to poor substrate consistency and low quantitative reliability. Herein, machine learning (ML) algorithms were employed in both substrate fabrication and spectral analysis of label-free SERS. Initially, a high-consistency Ag@Au substrate was prepared through a combination of experiments, particle swarm optimization-neural network (PSO-NN), and a hybrid strategy of particle swarm optimization and genetic algorithm (Hybrid PSO-GA). Notably, a two-step ML framework was proposed, whose operational mechanism is classification followed by quantification. The framework adopts a hierarchical modeling strategy, incorporating simple algorithms such as kernel support vector machine (Kernel-SVM), k-nearest neighbors (KNN), etc., to independently establish lightweight regression models on each cluster, which allows each model to focus more effectively on fitting the data within its cluster. The classification model achieved an accuracy of 100%, while the regression models exhibited an average correlation coefficient (R2) of 0.9953 and the root mean square errors (RMSE) consistently below 10-2. Thus, this ML framework emerges as a rapid and reliable method for detecting dissolved furfural in transformer oil, even in the presence of different interfering substances, which may also have potentiality for other complex mixture monitoring systems.

Evaluating Explainable Machine Learning Models for Clinicians

Gaining clinicians’ trust will unleash the full potential of artificial intelligence (AI) in medicine, and explaining AI decisions is seen as the way to build trustworthy systems. However, explainable artificial intelligence (XAI) methods in medicine often lack a proper evaluation. In this paper, we present our evaluation methodology for XAI methods using forward simulatability. We define the Forward Simulatability Score (FSS) and analyze its limitations in the context of clinical predictors. Then, we applied FSS to our XAI approach defined over an ML-RO, a machine learning clinical predictor based on random optimization over a multiple kernel support vector machine (SVM) algorithm. To Compare FSS values before and after the explanation phase, we test our evaluation methodology for XAI methods on three clinical datasets, namely breast cancer, VTE, and migraine. The ML-RO system is a good model on which to test our XAI evaluation strategy based on the FSS. Indeed, ML-RO outperforms two other base models—a decision tree (DT) and a plain SVM—in the three datasets and gives the possibility of defining different XAI models: TOPK, MIGF, and F4G. The FSS evaluation score suggests that the explanation method F4G for the ML-RO is the most effective in two datasets out of the three tested, and it shows the limits of the learned model for one dataset. Our study aims to introduce a standard practice for evaluating XAI methods in medicine. By establishing a rigorous evaluation framework, we seek to provide healthcare professionals with reliable tools for assessing the performance of XAI methods to enhance the adoption of AI systems in clinical practice.

Firefly Algorithm for SVM Multi-class Optimization on Soybean Land Suitability Analysis

Soybean is the primary source of vegetable protein nutrition, containing fat and vitamins that Indonesian people widely consume. The decline in soybean production in Indonesia every year is due to the reduced area of soybean cultivation, thereby increasing dependence on imports from other countries. Land suitability maps can provide directions for priority locations for soybean cultivation based on land characteristics and weather to produce optimal production. The SVM multi-class algorithm has been applied to classify land suitability data to create a land suitability map but has yet to obtain optimal accuracy, especially for sigmoid kernels. The objective of this study is to enhance the performance of the sigmoid kernel SVM by utilizing the firefly algorithm. The study focuses on evaluating the suitability of soybean cultivation in Bogor and Grobogan Regencies. The results of the tests indicate that the firefly algorithm-optimized SVM (FA-SVM) significantly improves accuracy compared to the SVM without optimization. The accuracy achieved by FA-SVM is 89.95%, while the SVM without optimization only achieves an accuracy of 65.99%. The best parameters produced by the firefly algorithm are C=2.33 and σ=0.45 obtained from firefly customization, and the number of generations is 10. Based on this, the optimization algorithm can be used to produce an optimal model. The best optimal model obtained can be used as a guide for priority locations/areas for soybean cultivation by farming communities, so as to produce maximum soybean productivity.

A novel machine learning model for efficacy prediction of immunotherapy-chemotherapy in NSCLC based on CT radiomics

Lung cancer is categorized into two main types: non-small cell lung cancer (NSCLC) and small cell lung cancer. Of these, NSCLC accounts for approximately 85% of all cases and encompasses varieties such as squamous cell carcinoma and adenocarcinoma. For patients with advanced NSCLC that do not have oncogene addiction, the preferred treatment approach is a combination of immunotherapy and chemotherapy. However, the progression-free survival (PFS) typically ranges only from about 6 to 8 months, accompanied by certain adverse events. In order to carry out individualized treatment more effectively, it is urgent to accurately screen patients with PFS for more than 12 months under this treatment regimen. Therefore, this study undertook a retrospective collection of pulmonary CT images from 60 patients diagnosed with NSCLC treated at the First Affiliated Hospital of Wenzhou Medical University. It developed a machine learning model, designated as bSGSRIME-SVM, which integrates the rime optimization algorithm with self-adaptive Gaussian kernel probability search (SGSRIME) and support vector machine (SVM) classifier. Specifically, the model initiates its process by employing the SGSRIME algorithm to identify pivotal image features. Subsequently, it utilizes an SVM classifier to assess these features, aiming to enhance the model's predictive accuracy. Initially, the superior optimization capability and robustness of SGSRIME in IEEE CEC 2017 benchmark functions were validated. Subsequently, employing color moments and gray-level co-occurrence matrix methods, image features were extracted from images of 60 NSCLC patients undergoing immunotherapy combined with chemotherapy. The developed model was then utilized for analysis. The results indicate a significant advantage of the model in predicting the efficacy of immunotherapy combined with chemotherapy for NSCLC, with an accuracy of 92.381% and a specificity of 96.667%. This lays the foundation for more accurate PFS predictions and personalized treatment plans.

Machine learning approaches to debris flow susceptibility analyses in the Yunnan section of the Nujiang River Basin.

The Yunnan section of the Nujiang River (YNR) Basin in the alpine-valley area is one of the most critical areas of debris flow in China. We analyzed the applicability of three machine learning algorithms to model of susceptibility to debris flow-Random Forest (RF), the linear kernel support vector machine (Linear SVM), and the radial basis function support vector machine (RBFSVM)-and compared 20 factors to determine the dominant controlling in debris flow occurrence in the region. We found that (1) RF outperformed RBFSVM and Linear SVM in terms of accuracy, (2) topographic conditions were prerequisites, and geology, precipitation, vegetation, and anthropogenic influence were critical to forming debris flows. Also, the relative elevation difference was the most prominent evaluation factor of debris flow susceptibility, and (3) susceptibility maps based on RF's debris flow susceptibility (DFS) showed that zones with very high susceptibility were distributed along the mainstream of the Nujiang River. These findings provide methodological guidance and reference for improvement of DFS assessment. It enriches the content of DFS studies in the alpine-valley areas.

Non-linear Kernel Optimisation of Support Vector Machine Algorithm for Online Marketplace Sentiment Analysis

Twitter is a social media platform that is very important in the digital world. Fast communication and interaction make Twitter a vital information center in sentiment analysis. The purpose of this research is to classify public opinion about the presence of marketplaces in Indonesia, both positive and negative sentiments, using a Non-linear SVM algorithm based on 1276 tweets. This research involves the stages of data pre-processing, labeling, feature extraction using TF-IDF, and data division into three scenarios: 80% training data and 20% test data, 50% training data and 50% test data scenario, and 20% training data and 80% test data scenario. The last process, GridSearchCV, combines cross-validation and non-linear SVM parameters for model evaluation using a confusion matrix. The best SVM model resulting from the scenario was 80% training and 20% test data, with hyperparameters Gamma = 100 and C = 0.01, achieving 89% accuracy. When tested on never-before-seen data, the accuracy increased to 90%, with an f1-score of 91%, precision of 88%, and recall of 95% on negative sentiments. In conclusion, evaluating the performance of non-linear SVM kernels with a combination of hyperparameter values can improve accuracy, especially on public response information about online marketplaces and public sentiment.

Machine Learning Insights: Exploring Key Factors Influencing Sale-to-List Ratio—Insights from SVM Classification and Recursive Feature Selection in the US Real Estate Market

The US real estate market is a complex ecosystem influenced by multiple factors, making it critical for stakeholders to understand its dynamics. This study uses Zillow Econ (monthly) data from January 2018 to October 2023 across 100 major regions gathered through Metropolitan Statistical Area (MSA) and advanced machine learning techniques, including radial kernel Support Vector Machines (SVMs), used to predict the sale-to-list ratio, a key metric that indicates the market health and competitiveness of the US real estate. Recursive Feature Elimination (RFE) is used to identify influential variables that provide insight into market dynamics. Results show that SVM achieves approximately 85% accuracy, with temporal indicators such as Days to Pending and Days to Close, pricing dynamics such as Listing Price Cut and Share of Listings with Price Cut, and rental market conditions captured by the Zillow Observed Rent Index (ZORI) emerging as critical factors influencing the sale-to-list ratio. The comparison between SVM alphas and RFE highlights the importance of time, price, and rental market indicators in understanding market trends. This study underscores the interplay between these variables and provides actionable insights for stakeholders. By contextualizing the findings within the existing literature, this study emphasizes the importance of considering multiple factors in housing market analysis. Recommendations include using pricing dynamics and rental market conditions to inform pricing strategies and negotiation tactics. This study adds to the body of knowledge in real estate research and provides a foundation for informed decision-making in the ever-evolving real estate landscape.

Detection of Exploit Websites Using Machine Learning and Data Analysis

Abstract: With the growing integration of internet integration into daily life, the prevalence of security threats such as phishing attacks has become a significant concern. Phishing websites aim to illicitly acquire sensitive user information, posing serious risks to online security. In response, machine learning methods have been investigated for the detection of such fraudulent websites. concentrates on developing a robust phishing website detection system, emphasizing efficiency, accuracy, and costeffectiveness. Four supervised classification models, namely K-Nearest Neighbour, Kernel Support Vector Machine, Decision Tree, and Random Forest Classifier, are employed and compared. Among these models, the Random Forest classifier demonstrates superior performance, achieving an impressive accuracy score of 96.82% on the selected dataset

Knowledge Graph Construction and Digital Twin Modeling Integrating Multi-modal Data

Supply chain analytics is focusing more and more attention on industrial logistics. Optimal allocation of assets is severely restricted by the timing inconsistency and geographical instability of industrial logistics assets brought by unpredictability and variability. Unnecessarily lengthy drive distances and lengthy delays are caused by the incapacity to acquire and utilize industrial logistics asset spatial-and-temporal (ST) qualities rationally, which affects the processes' potential to operate sustainably. Thus, for efficient usage of resources in industrial logistics, a novel machine learning (ML)-assisted knowledge graph (ML-KG) design is provided in this work. For evaluating the multi-modal data produced by widely deployed IoT devices, a novel customizable diversified kernelized support vector machine (CDK-SVM) approach is also suggested. After establishing the suggested ML-KG framework for ST integrity in the representation of the digital twin version, links are carried out and reasoning is performed using job data related to industrial logistics. The graph mechanism effectively distributes the industrial logistics resources. Lastly, the outcome proves that the suggested process is successful in the distribution of industrial logistics assets.

Explaining the predictions of kernel SVM models for neuroimaging data analysis

Machine learning methods have shown great performance in many areas, including neuroimaging data analysis. However, model performance is only one objective in neuroimaging analysis. Gaining insight from the data is also critical in this field, such as identifying regions where detected signals are relevant to cognitive and diagnostic tasks. To fulfill this need, enabling the explainability of a model’s decision-making process is critical. Predictions of complex machine learning models are notoriously difficult to explain. This limits the use of complex models like kernel support vector machines (SVM) in neuroimaging analysis. Recently, several permutation-based methods have been developed to explain these complex models. However, the explanation results are affected by class-irrelevant features like suppressor variables and high background noise variables. This problem may also happen when explaining linear models. One possible reason is that the permutation process will produce unrealistic data instances when features are not independent, e.g. correlated. These unrealistic data instances will influence the explanation results. In neuroimaging analysis, the activation pattern, the estimated weight of the assumed generative model corresponding to the current classifier, is used to deal with this problem for linear models. This method does not rely on a permutation process but rather on the available data information. In this paper, we propose a novel method of Explanation through Activation Pattern (EAP) to explain the SVM models with different types of kernels for neuroimaging data analysis. Our method can generate a global feature importance score by estimating the activation pattern of kernel SVM models. We evaluate our method against three popular methods on both simulation datasets and a publicly available EEG/MEG dataset on visual tasks. The experimental results demonstrate that the proposed EAP method can provide explanations with low computational cost and is less affected by class-irrelevant features than the other three methods. In the experiment using the MEG/EEG dataset of visual tasks, the proposed EAP method provides agreement results with the brain’s electrical activity patterns reported in the literature on the visual tasks EEG/MEG data and is significantly faster than the other explanation methods.

Ice-Core Micro-CT Image Segmentation with Dual Stream Spectrum Deconvolution Neural Network and Gaussian Mixture Model

Polar ice sheets, or ice cores, are among the most well-known natural archives that might provide crucial historical details about our planet's previous environment. An important factor in establishing the fundamental characteristics of ice, likes pore close-off, albedo, melt events, is the ice-core microstructure. To engulf these complications Ice-Core Micro-CT Image Segmentation with Dual Stream Spectrum Deconvolution Neural Network and Gaussian Mixture Model (ICMCTS-WSOA-DSSDNN-GMM)is proposed. Initially, micro scale CT images are collect from Alfred Wegener Institute ice-core storage as input. Then,data’s are given to pre-processing. In pre-processing, it enhance image brightness, remove salt pepper noise, crop outer ring (carbon fiber casing) to have only ice particles in image utilizing Federated Neural Collaborative Filtering (FNCF).The pre-processing output is given to segmentation. Here, micro scale CT image is utilized for segmenting high-resolution scans using Gaussian Mixture Model (GMM). After that, the segmented images are given to Dual Stream Spectrum Deconvolution Neural Network optimized with Water Strider Optimization Algorithm for classifying micro scale CT images as sintered snow, compacted firn and bubbly ice. The proposed ICMCTS-WSOA-DSSDNN-GMM method is executed in python. The performance of ICMCTS-WSOA-DSSDNN-GMM approach attains 16.24%, 17.90% and 27.7% high accuracy, 14.04%, 25.51% and 19.31% higher precision and 14.36%, 12.65%, 14.51% higher recall analyzed with existing techniques likes Ice-Core Micro-CT Image Segmentation With Deep Learning and Gaussian Mixture Method (ICMCTS-U-net-GMM), Computer Aided Detection of COVID 19 from CT Images Depend on Gaussian Mixture Method with Kernel Support Vector Machines Classifer (ICMCTS-KNN-GMM) and the Gmmseg: Gaussian mixture based generative semantic segmentation methods(ICMCTS-FCN-GMM) respectively.

A new COVID-19 classification approach based on Bayesian optimization SVM kernel using chest X-ray datasets

A new COVID-19 classification approach based on Bayesian optimization SVM kernel using chest X-ray datasets