Support Vector Machine Network Research Articles

Non-Invasive Monitoring of Cerebral Edema Using Ultrasonic Echo Signal Features and Machine Learning

Objectives: Cerebral edema, a prevalent consequence of brain injury, is associated with significant mortality and disability. Timely diagnosis and monitoring are crucial for patient prognosis. There is a pressing clinical demand for a real-time, non-invasive cerebral edema monitoring method. Ultrasound methods are prime candidates for such investigations due to their non-invasive nature. Methods: Acute cerebral edema was introduced in rats by permanently occluding the left middle cerebral artery (MCA). Ultrasonic echo signals were collected at nine time points over a 24 h period to extract features from both the time and frequency domains. Concurrently, histomorphological changes were examined. We utilized support vector machine (SVM), logistic regression (LogR), decision tree (DT), and random forest (RF) algorithms for classifying cerebral edema types, and SVM, RF, linear regression (LR), and feedforward neural network (FNNs) for predicting the cerebral infarction volume ratio. Results: The integration of 16 ultrasonic features associated with cerebral edema development with the RF model enabled effective classification of cerebral edema types, with a high accuracy rate of 97.9%. Additionally, it provided an accurate prediction of the cerebral infarction volume ratio, with an R2 value of 0.8814. Conclusions: Our proposed strategy classifies cerebral edema and predicts the cerebral infarction volume ratio with satisfactory precision. The fusion of ultrasound echo features with machine learning presents a promising non-invasive approach for the monitoring of cerebral edema.

Ensemble of hybrid model based technique for early detecting of depression based on SVM and neural networks

The prevalence of depression has increased dramatically over the last several decades: it is frequently overlooked and can have a significant impact on both physical and mental health. Therefore, it is crucial to develop an automated detection system that can instantly identify whether a person is depressed. Currently, machine learning (ML) and artificial neural networks (ANNs) are among the most promising approaches for developing automated computer-based systems to predict several mental health issues, such as depression. This study propose an ensemble of hybrid model-based techniques that aims to build a strong detection model that considers many psychological and sociodemographic characteristics of an individual to detect whether a person is depressed. Support vector machines (SVM) and multilayer perceptrons (MLP) are the two fundamental methods used to construct the suggested ensemble approach. The hybrid DeprMVM served as a meta-learner. In this study, the hybrid DeprMVM is a level-1 learner, whereas the SVM and MLP networks are level-0 learners. After the classifiers are trained and tested at level 0, their outputs are based on both the independent and dependent variables in the new data set that was used to train the meta-classifier. The training data class imbalance was reduced by applying the synthetic minority oversampling technique (SMOTE) and cluster sampling together, which improved the accuracy for detecting depression. Additionally, it can effectively reduce the risk of over-fitting from simply duplicating data points. To further confirm the effectiveness of the proposed method, various performance evaluation metrics were calculated and compared with previous studies conducted on this specific dataset. In conclusion, among all the techniques for identifying depression, the suggested ensemble approach had the best accuracy, at 99.39%, and an F1-score of 99.51%.

Comparative Analysis of Machine Learning Models for Predicting Student Success in Online Programming Courses: A Study Based on LMS Data and External Factors

Early prediction of student performance in online programming courses is essential for implementing timely interventions to enhance academic outcomes. This study aimed to predict academic success by comparing four machine learning models: Logistic Regression, Random Forest, Support Vector Machine (SVM), and Neural Network (Multilayer Perceptron, MLP). We analyzed data from the Moodle Learning Management System (LMS) and external factors of 591 students enrolled in online object-oriented programming courses at the Universidad Estatal de Milagro (UNEMI) between 2022 and 2023. The data were preprocessed to address class imbalance using the synthetic minority oversampling technique (SMOTE), and relevant features were selected based on Random Forest importance rankings. The models were trained and optimized using Grid Search with cross-validation. Logistic Regression achieved the highest Area Under the Receiver Operating Characteristic Curve (AUC-ROC) on the test set (0.9354), indicating strong generalization capability. SVM and Neural Network models performed adequately but were slightly outperformed by the simpler models. These findings suggest that integrating LMS data with external factors enhances early prediction of student success. Logistic Regression is a practical and interpretable tool for educational institutions to identify at-risk students, and to implement personalized interventions.

Rapid identification and early warning of axial compressor stall based on multiscale CNN-SVM-FC model

Early prewarning of compressor stall and surge is crucial to avoid aircraft engine instability, yet it is challenging due to the complex and unstable flow field characterized by multiple modes and multiscale features. To enhance the multi-scale feature representation capability of Convolutional Neural Network-Support Vector Machine (CNN-SVM) algorithm, a novel classifier modelling method combined multiscale windows with CNN-SVM is introduced for stall prewarning in this paper, named Multiscale CNN-SVM-FC. Multiscale detection windows are utilized to adaptively identify various pressure features during the stall process. Additionally, to reduce the false alarm rate, a fuzzy control algorithm is integrated with the temporal accumulation of prediction results from the multi-branch network for joint analysis. A series of test data from a five-stage axial compressor at different operating speeds is used to verify this method. The results indicate that the proposed Multiscale CNN-SVM-FC method enhances the accuracy of classification and reduces the false alarm rate compared to the standard CNN-SVM model, achieving over 99% accuracy in identifying unstable states under various speeds. Compared to three traditional stall prewarning methods, the Multiscale CNN-SVM-FC model provides an average warning signal 164 milliseconds ahead of stall, and reduces the uncertainty associated with threshold selection, which typically relies on engineering experience.

Harnessing machine learning for enhanced quantitative financial strategies: Applications and case studies

Machine learning algorithms have long been an essential tool for quantitative finance, as they play an important role in the asset pricing, portfolio optimisation and financial risk management. This work discusses how to apply Random Forest, Support Vector Machine (SVM), and Neural Networks to further develop and enhance the quantitative investment research. With automatic feature selection, reconstruction of high-dimensional data and resist against over-fitting, Random Forest has been an efficient ensemble approach with remarkable prediction performance. For this reason, Random Forest is leveraged for the stock price prediction. SVM, particularly known for its robustness in high-dimensional classification task, has a non-linear optimisation ability that can be employed to capture the inherent non-linear dependencies in options prices. Neural Networks, as a learning approach capable of discovering complex relationships, is employed for the portfolio optimisation, with a promise for further improving the risk-adjusted portfolio return. The work is conducted through practical case studies to simulate how Random Forest, SVM and Neural Networks enable us to further improve the financial performance, and to illustrate its advantage, disadvantage and practical application in quantitative finance.

Fault Detection of Wheelset Bearings through Vibration-Sound Fusion Data Based on Grey Wolf Optimizer and Support Vector Machine

This study aims to detect faults in wheelset bearings by analyzing vibration-sound fusion data, proposing a novel method based on Grey Wolf Optimizer (GWO) and Support Vector Machine (SVM). Wheelset bearings play a vital role in transportation. However, malfunctions in the bearing might result in extensive periods of inactivity and maintenance, disrupting supply chains, increasing operational costs, and causing delays that affect both businesses and consumers. Fast fault identification is crucial for minimizing maintenance expenses. In this paper, we proposed a new integration of GWO for optimizing SVM hyperparameters, specifically tailored for handling sound-vibration signals in fault detection. We have developed a new fault detection method that efficiently processes fusion data and performs rapid analysis and prediction within 0.0027 milliseconds per data segment, achieving a test accuracy of 98.3%. Compared to the SVM and neural network models built in MATLAB, the proposed method demonstrates superior detection performance. Overall, the GWO-SVM-based method proposed in this study shows significant advantages in fault detection of wheelset bearing vibrations, providing an efficient and reliable solution that is expected to reduce maintenance costs and improve the operational efficiency and reliability of equipment.

SVM, KNN, and Neural Networks Investigated for Machine Learning in Written Word Decoding

The capacity of a device to recognise and understand legible handwriting input from a variety of origins, including written material, snap shots, displays, and other electronics, is known as handwritten reputation. In this study, we investigate three classification algorithms: Support Vector Machines (SVM), K-Nearest_Neighbours (KNN), and Neural Networks for handwritten character recognition, and we will identify the best one among these three.

Analyzing speed-difference impact on freeway joint injury severities of Leading-Following vehicles using statistical and data-driven models

Rear-end (RE) crashes are notably prevalent and pose a substantial risk on freeways. This paper explores the correlation between speed difference among the following and leading vehicles (Δν) and RE crash risk. Three joint models, comprising both uncorrelated and correlated joint random-parameters bivariate probit (RPBP) approaches (statistical methods) and a cross-stitch multilayer perceptron (CS-MLP) network (a data-driven method), were estimated and compared against three separate models: Support Vector Machines (SVM), eXtreme Gradient Boosting (XGBoost), and MLP networks (all data-driven methods). Data on 15,980 two-vehicle RE crashes were collected over a two-year period, from January 1, 2021, to December 31, 2022, considering two possible levels of injury severity: no injury and injury/fatality for both drivers of following and leading vehicles. The comparative performance analysis demonstrates the superior predictive capability of the CS-MLP network over the uncorrelated/correlated joint RPBP model, SVM, XGBoost, and MLP networks in terms of recall, F-1 Score, and AUC. Significantly, numerous shared variables influence the injury severity outcomes for the following and leading vehicles across both statistical and data-driven approaches. Among these factors, the following vehicle (a truck) and the leading vehicle (a passenger car) demonstrate contrasting effects on the injury severity outcomes for both vehicles. Furthermore, the SHapley Additive exPlanations (SHAP) values from the CS-MLP network visually show the relationship between Δν and injury severity, revealing non-linear trends unlike the average effects shown by statistical methods. They indicate that the least injury outcomes for both following and leading vehicles occurs at a Δν of 0 to 10 mph, matching observed patterns in RE crash data. Additionally, a marked variation in the trend of SHAP values for the two vehicles is noted as the speed difference increases. Therefore, the findings affirm the superior performance of joint model development and substantiate the non-linear impacts of speed difference on injury outcomes. The adoption of dynamic speed control measures is recommended to mitigate the injury outcomes involved in two-vehicle RE crashes.

Predictive Study on the Occurrence of Wheat Blossom Midges Based on Gene Expression Programming with Support Vector Machines.

This study addresses the challenges in plant pest and disease prediction within the context of smart agriculture, highlighting the need for efficient data processing techniques. In response to the limitations of existing models, which are characterized by slow training speeds and a low prediction accuracy, we introduce an innovative prediction method that integrates gene expression programming (GEP) with support vector machines (SVM). Our approach, the gene expression programming-support vector machine (GEP-SVM) model, begins with encoding and fitness function determination, progressing through cycles of selection, crossover, mutation, and the application of a convergence criterion. This method uniquely employs individual gene values as parameters for SVM, optimizing them through a grid search technique to refine genetic parameters. We tested this model using historical data on wheat blossom midges in Shaanxi Province, spanning from 1933 to 2010, and compared its performance against traditional methods, such as GEP, SVM, naive Bayes, K-nearest neighbor, and BP neural networks. Our findings reveal that the GEP-SVM model achieves a leading back-generation accuracy rate of 90.83%, demonstrating superior generalization and fitting capabilities. These results not only enhance the computational efficiency of pest and disease prediction in agriculture but also provide a scientific foundation for future predictive endeavors, contributing significantly to the optimization of agricultural production strategies.

Automated classification of drill string vibrations using machine learning algorithms

Downhole vibration can cause drill string failures and significant economic losses. Recognizing harmful vibrations in real time is highly significant for optimizing drilling operations. This work aims to identify whirls and stick-slip using machine learning (ML) from downhole measured accelerations. A rotor dynamics model is utilized to simulate whirl and a coupling method between whirl and stick-slip is presented. 448 sets of simulated acceleration data are used for the training of ML classification models. 14 features for whirl identification and 8 for stick-slip are defined in each acceleration. The generalization abilities of the trained whirl and stick-slip classifiers are validated using ABAQUS simulation data and field-measured data, respectively. Decision Tree, Naive Bayes, Support Vector Machine (SVM), and Neural Network algorithms are tested. The classification accuracy is highest when whirl is divided into synchronous forward whirl, synchronous backward whirl, and discontinuous contact whirl. Both SVM and Neural Network algorithms can achieve nearly 100% accuracy in rotor dynamics data and ABAQUS data. The highest accuracy is attained by utilizing both tangential and radial acceleration. However, using only tangential acceleration can still fulfill engineering requirements. The stick-slip classifier, when using SVM and Neural Network, can achieve 100% recognition accuracy on all test data. The proposed methods can lessen sensor need for downhole measurements and speed up data processing, and may be applied to other problems involving rotating soft shafts.

Characterization of clinical data for patient stratification in moderate osteoarthritis with support vector machines, regulatory network models, and verification against osteoarthritis Initiative data

Knee osteoarthritis (OA) diagnosis is based on symptoms, assessed through questionnaires such as the WOMAC. However, the inconsistency of pain recording and the discrepancy between joint phenotype and symptoms highlight the need for objective biomarkers in knee OA diagnosis. To this end, we study relationships among clinical and molecular data in a cohort of women (n = 51) with Kellgren–Lawrence grade 2–3 knee OA through a Support Vector Machine (SVM) and a regulation network model. Clinical descriptors (i.e., pain catastrophism, depression, functionality, joint pain, rigidity, sensitization and synovitis) are used to classify patients. A Youden’s test is performed for each classifier to determine optimal binarization thresholds for the descriptors. Thresholds are tested against patient stratification according to baseline WOMAC data from the Osteoarthritis Initiative, and the mean accuracy is 0.97. For our cohort, the data used as SVM inputs are knee OA descriptors, synovial fluid proteomic measurements (n = 25), and transcription factor activation obtained from regulatory network model stimulated with the synovial fluid measurements. The relative weights after classification reflect input importance. The performance of each classifier is evaluated through ROC-AUC analysis. The best classifier with clinical data is pain catastrophism (AUC = 0.9), highly influenced by funcionality and pain sensetization, suggesting that kinesophobia is involved in pain perception. With synovial fluid proteins used as input, leptin strongly influences every classifier, suggesting the importance of low-grade inflammation. When transcription factors are used, the mean AUC is limited to 0.608, which can be related to the pleomorphic behaviour of osteoarthritic chondrocytes. Nevertheless, funcionality has an AUC of 0.7 with a decisive importance of FOXO downregulation. Though larger and longitudinal cohorts are needed, this unique combination of SVM and regulatory network model shall help to stratify knee OA patients more objectively.

Retraction Note: Speaker identification using hybrid neural network support vector machine classifier

Retraction Note: Speaker identification using hybrid neural network support vector machine classifier

Performance Comparison of Various Machine Learning Models for Rainfall Prediction Using Wind Information

Forecasting rainfall, crucial for agriculture, water management, and disaster preparedness, presents significant challenges due to intricate relationships often missed by conventional statistical methods. Hence, machine learning (ML) models offer promising alternatives, enhancing the precision and dependability of rainfall predictions. This paper presents a comprehensive comparison of various ML models with diverse model structures and regularization strategies for rainfall prediction in urban metropolitan cities. The results show that the random forest model, and gradient boosting model outperform the other models such as logistic regression, support vector machine (SVM), decision tree, K-nearest neighbor (KNN), Naive Bayes, linear SVM, and neural network in terms of accuracy. Validation accuracies of 75%, 77%, 68%, 78%, 76%, 78%, 74%, 75% and 76% were achieved for logistic regression, SVM, decision tree, random forest model, KNN, gradient boosting model, Naive Bayes, linear SVM, and neural network, respectively. The choice of ML models for rainfall prediction should consider the characteristics of the data, e.g. a lag feature for 20 days was employed that uses previous time steps to predict the next time step. The paper concludes that ML models, especially the random forest and gradient boosting models are powerful and robust tools for rainfall prediction in urban metropolitan cities. Key Words: rainfall prediction, wind information, machine learning, gradient boosting, random forest

Framework for the Classification of Facial Emotions Using Soft Computing Techniques

Background:: Facial emotion recognition (FER) technology is enumerated as a productive interface in several operations, which has been specifically focused on as a substitute communication path among a user and an appliance for human computer interface in the previous decade. The efficiency of the facial identification model straightaway relies on the capability of classification methods. In addition, an appropriate swap between recognition efficiency and computational cost is reckoned as the most important factor for planning such models. Methods:: The objective of this paper was to classify the facial emotion electromyogram (EMG) signals by means of a neural network algorithm (NN), support vector machine (SVM) algorithm, and Naive-Bayes algorithm. This research work was directed towards the correlation among the classification accuracies by applying distinct feature extraction procedures on fEMGs. At first, eight participants (six male and two female) were recruited for data recording. Four electrodes were placed on each participant's face for capturing facial gestures (happy, angry, sad, and fear) and two electrodes were placed on the wrist for grounding purposes. Data were recorded by using BIOPAC MP150. After this, the signals were filtered using a band-pass filter and segmentation techniques for enhanced processing. After that, the time-domain and frequency-domain feature extraction procedures were carried out. Time domain and frequency domain features were applied to recorded signals. In this research, we used LabVIEW and MATLAB to produce a set of characteristics from fEMG signals for four emotional conditions, such as anger, sad, fear, and happy. After the feature extraction process, the extracted features were aligned into respective emotions by applying classifiers. The extracted features were further trained and classified by applying the SVM classifier, neural network classifier, and Naive Bayes classifier in MATLAB 2020. Results:: The SVM classifier and neural network classifier generated an accuracy of 93.80% and 96.90%, respectively, whereas the Naive Bayes classifier generated an accuracy of 90.60%. Conclusion:: Facial emotion recognition (FER) is foresighted as a progressive or futuristic model, which has attracted the attention of researchers in several areas of learning due to its higher prospects in distinct applications. Acknowledgment of the emotions through biomedical signals produced from movements of facial muscles is lately presented using an explicit and authentic route.

Deep-Learning Model Prediction of Radiation Pneumonitis Using Pretreatment Chest Computed Tomography and Clinical Factors.

Objectives: This study aimed to build a comprehensive deep-learning model for the prediction of radiation pneumonitis using chest computed tomography (CT), clinical, dosimetric, and laboratory data. Introduction: Radiation therapy is an effective tool for treating patients with lung cancer. Despite its effectiveness, the risk of radiation pneumonitis limits its application. Although several studies have demonstrated models to predict radiation pneumonitis, no reliable model has been developed yet. Herein, we developed prediction models using pretreatment chest CT and various clinical data to assess the likelihood of radiation pneumonitis in lung cancer patients. Methods: This retrospective study analyzed 3-dimensional (3D) lung volume data from chest CT scans and 27 features including dosimetric, clinical, and laboratory data from 548 patients who were treated at our institution between 2010 and 2021. We developed a neural network, named MergeNet, which processes lung 3D CT, clinical, dosimetric, and laboratory data. The MergeNet integrates a convolutional neural network with subsequent fully connected layers. A support vector machine (SVM) and light gradient boosting machine (LGBM) model were also implemented for comparison. For comparison, the convolution-only neural network was implemented as well. Three-dimensional Resnet-10 network and 4-fold cross-validation were used. Results: Classification performance was quantified by using the area under the receiver operative characteristic curve (AUC) metrics. MergeNet showed the AUC of 0.689. SVM, LGBM, and convolution-only networks showed AUCs of 0.525, 0.541, and 0.550, respectively. Application of DeLong test to pairs of receiver operating characteristic curves respectively yielded P values of .001 for the MergeNet-SVM pair and 0.001 for the MergeNet-LGBM pair. Conclusion: The MergeNet model, which incorporates chest CT, clinical, dosimetric, and laboratory data, demonstrated superior performance compared to other models. However, since its prediction performance has not yet reached an efficient level for clinical application, further research is required. Contribution: This study showed that MergeNet may be an effective means to predict radiation pneumonitis. Various predictive factors can be used together for the radiation pneumonitis prediction task via the MergeNet.

Rapid Identification of the Species of Bloodstain Based on Near Infrared Spectroscopy and Convolutional Neural Network-Support Vector Machine Algorithm

As one of the most important types of evidence at the scene of the crime, the rapid identification of the human bloodstain is of great significance to solve the criminal case. In this paper, the spectral data of different species of bloodstain samples including human, chicken and pig were acquired by using a hand-held near-infrared spectrometer. Then, the training models were established via convolutional neural network-support vector machine algorithm. Meanwhile, the traditional support vector machine, genetic algorithm-back propagation and random forest classification algorithms were also compared. The results showed that the prediction accuracy of convolutional neural network-support vector machine algorithm was the highest and the overall performance of the model was the best. The rapid detection method based on a handheld near-infrared spectrometer and convolutional neural network-support vector machine algorithm could identify the species of bloodstain efficiently, non-destructively, quickly and accurately and it provided a new technical reference for bloodstains detection and identification.

A hybrid CNN-SVM model for enhanced autism diagnosis.

Autism is a representative disorder of pervasive developmental disorder. It exerts influence upon an individual's behavior and performance, potentially co-occurring with other mental illnesses. Consequently, an effective diagnostic approach proves to be invaluable in both therapeutic interventions and the timely provision of medical support. Currently, most scholars' research primarily relies on neuroimaging techniques for auxiliary diagnosis and does not take into account the distinctive features of autism's social impediments. In order to address this deficiency, this paper introduces a novel convolutional neural network-support vector machine model that integrates resting state functional magnetic resonance imaging data with the social responsiveness scale metrics for the diagnostic assessment of autism. We selected 821 subjects containing the social responsiveness scale measure from the publicly available Autism Brain Imaging Data Exchange dataset, including 379 subjects with autism spectrum disorder and 442 typical controls. After preprocessing of fMRI data, we compute the static and dynamic functional connectivity for each subject. Subsequently, convolutional neural networks and attention mechanisms are utilized to extracts their respective features. The extracted features, combined with the social responsiveness scale features, are then employed as novel inputs for the support vector machine to categorize autistic patients and typical controls. The proposed model identifies salient features within the static and dynamic functional connectivity, offering a possible biological foundation for clinical diagnosis. By incorporating the behavioral assessments, the model achieves a remarkable classification accuracy of 94.30%, providing a more reliable support for auxiliary diagnosis.

NA

NA

Predicting consumer acceptance of automobiles based on deep learning and traditional machine learning algorithms

Researchers have made significant progress in machine learning in recent years. Machine learning can learn and predict large and complex data sets. Researchers have divided machine learning algorithms into two categories: deep learning and traditional machine learning. Every problem can be predicted in both ways. This paper uses the "Car Data" dataset to investigate deep learning and traditional machine learning. In order to find a machine learning algorithm that is more conducive to analyzing and predicting consumers' acceptance of different cars, this paper mainly explores the differences in the prediction accuracy of the three methods of Neural Networks, Random Forest and Support Vector Machine (SVM). We construct 3-hidden layers neural networks and 4-hidden layers neural networks. After testing, it is known that the result predicted by Random Forest is the worst. The prediction accuracy of 3-hidden layers Neural Networks is similar to that by SVM. When we added an extra layer of hidden layers on the basis of 3-hidden layers, the prediction accuracy was higher than that of SVM. Adding a hidden layer can improve the prediction accuracy, and both SVM and Neural Network can be used to analyze Car Data. But not all methods have similar predictive accuracy.

Performance Analysis of Artificial Intelligence Approaches for LEMP Classification

Lightning Electromagnetic Pulses, or LEMPs, propagate in the Earth–ionosphere waveguide and can be detected remotely by ground-based lightning electric field sensors. LEMPs produced by different types of lightning processes have different signatures. A single thunderstorm can produce thousands of LEMPs, which makes their classification virtually impossible to carry out manually. The lightning classification is important to distinguish the types of thunderstorms and to know their severity. Lightning type is also related to aerosol concentration and can reveal wildfires. Artificial Intelligence (AI) is a good approach to recognizing patterns and dealing with huge datasets. AI is the general denomination for different Machine Learning Algorithms (MLAs) including deep learning and others. The constant improvements in the AI field show us that most of the Lightning Location Systems (LLS) will soon incorporate those techniques to improve their performance in the lightning-type classification task. In this study, we assess the performance of different MLAs, including a SVM (Support Vector Machine), MLP (Multi-Layer Perceptron), FCN (Fully Convolutional Network), and Residual Neural Network (ResNet) in the task of LEMP classification. We also address different aspects of the dataset that can interfere with the classification problem, including data balance, noise level, and LEMP recorded length.