Support Vector Machine Classification Model Research Articles

Distinguishing Rectal Cancer from Colon Cancer Based on the Support Vector Machine Method and RNA-sequencing Data.

Colorectal cancer (CRC) is the third most commonly diagnosed cancer worldwide. Several studies have indicated that rectal cancer is significantly different from colon cancer in terms of treatment, prognosis, and metastasis. Recently, the differential mRNA expression of colon cancer and rectal cancer has received a great deal of attention. The current study aimed to identify significant differences between colon cancer and rectal cancer based on RNA sequencing (RNA-seq) data via support vector machines (SVM). Here, 393 CRC samples from the The Cancer Genome Atlas (TCGA) database were investigated, including 298 patients with colon cancer and 95 with rectal cancer. Following the random forest (RF) analysis of the mRNA expression data, 96 genes such as HOXB13, PRAC, and BCLAF1 were identified and utilized to build the SVM classification model with the Leave-One-Out Cross-validation (LOOCV) algorithm. In the training (n=196) and the validation cohorts (n=197), the accuracy (82.1 % and 82.2 %, respectively) and the AUC (0.87 and 0.91, respectively) indicated that the established optimal SVM classification model distinguished colon cancer from rectal cancer reasonably. However, additional experiments are required to validate the predicted gene expression levels and functions.

Identification of SARS-CoV-2 viral entry inhibitors using machine learning and cell-based pseudotyped particle assay

In response to the pandemic caused by SARS-CoV-2, we constructed a hybrid support vector machine (SVM) classification model using a set of publicly posted SARS-CoV-2 pseudotyped particle (PP) entry assay repurposing screen data to identify novel potent compounds as a starting point for drug development to treat COVID-19 patients. Two different molecular descriptor systems, atom typing descriptors and 3D fingerprints (FPs), were employed to construct the SVM classification models. Both models achieved reasonable performance, with the area under the curve of receiver operating characteristic (AUC-ROC) of 0.84 and 0.82, respectively. The consensus prediction outperformed the two individual models with significantly improved AUC-ROC of 0.91, where the compounds with inconsistent classifications were excluded. The consensus model was then used to screen the 173,898 compounds in the NCATS annotated and diverse chemical libraries. Of the 255 compounds selected for experimental confirmation, 116 compounds exhibited inhibitory activities in the SARS-CoV-2 PP entry assay with IC50 values ranged between 0.17 µM and 62.2 µM, representing an enrichment factor of 3.2. These 116 active compounds with diverse and novel structures could potentially serve as starting points for chemistry optimization for COVID-19 drug discovery.

Forensic analysis of beverage stains using hyperspectral imaging

Documentation and analysis of crime scene evidences are of great importance in any forensic investigation. In this paper, we present the potential of hyperspectral imaging (HSI) to detect and analyze the beverage stains on a paper towel. To detect the presence and predict the age of the commonly used drinks in a crime scene, we leveraged the additional information present in the HSI data. We used 12 different beverages and four types of paper hand towel to create the sample stains in the current study. A support vector machine (SVM) is used to achieve the classification, and a convolutional auto-encoder is used to achieve HSI data dimensionality reduction, which helps in easy perception, process, and visualization of the data. The SVM classification model was re-established for a lighter and quicker classification model on the basis of the reduced dimension. We employed volume-gradient-based band selection for the identification of relevant spectral bands in the HSI data. Spectral data recorded at different time intervals up to 72 h is analyzed to trace the spectral changes. The results show the efficacy of the HSI techniques for rapid, non-contact, and non-invasive analysis of beverage stains.

Distinguishing Planting Structures of Different Complexity from UAV Multispectral Images.

This study explores the classification potential of a multispectral classification model for farmland with planting structures of different complexity. Unmanned aerial vehicle (UAV) remote sensing technology is used to obtain multispectral images of three study areas with low-, medium-, and high-complexity planting structures, containing three, five, and eight types of crops, respectively. The feature subsets of three study areas are selected by recursive feature elimination (RFE). Object-oriented random forest (OB-RF) and object-oriented support vector machine (OB-SVM) classification models are established for the three study areas. After training the models with the feature subsets, the classification results are evaluated using a confusion matrix. The OB-RF and OB-SVM models’ classification accuracies are 97.09% and 99.13%, respectively, for the low-complexity planting structure. The equivalent values are 92.61% and 99.08% for the medium-complexity planting structure and 88.99% and 97.21% for the high-complexity planting structure. For farmland with fragmentary plots and a high-complexity planting structure, as the planting structure complexity changed from low to high, both models’ overall accuracy levels decreased. The overall accuracy of the OB-RF model decreased by 8.1%, and that of the OB-SVM model only decreased by 1.92%. OB-SVM achieves an overall classification accuracy of 97.21%, and a single-crop extraction accuracy of at least 85.65%. Therefore, UAV multispectral remote sensing can be used for classification applications in highly complex planting structures.

Systematic evaluation of sample preparation strategy for GC-MS-based plasma metabolomics and its application in osteoarthritis

Sample preparation plays a crucial part in plasma metabolomics. In order to obtain an optimal sample extraction method for gas chromatography mass spectrometry (GC-MS)-based plasma metabolomics, five different extraction strategies including protein precipitation, liquid-liquid extraction and solid-phase extraction were evaluated systematically for both plasma untargeted- and targeted-metabolomics. The comprehensive evaluation revealed that the all-in-one sample preparation method, MeOH-MTBE-H2O (1:5:1.5, v/v/v), was the optimal extraction method for both untargeted- and targeted-metabolomics. Next, the optimal sample preparation protocol was applied in plasma metabolomics of osteoarthritis (OA). A panel containing cholesterol, lactic acid, stearic acid, alpha-tocopherol and oxalic acid was selected as candidate biomarker to distinguish OA patients from healthy controls (HC) based on the support vector machine (SVM) classification model. The discriminating capability of the candidate biomarker panel was further validated successfully with logistic regression and principal components analysis (PCA) analysis. Therefore, the panel could potentially act as diagnostic biomarker for osteoarthritis.

Classification of Damaged Road Types Using Multiclass Support Vector Machine (SVM)

Damage roads had been disturbed by social activities and involved in traffic accidents. Identification and classification of the types of defected road are required to minimize its impact and before repairs. Digital image processing technology can identify and classify the type of damaged roads automatically. In this study, the classification of defected roads is automatic with a multiclass Support Vector Machine(SVM). There are three classes in the classification process, namely, alligators, potholes, and cracks. The process of recognizing defected roads uses a multiclass SVM classification model with polynomial and Gaussian kernel function and One Vs. All strategy and uses a cell size of 16 × 16 pixels during the Histogram of Oriented Gradients (HOG) feature extraction process. and produces an accuracy value of 78,85%.

Robust optimization of SVM hyper-parameters for spillway type selection

Spillways, which play a vital role in dams, can be built in various types. Although several studies have been conducted on hydraulic calculations of spillways, studies on type selection that require heuristics knowledge were limited. The tuning of the hyperparameters in machine learning algorithms is still an open problem. In this paper, a parallel global optimization algorithm is proposed optimizing the hyperparameters of a Support Vector Machine (SVM) classification model for providing accurate spillway type selection (STS). The random forest method is used to obtain the relative importance of input variables. Besides, a novel spillway dataset was introduced and a novel STS software tool has been developed based on different machine learning algorithms. Several experiments are carried out to demonstrate the effectiveness of the proposed tool and the reliability of data. The hyper-parameters optimized SVM was achieved the best results with 93.81% classification accuracy.

Multiregional-Based Magnetic Resonance Imaging Radiomics Combined With Clinical Data Improves Efficacy in Predicting Lymph Node Metastasis of Rectal Cancer

ObjectiveTo develop and validate a multiregional-based magnetic resonance imaging (MRI) radiomics model and combine it with clinical data for individual preoperative prediction of lymph node (LN) metastasis in rectal cancer patients.Methods186 rectal adenocarcinoma patients from our retrospective study cohort were randomly selected as the training (n = 123) and testing cohorts (n = 63). Spearman’s rank correlation coefficient and the least absolute shrinkage and selection operator were used for feature selection and dimensionality reduction. Five support vector machine (SVM) classification models were built using selected clinical and semantic variables, single-regional radiomics features, multiregional radiomics features, and combinations, for predicting LN metastasis in rectal cancer. The performance of the five SVM models was evaluated via the area under the receiver operator characteristic curve (AUC), accuracy, sensitivity, and specificity in the testing cohort. Differences in the AUCs among the five models were compared using DeLong’s test.ResultsThe clinical, single-regional radiomics and multiregional radiomics models showed moderate predictive performance and diagnostic accuracy in predicting LN metastasis with an AUC of 0.725, 0.702, and 0.736, respectively. A model with improved performance was created by combining clinical data with single-regional radiomics features (AUC = 0.827, (95% CI, 0.711–0.911), P = 0.016). Incorporating clinical data with multiregional radiomics features also improved the performance (AUC = 0.832 (95% CI, 0.717–0.915), P = 0.015).ConclusionMultiregional-based MRI radiomics combined with clinical data can improve efficacy in predicting LN metastasis and could be a useful tool to guide surgical decision-making in patients with rectal cancer.

A Novel Machine Learning Algorithm Predicts Dementia With Lewy Bodies Versus Parkinson's Disease Dementia Based on Clinical and Neuropsychological Scores.

Our aim was to develop a machine learning algorithm based only on non-invasively clinic collectable predictors, for the accurate diagnosis of these disorders. This is an ongoing prospective cohort study (ClinicalTrials.gov identifier NCT number NCT04448340) of 78 PDD and 62 DLB subjects whose diagnostic follow-up is available for at least 3 years after the baseline assessment. We used predictors such as clinico-demographic characteristics, 6 neuropsychological tests (mini mental, PD Cognitive Rating Scale, Brief Visuospatial Memory test, Symbol digit written, Wechsler adult intelligence scale, trail making A and B). We investigated logistic regression, K-Nearest Neighbors (K-NNs) Support Vector Machine (SVM), Naïve Bayes classifier, and Ensemble Model for their ability to predict successfully PDD or DLB diagnosis. The K-NN classification model had an accuracy 91.2% of overall cases based on 15 best clinical and cognitive scores achieving 96.42% sensitivity and 81% specificity on discriminating between DLB and PDD. The binomial logistic regression classification model achieved an accuracy of 87.5% based on 15 best features, showing 93.93% sensitivity and 87% specificity. The SVM classification model had an accuracy 84.6% of overall cases based on 15 best features achieving 90.62% sensitivity and 78.58% specificity. A model created on Naïve Bayes classification had 82.05% accuracy, 93.10% sensitivity and 74.41% specificity. Finally, an Ensemble model, synthesized by the individual ones, achieved 89.74% accuracy, 93.75% sensitivity and 85.73% specificity. Machine learning method predicted with high accuracy, sensitivity and specificity PDD or DLB diagnosis based on non-invasively and easily in-the-clinic and neuropsychological tests.

Support vector machine classification model for color fastness to ironing of vat dyes

Investigations of quantitative relationships between structure and color fastness of dyes are crucial in seeking novel dyes. For the first time, this work reported a classification model based on a quantitative structure–property relationship to predict color fastness to ironing of vat dyes. By performing binary classification analysis based on a support vector machine (SVM) and genetic algorithm, 56 vat dyes in the training set together with seven molecular descriptors were used to develop the classification model, which was validated with 59 vat dyes in the test set. The optimal SVM model ( C = 208.465 and γ = 5.9692) possesses overall accuracy of 91.1% for the training set and 83.1% for the test set, which is more accurate than those from the binary logistic regression model (87.5% and 81.4%, respectively). Furthermore, the mechanism of molecular descriptors correlated with color fastness to ironing of vat dyes is discussed.

Prediction of genetically-evaluated tumour responses to chemotherapy from breast MRI using machine learning with model selection

Genetic tests can provide prognostic information in breast cancer for both diagnosis and treatment planning. However, the cost of a genetic test is still high. In this study, we developed a radiogenomics method to predict genetically-evaluated responses to chemotherapy for breast cancer using our machine-learning technology coupled with model selection. Our proposed method consists of feature extraction, model selection, and prediction by the selected model. In the feature extraction, 318 morphological and texture features were extracted from a tumour region. In the model selection module, there are two major components: (1) selection of imaging biomarkers based on our original sequential forward floating selection (SFFS) feature selection and (2) building of a support vector machine (SVM) classifier including kernel function selection and hyperparameter optimization. The optimized feature set, i.e. imaging biomarkers, coupled with an SVM classifier were chosen by maximizing the area under curve (AUC) of corresponding receiver-operating-characteristic curve (ROC). After the model selection, the optimized SVM classifier operated on the selected imaging biomarkers for prediction. We applied our proposed method to 118 breast MRI studies from 118 patients for predicting genetically-evaluated responses to chemotherapy for breast cancer that evaluated by the genetic test of IRSN-23. We achieved an AUC value of 0.96 using the optimized SVM classifier model coupled with 24 selected imaging biomarkers in predicting the results of IRSN-23 in a five-fold cross-validation procedure.

An automated non-destructive prediction of peroxide value and free fatty acid level in mixed nut samples

This study aimed to develop an automated technique, which is rapid, non-destructive and inexpensive, to test for rancidity of nuts. A visible to near infrared benchtop hyperspectral camera was used to capture images from blanched canarium, unblanched canarium and macadamia samples. Support vector machine classification (SVC) and PLSR models were developed to segregate the pooled spectra of the nuts and predict their peroxide values (PV) and free fatty acid (FFA) concentrations. The SVC and PLSR models were then used in a hierarchical model to develop an automated system for predicting PV and FFA. The automated model was then tested using a test set providing classification accuracy of 87% and R2 between 0.60 and 0.76 and RPD between 1.6 and 2.7 for PV and FFA prediction. Overall, the automated system has the potential commercial application in nut processing to detect rancidity of mixed nut samples non-destructively and in real-time. It is suggested to train other machine learning models with more samples to improve the accuracy of predictions.

Three different SVM classification models in Tea Oil FTIR Application Research in Adulteration Detection

Fourier transform infrared spectroscopy (FTIR), as a new type of rapid environmental detection technology, has attracted extensive attention from researchers. In this study, FTIR combined with stoichiometry was used to establish and study the qualitative detection model of tea oil-doped soybean oil and corn oil. Different spectrum preprocessing and feature value extraction were performed on the infrared spectra of 105 samples of tea oil and adulterated oil in the spectral band of 600-4000cm-1. The KS sample selection method was used to divide the training set and the test set, and the training set was used to construct Support Vector Machine (SVM) Classification model, select the best model construction method based on the accuracy of the test set. The results show that the SVM tea oil adulteration detection model with convolution smoothing ( SG ) spectral preprocessing and random forest ( RF ) feature extraction achieves the best accuracy of 0.93, which is simple, fast, and pollution-free for the market to detect adulterated tea oil. Provide technical reference.

Segmentation and Measurements of Carotid Intima-Media Thickness in Ultrasound Images Using the Improved Convolutional Neural Network and Support Vector Machine

In recent years, diseases of cardiovascular and cerebrovascular have attracted much attention due to main causes in death in human beings. To reduce mortality, there are lots of efforts which are focused on early diagnosis and prevention. It is an important reference index for cardiovascular diseases through the endovascular membrane in carotid artery by medical ultrasound images. The paper proposes a method which finds the region of interest (ROI) by convolutional neural network, segments and measures intima-media membrane mainly using support vector machine (SVM). Essentially, the task of detecting the membrane is one target detection problem. This paper adopts the strategy, named Yon Only Look Once (YOLO), a new detection algorithm, and follows the convolution neural network algorithm based on end-to-end training. Firstly, sufficient samples are extracted according to certain characteristics in the special region. It can be trained by the SVM classification model. Then the ROI is processed and all the pixels are classified into boundary points and non-boundary points through the classification model. Thirdly, the boundary points are selected to obtain the accurate boundary and calculate the intima-media thickness (IMT). In experiments, two hundred ultrasound images are tested, and the results verify that our algorithm is consistent with the results by ground truth (GT). The detection speed of the algorithm in this paper is in real time, and it has high generalization characteristics. The algorithm computes the intima-media thickness in ultrasound images accurately and quickly with 95% consistence to ground truth.

Segmentation and Measurements of Carotid Intima-Media Thickness in Ultrasound Images Using the Improved Convolutional Neural Network and Support Vector Machine

In recent years, diseases of cardiovascular and cerebrovascular have attracted much attention due to main causes in death in human beings. To reduce mortality, there are lots of efforts which are focused on early diagnosis and prevention. It is an important reference index for cardiovascular diseases through the endovascular membrane in carotid artery by medical ultrasound images. The paper proposes a method which finds the region of interest (ROI) by convolutional neural network, segments and measures intima-media membrane mainly using support vector machine (SVM). Essentially, the task of detecting the membrane is one target detection problem. This paper adopts the strategy, named Yon Only Look Once (YOLO), a new detection algorithm, and follows the convolution neural network algorithm based on end-to-end training. Firstly, sufficient samples are extracted according to certain characteristics in the special region. It can be trained by the SVM classification model. Then the ROI is processed and all the pixels are classified into boundary points and non-boundary points through the classification model. Thirdly, the boundary points are selected to obtain the accurate boundary and calculate the intima-media thickness (IMT). In experiments, two hundred ultrasound images are tested, and the results verify that our algorithm is consistent with the results by ground truth (GT). The detection speed of the algorithm in this paper is in real time, and it has high generalization characteristics. The algorithm computes the intima-media thickness in ultrasound images accurately and quickly with 95% consistence to ground truth.

Performing sequential forward selection and variational autoencoder techniques in soil classification based on laser-induced breakdown spectroscopy.

The feasibility and accuracy of several combination classification models, i.e., quadratic discriminant analysis (QDA), random forest (RF), Bernoulli naïve Bayes (BNB), and support vector machine (SVM) classification models combined with either sequential feature selection (SFS) or dimensionality reduction methods, for classifying soil with laser-induced breakdown spectroscopy (LIBS) had been explored in this study. Each algorithm combination was compared to assess their classification performance. After eliminating the irrelevant features of the data using sequential feature selection (SFS), the performances were all improved for the studied four classification models, and the best accuracy reached 97.88% by SFS-SVM. The dimensions of the data were then reduced using variational autoencoder (VAE), truncated singular value decomposition (TSVD), and isometric mapping (Isomap), respectively. The classification accuracy improved for all combination models with dimensionality reduction, and impressive accuracies of 98.12% from TSVD-SVM and 98.24% from VAE-SVM were obtained. These results demonstrate an effective way to reduce uncorrelated features, high dimensionality, and redundant information in the LIBS dataset. In addition, coupling classification models with feature selection and dimensionality reduction techniques could significantly optimize the classification performance of LIBS.

Automatic Identification Algorithm of the Rice Tiller Period Based on PCA and SVM

The tillering period of rice is the crucial phenological period for the cultivation of high-quality and high-yield rice. Currently, human inspection is mainly used for identification, but it is time-consuming, laborious, and prone to mistakes. To efficiently and accurately identify the start date of rice tillering in the monitoring area, this paper proposed a new algorithm called rice tiller period recognition combining principal component analysis (PCA) and a support vector machine (SVM) (RTR-CPS). This algorithm characterizes the problem of identifying the rice tiller stage as a binary classification problem of rice either entering or not entering the tiller stage. To improve the image segmentation quality of traditional visual segmentation methods, the algorithm was designed to extract five image feature values to describe the rice tiller stage in a multi-featured way, reducing the impact of single feature value bias on the identification of the rice tiller stage. To improve the performance of the rice tiller stage recognition model, the algorithm selects ideal principal features in limited sample data by the PCA algorithm and optimizes SVM classification model hyper-parameters by combining 5-fold cross-validation. The experimental results showed that the accuracy of the algorithm for identifying the tillering date of potted rice was as high as 97.76%, which is significantly higher than other competitive methods, and the maximum error between the detection results and human inspection of potted rice tillering period was no more than 2 days. The rice tillering stage recognition model was applied to the field, and the images of field rice planted by two different methods were tested, which verified that the algorithm proposed in this paper is generalizable. These results fully demonstrate the feasibility and superiority of the algorithm in this paper.

Classification of rainfall data using support vector machine

Classification problems can be based on cross-section or time-series data. In general, some of the characteristics found in time series data are data that are very susceptible to containing noise and outliers. In this paper, time series data-based classification was carried out using the support vector machine (SVM) method. The SVM method is the most popular binary classification technique in machine learning. The advantage of this method is that it can find a global optimum solution and always achieve the same solution for every running. Another advantage is that it can solve the over-fitting problem by minimizing the upper limit of generalization errors. SVM classification model performance can be seen from classification accuracy and sensitivity and specificity tests. The results showed that based on the level of classification accuracy used the SVM method resulted in an accuracy rate of the prediction results with training data of 96,3% and the accuracy of the prediction results with testing data of 90,08%. Therefore, the classification of rainfall data using the SVM method has a very good performance.

Episodic Memory–Related Imaging Features as Valuable Biomarkers for the Diagnosis of Alzheimer’s Disease: A Multicenter Study Based on Machine Learning

BackgroundIndividualized and reliable biomarkers are crucial for diagnosing Alzheimer’s disease (AD). However, lack of accessibility and neurobiological correlation are the main obstacles to their clinical application. Machine learning algorithms can effectively identify personalized biomarkers based on the prominent symptoms of AD. MethodsEpisodic memory–related magnetic resonance imaging (MRI) features of 143 patients with amnesic mild cognitive impairment (MCI) were identified using a multivariate relevance vector regression algorithm. The support vector machine classification model was constructed using these MRI features and verified in 2 independent datasets (N = 994). The neurobiological basis was also investigated based on cognitive assessments, neuropathologic biomarkers of cerebrospinal fluid, and positron emission tomography images of amyloid-β plaques. ResultsThe combination of gray matter volume and amplitude of low-frequency fluctuation MRI features accurately predicted episodic memory impairment in individual patients with amnesic MCI (r = 0.638) when measured using an episodic memory assessment panel. The MRI features that contributed to episodic memory prediction were primarily distributed across the default mode network and limbic network. The classification model based on these features distinguished patients with AD from normal control subjects with more than 86% accuracy. Furthermore, most identified episodic memory–related regions showed significantly different amyloid-β positron emission tomography measurements among the AD, MCI, and normal control groups. Moreover, the classification outputs significantly correlated with cognitive assessment scores and cerebrospinal fluid pathological biomarkers' levels in the MCI and AD groups. ConclusionsNeuroimaging features can reflect individual episodic memory function and serve as potential diagnostic biomarkers of AD.

Data‐enhanced machine recognition model of DC serial arc in electric vehicle power system

Electric vehicle (EV) power system is the key to the development of EVs. If direct current (DC) arc occurs in the power system, it is difficult to extinguish at zero point. The arc fault will release a huge amount of energy and continuous sparking, which may cause spontaneous combustion or even explosion. In this study, an arc detection algorithm based on the classification of windowed Fourier transform and support vector machine (SVM) model is proposed for DC serial arc detection of EV power system. In order to optimise the arc detection algorithm, the authors use the pre-detection algorithm, which can effectively reduce the false detection rate of DC arc fault and ensure the reliability of detection algorithm. In addition, they propose an arc fault data enhancement model, which can generate arc fault current data. Finally, the experimental results show that the arc detection algorithm has a high accuracy and a false detection rate of 0%. After data enhancement, it has generalisation of the SVM classification model under the condition of high power experiment.