Generalized Support Vector Machine Research Articles

Identification of male schizophrenia patients using brain morphology based on machine learning algorithms.

Schizophrenia is a severe psychiatric disease, and its prevalence is higher. However, diagnosis of early-stage schizophrenia is still considered a challenging task. To employ brain morphological features and machine learning method to differentiate male individuals with schizophrenia from healthy controls. The least absolute shrinkage and selection operator and t tests were applied to select important features from structural magnetic resonance images as input features for classification. Four commonly used machine learning algorithms, the general linear model, random forest (RF), k-nearest neighbors, and support vector machine algorithms, were used to develop the classification models. The performance of the classification models was evaluated according to the area under the receiver operating characteristic curve (AUC). A total of 8 important features with significant differences between groups were considered as input features for the establishment of classification models based on the four machine learning algorithms. Compared to other machine learning algorithms, RF yielded better performance in the discrimination of male schizophrenic individuals from healthy controls, with an AUC of 0.886. Our research suggests that brain morphological features can be used to improve the early diagnosis of schizophrenia in male patients.

Decoding cognitive health using machine learning: A comprehensive evaluation for diagnosis of significant memory concern

AbstractThe timely identification of significant memory concern (SMC) is crucial for proactive cognitive health management, especially in an aging population. Detecting SMC early enables timely intervention and personalized care, potentially slowing cognitive disorder progression. This study presents a state‐of‐the‐art review followed by a comprehensive evaluation of machine learning models within the randomized neural networks (RNNs) and hyperplane‐based classifiers (HbCs) family to investigate SMC diagnosis thoroughly. Utilizing the Alzheimer's Disease Neuroimaging Initiative 2 (ADNI2) dataset, 111 individuals with SMC and 111 healthy older adults are analyzed based on T1W magnetic resonance imaging (MRI) scans, extracting rich features. This analysis is based on baseline structural MRI (sMRI) scans, extracting rich features from gray matter (GM), white matter (WM), Jacobian determinant (JD), and cortical thickness (CT) measurements. In RNNs, deep random vector functional link (dRVFL) and ensemble dRVFL (edRVFL) emerge as the best classifiers in terms of performance metrics in the identification of SMC. In HbCs, Kernelized pinball general twin support vector machine (Pin‐GTSVM‐K) excels in CT and WM features, whereas Linear Pin‐GTSVM (Pin‐GTSVM‐L) and Linear intuitionistic fuzzy TSVM (IFTSVM‐L) performs well in the JD and GM features sets, respectively. This comprehensive evaluation emphasizes the critical role of feature selection, feature based‐interpretability and model choice in attaining an effective classifier for SMC diagnosis. The inclusion of statistical analyses further reinforces the credibility of the results, affirming the rigor of this analysis. The performance measures exhibit the suitability of this framework in aiding researchers with the automated and accurate assessment of SMC. The source codes of the algorithms and datasets used in this study are available at https://github.com/mtanveer1/SMC.This article is categorized under: Technologies > Classification Technologies > Machine Learning Application Areas > Health Care

Machine Learning Applied to Pre-Operative Computed-Tomography-Based Radiomic Features Can Accurately Differentiate Uterine Leiomyoma from Leiomyosarcoma: A Pilot Study.

The accurate discrimination of uterine leiomyosarcomas and leiomyomas in a pre-operative setting remains a current challenge. To date, the diagnosis is made by a pathologist on the excised tumor. The aim of this study was to develop a machine learning algorithm using radiomic data extracted from contrast-enhanced computed tomography (CECT) images that could accurately distinguish leiomyosarcomas from leiomyomas. Pre-operative CECT images from patients submitted to surgery with a histological diagnosis of leiomyoma or leiomyosarcoma were used for the region of interest identification and radiomic feature extraction. Feature extraction was conducted using the PyRadiomics library, and three feature selection methods combined with the general linear model (GLM), random forest (RF), and support vector machine (SVM) classifiers were built, trained, and tested for the binary classification task (malignant vs. benign). In parallel, radiologists assessed the diagnosis with or without clinical data. A total of 30 patients with leiomyosarcoma (mean age 59 years) and 35 patients with leiomyoma (mean age 48 years) were included in the study, comprising 30 and 51 lesions, respectively. Out of nine machine learning models, the three feature selection methods combined with the GLM and RF classifiers showed good performances, with predicted area under the curve (AUC), sensitivity, and specificity ranging from 0.78 to 0.97, from 0.78 to 1.00, and from 0.67 to 0.93, respectively, when compared to the results obtained from experienced radiologists when blinded to the clinical profile (AUC = 0.73 95%CI = 0.62-0.84), as well as when the clinical data were consulted (AUC = 0.75 95%CI = 0.65-0.85). CECT images integrated with radiomics have great potential in differentiating uterine leiomyomas from leiomyosarcomas. Such a tool can be used to mitigate the risks of eventual surgical spread in the case of leiomyosarcoma and allow for safer fertility-sparing treatment in patients with benign uterine lesions.

Panel Data Classification Models Based on Generalized Support Vector Machine

Panel Data Classification Models Based on Generalized Support Vector Machine

Generalized support vector machines (GSVMs) model for real-world time series forecasting

Support vector machines (SVMs) are one of the most popular and widely used approaches in modeling. Various kinds of SVM models have been developed in the literature of prediction and classification in order to cover different purposes. Fuzzy and crisp support vector machines are a well-known branch of modeling approaches frequently applied for certain and uncertain modeling, respectively. However, each model can only be efficiently used in its specified domain and cannot yield relevant and accurate results if the opposite situations have occurred. While the real-world systems and data sets often contain both certain and uncertain patterns that are complicatedly mixed and need to be simultaneously modeled. In this paper, a generalized support vector machine is proposed that can simultaneously benefit the unique advantages of certain and uncertain versions of the traditional support vector machines in their specialized categories. In the proposed model, the underlying data set is first categorized into two classes of certain and uncertain patterns. Then, certain patterns are modeled by a support vector machine, and uncertain patterns are modeled by a fuzzy support vector machine. After that, the function of the relationship, as well as the relative importance of each component, is estimated by another support vector machine. Finally, the forecasts of the proposed model are calculated. Empirical results of wind speed forecasting indicate that the proposed method not only can achieve more accurate results than support vector machines (SVMs) and fuzzy support vector machines but also can yield better forecasting performance than traditional fuzzy and nonfuzzy single models and traditional preprocessing-based hybrid models of SVMs.

A New Approach for Unqualified Salted Sea Cucumber Identification: Integration of Image Texture and Machine Learning under the Pressure Contact

At present, rapid, nondestructive, and objective identification of unqualified salted sea cucumbers with excessive salt content is extremely difficult. Artificial identification is the most common method, which is based on observing sea cucumber deformation during recovery after applying-removing pressure contact. This study is aimed at simulating the artificial identification method and establishing an identification model to distinguish whether the salted sea cucumber exceeds the standard by means of machine vision and machine learning technology. The system for identification of salted sea cucumbers was established, which was used for delivering the standard and uniform pressure forces and collecting the deformation images of salted sea cucumbers during the recovery after pressure removal. Image texture features of contour variation were extracted based on histograms (HIS) and gray level cooccurrence matrix (GLCM), which were used to establish the identification model by combining general regression neural networks (GRNN) and support vector machine (SVM), respectively. Contour variation features of salted sea cucumbers were extracted using a specific algorithm to improve the accuracy and stability of the model. Then, the dimensionality reduction and fusion of the feature images were achieved. According to the results of the models, the SVM identification model integrated with GLCM (GLCM-SVM) was found to be optimal, with accuracy, sensitivity, and specificity of 100%, 100%, and 100%, respectively. In particular, the sensitivity reached 100%, demonstrating an excellent identification ability to excessively salted sea cucumbers of the optimized model. This study illustrated the potential for identification of salted sea cucumbers based on pressure contact by combining image texture of contour varying with machine learning.

Classification of schizophrenia using general linear model and support vector machine via fNIRS.

Schizophrenia is a type of serious mental illness. In clinical practice, it is still a challenging problem to identify schizophrenia-related brain patterns due to the lack of objective physiological data support and a unified data analysis method, physicians can only use the subjective experience to distinguish schizophrenia patients and healthy people, which may easily lead to misdiagnosis. In this study, we designed an optimized data-preprocessing method accompanied with techniques of general linear model feature extraction, independent sample t-test feature selection and support vector machine to identify a set of robust fNIRS pattern features as a biomarker to discriminate schizophrenia patients and healthy people. Experimental results demonstrated that the proposed combination way of data preprocessing, feature extraction, feature selection and support vector machine classification can effectively identify schizophrenia patients and the healthy people with a leave-one-out-cross-validation classification accuracy of 89.5%.

Probabilistic Mapping and Spatial Pattern Analysis of Grazing Lawns in Southern African Savannahs Using WorldView-3 Imagery and Machine Learning Techniques

Savannah grazing lawns are a key food resource for large herbivores such as blue wildebeest (Connochaetes taurinus), hippopotamus (Hippopotamus amphibius) and white rhino (Ceratotherium simum), and impact herbivore densities, movement and recruitment rates. They also exert a strong influence on fire behaviour including frequency, intensity and spread. Thus, variation in grazing lawn cover can have a profound impact on broader savannah ecosystem dynamics. However, knowledge of their present cover and distribution is limited. Importantly, we lack a robust, broad-scale approach for detecting and monitoring grazing lawns, which is critical to enhancing understanding of the ecology of these vital grassland systems. We selected two sites in the Lower Sabie and Satara regions of Kruger National Park, South Africa with mesic and semiarid conditions, respectively. Using spectral and texture features derived from WorldView-3 imagery, we (i) parameterised and assessed the quality of Random Forest (RF), Support Vector Machines (SVM), Classification and Regression Trees (CART) and Multilayer Perceptron (MLP) models for general discrimination of plant functional types (PFTs) within a sub-area of the Lower Sabie landscape, and (ii) compared model performance for probabilistic mapping of grazing lawns in the broader Lower Sabie and Satara landscapes. Further, we used spatial metrics to analyse spatial patterns in grazing lawn distribution in both landscapes along a gradient of distance from waterbodies. All machine learning models achieved high F-scores (F1) and overall accuracy (OA) scores in general savannah PFTs classification, with RF (F1 = 95.73±0.004%, OA = 94.16±0.004%), SVM (F1 = 95.64±0.002%, OA = 94.02±0.002%) and MLP (F1 = 95.71±0.003%, OA = 94.27±0.003%) forming a cluster of the better performing models and marginally outperforming CART (F1 = 92.74±0.006%, OA = 90.93±0.003%). Grazing lawn detection accuracy followed a similar trend within the Lower Sabie landscape, with RF, SVM, MLP and CART achieving F-scores of 0.89, 0.93, 0.94 and 0.81, respectively. Transferring models to the Satara landscape however resulted in relatively lower but high grazing lawn detection accuracies across models (RF = 0.87, SVM = 0.88, MLP = 0.85 and CART = 0.75). Results from spatial pattern analysis revealed a relatively higher proportion of grazing lawn cover under semiarid savannah conditions (Satara) compared to the mesic savannah landscape (Lower Sabie). Additionally, the results show strong negative correlation between grazing lawn spatial structure (fractional cover, patch size and connectivity) and distance from waterbodies, with larger and contiguous grazing lawn patches occurring in close proximity to waterbodies in both landscapes. The proposed machine learning approach provides a novel and robust workflow for accurate and consistent landscape-scale monitoring of grazing lawns, while our findings and research outputs provide timely information critical for understanding habitat heterogeneity in southern African savannahs.

Multi-view generalized support vector machine via mining the inherent relationship between views with applications to face and fire smoke recognition

Multiview Generalized Eigenvalue Proximal Support Vector Machines (MvGSVMs) is an effective multi-view classification algorithm, which effectively combines multi-view learning and classification. Then it was found that in the classification learning task, the classifier combined with multi-view learning has a better classification effect than considering only a single view. In order to utilize the multi-view learning framework more fully and accurately, we further research this. We explore the internal relationship between different views between samples to replace the method of connecting different views through distance combinations. We propose a new method named Multi-view Generalized Support Vector Machine via Mining the Inherent Relationship between Views (MRMvGSVM). At the same time, we use the L2,1-norm constraint relationship matrix as a multi-view regularization term to select the most relevant sample data from different views. It not only helps to improve the accuracy of classification but also reduces the influence of extraneous factors to a certain extent and improves the robustness of the algorithm. The effectiveness of the algorithm is proved by theory and experiments on UCI, and Face and Fire Smoke image datasets.

Novel Machine Learning Approaches for Modelling the Gully Erosion Susceptibility

The extreme form of land degradation caused by the formation of gullies is a major challenge for the sustainability of land resources. This problem is more vulnerable in the arid and semi-arid environment and associated damage to agriculture and allied economic activities. Appropriate modeling of such erosion is therefore needed with optimum accuracy for estimating vulnerable regions and taking appropriate initiatives. The Golestan Dam has faced an acute problem of gully erosion over the last decade and has adversely affected society. Here, the artificial neural network (ANN), general linear model (GLM), maximum entropy (MaxEnt), and support vector machine (SVM) machine learning algorithm with 90/10, 80/20, 70/30, 60/40, and 50/50 random partitioning of training and validation samples was selected purposively for estimating the gully erosion susceptibility. The main objective of this work was to predict the susceptible zone with the maximum possible accuracy. For this purpose, random partitioning approaches were implemented. For this purpose, 20 gully erosion conditioning factors were considered for predicting the susceptible areas by considering the multi-collinearity test. The variance inflation factor (VIF) and tolerance (TOL) limit were considered for multi-collinearity assessment for reducing the error of the models and increase the efficiency of the outcome. The ANN with 50/50 random partitioning of the sample is the most optimal model in this analysis. The area under curve (AUC) values of receiver operating characteristics (ROC) in ANN (50/50) for the training and validation data are 0.918 and 0.868, respectively. The importance of the causative factors was estimated with the help of the Jackknife test, which reveals that the most important factor is the topography position index (TPI). Apart from this, the prioritization of all predicted models was estimated taking into account the training and validation data set, which should help future researchers to select models from this perspective. This type of outcome should help planners and local stakeholders to implement appropriate land and water conservation measures.

Dealing with overprediction in species distribution models: How adding distance constraints can improve model accuracy

Species distribution models can be affected by overprediction when dispersal movement is not incorporated into the modelling process. We compared the efficiency of seven methods that take into account spatial constraints to reduce overprediction when using four algorithms for species distribution models. By using a virtual ecologist approach, we were able to measure the accuracy of each model in predicting actual species distributions. We built 40 virtual species distributions within the Neotropical realm. Then, we randomly sampled 50 occurrences that were used in seven spatially restricted species distribution models (hereafter called M-SDMs) and a non-spatially restricted ecological niche model (ENM). We used four algorithms; Maximum Entropy, Generalized Linear Models, Random Forest, and Support Vector Machine. M-SDM methods were divided into a priori methods, in which spatial restrictions were inserted with environmental variables in the modelling process, and a posteriori methods, in which reachable and suitable areas were overlapped. M-SDM efficiency was obtained by calculating the difference in commission and omission errors between M-SDMs and ENMs. We used linear mixed-effects models to test if differences in commission and omission errors varied among the M-SDMs and algorithms. Our results indicate that overall M-SDMs reduce overprediction with no increase in underprediction compared to ENMs with few exceptions, such as a priori methods combined with the Support Vector Machine algorithm. There is a high variation in modelling performance among species, but there were only a few cases in which overprediction or underprediction increased. We only compared methods that do not require species dispersal data, guaranteeing that they can be applied to less-studied species. We advocate that species distribution modellers should not ignore spatial constraints, especially because they can be included in models at low costs but high benefits in terms of overprediction reduction.

An Efficient and Privacy-Preserving Outsourced Support Vector Machine Training for Internet of Medical Things

As the use of machine learning in the Internet-of-Medical Things (IoMT) settings increases, so do the data privacy concerns. Therefore, in this article, we propose an efficient privacy-preserving outsourced support vector machine scheme (EPoSVM), designed for IoMT deployment. To securely train the support vector machine (SVM), we design eight secure computation protocols to allow the cloud server to efficiently execute basic integer and floating-point computations. The proposed scheme protects training data privacy and guarantees the security of the trained SVM model. The security analysis proves that our proposed protocols and EPoSVM satisfy both security and privacy protection requirements. Findings from the performance evaluation using two real-world disease data sets also demonstrate the efficiency and effectiveness of EPoSVM in achieving the same classification accuracy as a general SVM.

Designing hybrid classifiers based on general type-2 fuzzy logic and support vector machines

Designing hybrid classifiers based on general type-2 fuzzy logic and support vector machines

Multi-Weighted Co-Occurrence Descriptor Encoding for Vein Recognition

Despite being highly secure, vein recognition suffers from the high inter-class similarity and intra-class variation resulting from the uncontrolled image capture, making the design of discriminative and robust representation very important. The recent success of convolutional neural network (CNN) for various image understanding tasks makes it a promising method for feature extraction. However, limited variability in small-scale datasets leads to systems derived from the direct training or fine-tuning not transferable and unreliable for practical biometric applications. This motivates the design of a multi-weighted co-occurrence descriptor encoding (MWCDE) model for vein recognition. Instead of directly conducting a feed-forward operation with a pre-trained CNN for obtaining the semantic features from the fully connected layers, co-occurrence features among convolutional filters are modeled first in MWCDE by a simple convolution between an indicator filter in a higher layer with a to-be-reweighted filter in a lower layer, and a redundancy-driven indicator filter selection algorithm is designed for filtering out some ambiguous representations. Second, another hard feature weighting strategy with a binary masking scheme is proposed for discarding noisy background and feature redundancy. The selected high-order descriptors are then embedded and aggregated into the compact feature vectors with a saliency driven spatial weighted Fisher vector algorithm, followed by the introduction of a generalized support vector machine for recognition. Extensive experiments with three benchmark vein datasets demonstrate that the proposed framework can achieve state-of-the-art results, and an additional experiment with the PolyU multispectral palmprint database illustrates its generalization ability. Code is available at (https://github.com/RobinCSIRO/MWCDE-for-Vein-Recognition).

General twin support vector machine with pinball loss function

The standard twin support vector machine (TSVM) uses the hinge loss function which leads to noise sensitivity and instability. In this paper, we propose a novel general twin support vector machine with pinball loss (Pin-GTSVM) for solving classification problems. We show that the proposed Pin-GTSVM is noise insensitive and more stable for re-sampling. Further, the computational complexity of the proposed Pin-GTSVM is similar to that of the TSVM. Thus, the pinball loss function does not increase the computation time of the proposed Pin-GTSVM. Numerical experiments with different noise are performed on 17 UCI and KEEL benchmark real-world datasets and the results are compared with other baseline methods. The comparisons clearly show that the proposed Pin-GTSVM has better generalization performance for noise corrupted datasets.

Biased support vector machine and weighted-smote in handling class imbalance problem

Class imbalance occurs when instances in a class are much higher than in other classes. This machine learning major problem can affect the predicted accuracy. Support Vector Machine (SVM) is robust and precise method in handling class imbalance problem but weak in the bias data distribution, Biased Support Vector Machine (BSVM) became popular choice to solve the problem. BSVM provide better control sensitivity yet lack accuracy compared to general SVM. This study proposes the integration of BSVM and SMOTEBoost to handle class imbalance problem. Non Support Vector (NSV) sets from negative samples and Support Vector (SV) sets from positive samples will undergo a Weighted-SMOTE process. The results indicate that implementation of Biased Support Vector Machine and Weighted-SMOTE achieve better accuracy and sensitivity.

RETRACTED ARTICLE: Hybrid Recommendation System for Heart Disease Diagnosis based on Multiple Kernel Learning with Adaptive Neuro-Fuzzy Inference System

Multiple Kernel Learning with Adaptive Neuro-Fuzzy Inference System (MKL with ANFIS) based deep learning method is proposed in this paper for heart disease diagnosis. The proposed MKL with ANFIS based deep learning method follows two-fold approach. MKL method is used to divide parameters between heart disease patients and normal individuals. The result obtained from the MKL method is given to the ANFIS classifier to classify the heart disease and healthy patients. Sensitivity, Specificity and Mean Square Error (MSE) are calculated to evaluate the proposed MKL with ANFIS method. The proposed MKL with ANFIS is also compared with various existing deep learning methods such as Least Square with Support Vector Machine (LS with SVM), General Discriminant Analysis and Least Square Support Vector Machine (GDA with LS-SVM), Principal Component Analysis with Adaptive Neuro-Fuzzy Inference System (PCA with ANFIS) and Latent Dirichlet Allocation with Adaptive Neuro-Fuzzy Inference System (LDA with ANFIS). The results from the proposed MKL with ANFIS method has produced high sensitivity (98%), high specificity (99%) and less Mean Square Error (0.01) for the for the KEGG Metabolic Reaction Network dataset.

Turbo-Satori: a neurofeedback and brain-computer interface toolbox for real-time functional near-infrared spectroscopy.

.Turbo-Satori is a neurofeedback and brain–computer interface (BCI) toolbox for real-time functional near-infrared spectroscopy (fNIRS). It incorporates multiple pipelines from real-time preprocessing and analysis to neurofeedback and BCI applications. The toolbox is designed with a focus in usability, enabling a fast setup and execution of real-time experiments. Turbo-Satori uses an incremental recursive least-squares procedure for real-time general linear model calculation and support vector machine classifiers for advanced BCI applications. It communicates directly with common NIRx fNIRS hardware and was tested extensively ensuring that the calculations can be performed in real time without a significant change in calculation times for all sampling intervals during ongoing experiments of up to 6 h of recording. Enabling immediate access to advanced processing features also allows the use of this toolbox for students and nonexperts in the field of fNIRS data acquisition and processing. Flexible network interfaces allow third party stimulus applications to access the processed data and calculated statistics in real time so that this information can be easily incorporated in neurofeedback or BCI presentations.

New methods for prediction of elastic constants based on density functional theory combined with machine learning

Elastic constants play critical roles in researching mechanical properties, but they are usually difficult to be measured. While density functional theory (DFT) calculations provide a reliable method to meet this challenge, the results contain inherent errors caused by various approximations. The data-driven approach of machine learning also laid a foundation for predicting material properties. In order to increase the accuracy of theoretical calculations results, in this paper we investigate using machine learning methods to both correct the elastic constants by DFT calculation, and to directly predict elastic constants. The single-hidden layer feedforward neural network trained by back propagation algorithm (SLFN), general regression neural network (GRNN) and support vector machine for regression (SVR) techniques are employed to build regression models to correct the elastic constants by DFT calculation for metal or metallic binary alloys. We also build regression models to predict the elastic constants of metallic binary alloys with cubic crystal system rather than using DFT calculations. It has been demonstrated that the elastic constants corrected by regression models has higher accuracy than those calculated by DFT, and the elastic constants of binary alloys directly predicted by model using the outperformed SLFN technique is prospective.

An Adaptive Data-driven Model for Erratic Demand Forecasting

Abstract Erratic demand patterns are common in spare parts supply networks. Owing to the characteristics of nonlinear dynamics, aperiodic variations and deep uncertainties, erratic demand forecasting remains to be a challenge. This paper is devoted to forecast this type of demand in a more difficult situation where regular explanatory variables are not available and historical data are limited. To address this problem, we propose an Adaptive Autoregressive Support Vector Machine model in which: 1) autocorrelated attributes are generated from historical demand time-series data automatically; 2) the attribute dimension and the suitable nonlinear kernel mapping function are identified in a data-driven manner; and 3) key model parameters are adaptively controlled by a parallel heuristic algorithm to cope with data uncertainties and guarantee the model generalization ability. We test this model by erratic demands of heavy truck spare parts. Computational results demonstrate that the proposed model outperforms seven sound time-series forecasting models and general Support Vector Machine models.