Support Vector Machine Training Research Articles

Predicting the productivity of fractured horizontal wells using few-shot learning

Predicting the productivity of multistage fractured horizontal wells plays an important role in exploiting unconventional resources. In recent years, machine learning (ML) models have emerged as a new approach for such studies. However, the scarcity of sufficient real data for model training often leads to imprecise predictions, even though the models trained with real data better characterize geological and engineering features. To tackle this issue, we propose an ML model that can obtain reliable results even with a small amount of data samples. Our model integrates the synthetic minority oversampling technique (SMOTE) to expand the data volume, the support vector machine (SVM) for model training, and the particle swarm optimization (PSO) algorithm for optimizing hyperparameters. To enhance the model performance, we conduct feature fusion and dimensionality reduction. Additionally, we examine the influences of different sample sizes and ML models for training. The proposed model demonstrates higher prediction accuracy and generalization ability, achieving a predicted R2 value of up to 0.9 for the test set, compared to the traditional ML techniques with an R2 of 0.13. This model accurately predicts the production of fractured horizontal wells even with limited samples, supplying an efficient tool for optimizing the production of unconventional resources. Importantly, the model holds the potential applicability to address similar challenges in other fields constrained by scarce data samples.

Quantum support vector machines: theory and applications

Abstract. Quantum Support Vector Machines (QSVMs) combine the fundamental principles of quantum computing and classical Support Vector Machines (SVMs) to improve machine learning performance. In this paper, the author will further explore QSVM. Firstly, introduce the basics of classical SVM, including hyperplane, margin, support vector, and kernel methods. Then, introduce the basic theories of quantum computing, including quantum bits, entanglement, quantum states, superposition, and some related quantum algorithms. Focuses on the concept of QSVM, quantum kernel methods, and how SVM runs on a quantum computer. Key topics include quantum state preparation, measurement, and output interpretation. Theoretical advantages of QSVMs, such as faster computation speed, stronger performance to process high-dimensional data, and kernal computation. In addition, the author discussed the implementation of QSVM, quantum algorithms, quantum gradient descent, and optimization techniques for SVM training. The article also discusses practical issues such as error mitigation and quantum hardware requirements. The purpose of this paper is to show the advantages of QSVM by comparing SVM and QSVM.

Enhanced Hessian locally linear embedding method for rolling bearing fault diagnosis based upon novel variational mode decomposition

Due to the plenty of redundant information contained in the fault feature sets of the original vibration signals of rolling bearings, the diagnostic accuracy is reduced and computational complexity is increased, making it very difficult to achieve accurate and fast fault recognition. So as to address the hard issue, this article develops an Enhanced Hessian Locally Linear Embedding (EHLLE) method for rolling bearing fault diagnosis based upon Novel Variational Mode Decomposition (NVMD). Firstly, NVMD method is utilized to denoise sample vibration signals and the sensitive modes containing main fault information are obtained. Secondly, some time-domain and frequency-domain statistical features are used to construct sample high-dimensional features, the dimensionality of which is reduced by EHLLE. Ultimately, K-Means algorithm is employed to cluster the low-dimensional features, which are utilized to train Support Vector Machine (SVM), and then the trained SVM is applied to the recognition of testing sample low-dimensional features. Two experiments of rolling bearing fault diagnosis demonstrate the effectiveness of NVMD-EHLLE method. Additionally, the superiority of the developed method is verified by comparing with other three typical methods.

Fall Detection Based on Data-Adaptive Gaussian Average Filtering Decomposition and Machine Learning

Falls are a significant health concern leading to increased morbidity and healthcare costs, especially for the elderly. Early and accurate detection of fall events is critical for timely intervention and preventing severe complications. This study presents a novel approach to triaxial accelerometer signals by employing data-adaptive Gaussian average filtering (DAGAF) decomposition in conjunction with machine learning techniques for fall detection. The triaxial accelerometer signals from the FallAllD dataset were decomposed into intrinsic mode functions (IMFs) and a residual component, from which feature vectors were extracted to train support vector machine (SVM) and k-nearest neighbor (kNN) classifiers. Experimental results demonstrate that the combination of the first and the third IMFs with the residual component yields the highest classification accuracy of 96.34%, with SVM outperforming kNN across all performance metrics. This approach significantly improves fall detection accuracy compared to using raw accelerometer signals, highlighting its potential in enhancing wearable fall detection systems. The proposed DAGAF decomposition method not only enhances feature extraction but also provides a promising advancement in the field, suggesting its potential to increase the reliability and accuracy of fall detection in practical applications.

An efficient instance selection algorithm for fast training of support vector machine for cross-project software defect prediction pairs

SVM is limited in its use for cross-project software defect prediction because of its very slow training process. So, this research article proposes a new instance selection (IS) algorithm called boundary detection among classes (BDAC) to reduce the training dataset size for faster training of SVM without degrading the prediction performance. The proposed algorithm is evaluated against six existing IS algorithms based on accuracy, running time, data reduction rate, etc. using 23 general datasets, 18 software defect prediction datasets, and two shape-based datasets, and results prove that BDAC is better than the selected algorithm based on collective comparison.

Medium-term wind power prediction based on LSTM classification aided Pelt-Neuralprophet HHO-SVM

The precision of wind power prediction plays a vital role in ensuring the stable operation of wind power systems. To elevate this accuracy and enhance the real-time performance, this paper proposes a hybrid Support Vector Machine (SVM) method, with using the Long Short-Term Memory Network (LSTM) to categorize the wind data based on the statistical features and feedback to the trained SVM model. The hybrid Harris Hawk Optimization (HHO) SVM method adopts the Neuralprophet algorithm to model the seasonality of wind power data and then uses the Pelt technique to the LSTM aided Pelt-Neuralprophet HHO-SVM (i.e., PN-HHO-SVM) scheme, which can utilize the seasonal fluctuations inherent in wind power data. The Neuralprophet algorithm is employed to formulate the seasonal regression model of wind power data. Then, the Pelt technique is used to process the modeled data to locate the change points, so as to classify the time series with similar statistical properties. Furthermore, to tune the SVM hyperparameters for each identified cluster, the HHO algorithm is adopted. Consequently, the LSTM aided PN-HHO-SVM is achieved. The real data sourced from the National Renewable Energy Laboratory (NREL) are used for validation case studies, demonstrating the superiorities of the prediction performance, especially in distinguishing and discriminating the seasonal dynamics of wind power data characters.

Augmented Attention: Enhancing Morph Detection in Face Recognition

Face Morphing is a technique that involves blending two or more faces to create new often realistic- looking images. These morphed images are generated or created using morphing techniques or photo manipulation tools pose a significant peril to face recognition systems. In this paper, we proposed a method to improve deep learning based face morphing detection systems to be more robust against face morphing attacks. Leveraging deep learning models and algorithms including MTCNN (Multitask Cascaded Convolutional Neural Network) for efficient face extraction from original and morphed faces with a high accuracy and FaceNet for extracting unified embeddings from the faces. The project aims to push the boundaries of face morphing detection capabilities by leveraging feature combination techniques using cosine distance and SSIM(structural similarity index measure) for identifying the similarity between faces and applying spatial attention mechanism which aims to enhance the feature representation learned by the model by focusing on the most informative parts of the image and training support vector machine classifier and voting classifier using the extracted embeddings significantly helps in building a robust face morphing detection system.

A verified training support vector machine in bearing fault diagnosis

Abstract The combination of support vector machine (SVM) and deep learning is widely used in bearing fault diagnosis. The SVM-based bearing fault diagnosis method usually uses features extracted from bearing vibration signals as input. However, environmental noise in industrial applications can affect the feature representation, potentially leading to failures in SVM-based fault diagnosis methods. Adversarial robustness verification methods can evaluate the robustness of models to small perturbations in feature representations. Certified defense methods achieve robustness enhancement by embedding adversarial robustness verification into the learning process of the model. Thus, we propose a certified defense method named verified training SVM (VT-SVM) based on Lagrange duality. The proposed method incorporates adversarial robustness verification into the SVM learning framework, thereby enhancing the robustness of SVM in noisy environments. First, the certified defense optimization problem of SVM is constructed by combining the original optimization problem of SVM with the adversarial robustness verification problem. Then, the certified defense optimization problem is converted into an equivalent convex quadratic programming problem by introducing slack variables. Next, the Lagrange duality is used to transform the convex quadratic programming problem into a dual problem. Finally, the solution to the original optimization problem can be obtained by solving the dual problem. We validate the effectiveness of VT-SVM on the artificial dataset, the rolling bearing dataset from Case Western Reserve University, and the VBL-VA001 dataset from Sepuluh Nopember Institute of Technology. Experimental results demonstrate that our method both ensures high predictive performance and improves the resistance of the model to small noise.

A Machine Learning Prediction Model for Myelitis and Multiple Sclerosis Based on Fourier Transform Features from MRI Images

Myelitis is a neurodegenerative disease positioned in the spinal cord, with multiple sclerosis (MS) being a common subtype. Radiological indicators enable the diagnosis of these diseases. This study proposes a classification framework to detect myelitis, MS, and healthy control (HC) groups using magnetic resonance imaging (MRI) images. The feature extraction step involves applying the fast Fourier transform (FFT) to MRI images. FFT is important because it converts spatial data into the frequency domain, making it easier to identify patterns and abnormalities that indicate these diseases. Then, statistical features (mean, minimum, maximum, standard deviation, skewness, kurtosis, and total energy) are extracted from this frequency information. These features are then used to train support vector machine (SVM), k-nearest neighbor (KNN), and decision tree algorithms. In multi-class classification (myelitis vs. MS vs. HC), the proposed method achieves a classification accuracy of 99.31% with SVM, with average precision, recall, and F1-score values of 99.27%, 99.21%, and 99.24%, respectively, indicating effective classification across all classes. In the binary class classification (HC vs. MS, MS vs. myelitis, HC vs. myelitis), the SVM achieves an outstanding classification accuracy of 99.36%, 99.71%, and 100% respectively. This study highlights the efficiency of FFT-based feature extraction in forming detection patterns for classifying HC, MS, and myelitis classes.

Hyperspectral Image Analysis Using Cloud-Based Support Vector Machines

Hyperspectral image processing techniques involve time-consuming calculations due to the large volume and complexity of the data. Indeed, hyperspectral scenes contain a wealth of spatial and spectral information thanks to the hundreds of narrow and continuous bands collected across the electromagnetic spectrum. Predictive models, particularly supervised machine learning classifiers, take advantage of this information to predict the pixel categories of images through a training set of real observations. Most notably, the Support Vector Machine (SVM) has demonstrate impressive accuracy results for image classification. Notwithstanding the performance offered by SVMs, dealing with such a large volume of data is computationally challenging. In this paper, a scalable and high-performance cloud-based approach for distributed training of SVM is proposed. The proposal address the overwhelming amount of remote sensing (RS) data information through a parallel training allocation. The implementation is performed over a memory-efficient Apache Spark distributed environment. Experiments are performed on a benchmark of real hyperspectral scenes to show the robustness of the proposal. Obtained results demonstrate efficient classification whilst optimising data processing in terms of training times.

A novel deep CNN model with entropy coded sine cosine for corn disease classification

Corn diseases significantly impact crop yields, posing a major challenge to agricultural productivity. Early and accurate detection of these diseases is crucial for effective management and mitigation. Existing methods, mostly relying on analyzing corn leaves, often lack the precision to identify and classify a wide range of diseases under varying conditions. This study introduces a novel approach to detecting corn diseases using image processing and deep learning techniques, aiming to enhance detection accuracy through pre-processing, improved feature extraction and selection, and classification algorithms. A new deep Convolutional Neural Network (CNN) model named TreeNet, with 35 layers and 38 connections, is proposed. TreeNet is pre-trained using the Plant Village imaging dataset. For image pre-processing, the YCbCr color space is utilized to improve color representation and contrast. Feature extraction is performed using TreeNet and two pre-trained models, Darknet-53, and DenseNet-201, with features fused using a serial-based fusion method. The Entropy-coded Sine Cosine Algorithm is applied for feature selection, optimizing the feature set for classification. The selected features are used to train Support Vector Machine (SVM) and K-Nearest Neighbor (KNN) classifiers, with extensive experiments conducted using both 5-fold and 10-fold cross-validation, and feature sizes ranging from 200 to 1150. The proposed method achieves classification accuracy, precision, recall, and F1-score of 99.8%, 99%, 100%, and 99%, respectively, surpassing existing benchmarks. The integration of TreeNet with Darknet-53 and DenseNet-201, along with robust pre-processing and feature selection, significantly improves corn disease detection, highlighting the potential of advanced CNN architectures in agriculture.

Research on the classification of complex noise-mixed microseismic events based on machine vision

Event classification is important for accurately monitoring and warning against rockburst hazards using microseismic technology. Here, we propose an automatic classification method for microseismic events based on machine vision. The method uses Histogram of Oriented Gradient (HOG) integrated with Support Vector Machine (SVM) as the core model (HOG-SVM, HSVM) to classify microseismic events. First, the method uses as input spectrograms generated from microseismic event signals recorded in the field. Next, the HOG method is used to accurately extract the spectral feature information of the useful signals of microseismic events under the interference of noisy signal. Finally, the extracted feature data is used to train SVM, after the training is completed, the SVM is used to classify the microseismic events. The performance of the method for categorizing microseismic events was tested using multiple independent test sets built from data monitored in the field of a mine in Shandong Province. The results show that the method can effectively extract the spectral feature information of useful signals of microseismic events contaminated with noise, with good classification accuracy and robustness to noise. It classifies microseismic events with high accuracy and efficiency compared to well-performing classification methods based on seismic source parameters and typical depth models. The method can provide technical support for the effective classification of microseismic events in complex construction sites, especially in noisy deep underground construction environments.

Tri-axial accelerometry allows to determine parental food provisioning behaviour in a marine bird

The study of parental food provisioning is essential for understanding the breeding ecology of birds. We conducted the first study using accelerometry to detect food provisioning in birds, using Support Vector Machine (SVM) models to identify when adults feed chicks of three different age classes. Accelerometers were attached to the head of adult female Imperial Shags (Leucocarbo atriceps), and various attributes derived from the acceleration signals were used to train SVM models for each chick age class. Model performance improved with chick age class, with SVM models achieving high overall accuracy (>88%) and highest sensitivity in older chick categories (>91%). However, precision values, especially for younger chicks, remained relatively low (between 26% and 45%). The application of a time filter based on the minimum duration of the observed food provisioning behaviours for each chick age category, improved model performance by reducing false provisioning behaviours, particularly in the model for older chicks, which showed the highest precision (72.4%). This study highlights the effectiveness of accelerometry and machine learning in studying parental food provisioning in birds, providing a rapid and accurate data collection method to complement traditional techniques. The described methodology can be applied to any bird species that exhibits distinctive movements while feeding its offspring and has suitable characteristics for attaching an accelerometer to the body part that best captures this movement. Finally, it is hoped that the results of this study will contribute to future research on key questions in parental investment theory and reproductive strategies in birds.

Nanofluidic Detection Platform for Simultaneous Light Absorption and Scattering Measurement of Individual Nanoparticles in Flow.

Characterization and quantification of plasmonic nanoparticles at the single particle level have become increasingly important with the advancements in nanotechnology and their application to various biological analyses including diagnostics, photothermal therapy, and immunoassays. While various nanoparticle detection methodologies have been developed and widely used, simultaneous measurement of light absorption and scattering from individual plasmonic nanoparticles in flow is still challenging. Herein, we describe a novel nanofluidic detection platform that enables simultaneous measurement of absorption and scattering signals from individual nanoparticles within a nanochannel. Our detection platform utilized optical diffraction phenomena by a single nanochannel as both a readout signal for photothermal detection and a reference light for interferometric scattering detection. Through the elucidation of the frequency effect on the detection performance and optimization of experimental conditions, we achieved the classification of gold and silver nanoparticles with a diameter of 20-60 nm at an average accuracy score of 82.6 ± 2.1% by measured data sets of absorption and scattering signals. Furthermore, we demonstrated the concentration determination of plasmonic nanoparticle mixtures using a trained Support vector machine (SVM) classifier. Our simple yet sensitive nanofluidic detection platform will be a valuable tool for the analysis of nanoparticles and their applications to chemical and biological assays.

A Study on Voice Measures in Patients with Parkinson’s Disease

This research aims to identify acoustic features which can distinguish patients with Parkinson's disease (PD patients) and healthy speakers. Thirty PD patients and 30 healthy speakers were recruited in the experiment, and their speech was collected, including three vowels (/i/, /a/, and /u/) and nine consonants (/p/, /pʰ/, /t/, /tʰ/, /k/, /kʰ/, /l/, /m/, and /n/). Acoustic features like fundamental frequency (F0), Jitter, Shimmer, harmonics-to-noise ratio (HNR), first formant (F1), second formant (F2), third formant (F3), first bandwidth (B1), second bandwidth (B2), third bandwidth (B3), voice onset, voice onset time were analyzed in our experiment. Two-sample independent t test and the nonparametric Mann-Whitney U (MWU) test were carried out alternatively to compare the acoustic measures between the PD patients and healthy speakers. In addition, after figuring out the effective acoustic features for distinguishing PD patients and healthy speakers, we adopted two methods to detect PD patients: (1) Built classifiers based on the effective acoustic featuresand (2) Trained support vector machine classifiers via the effective acoustic features. Significant differences were found between the male PD group and the male health control in vowel /i/ (Jitter and Shimmer) and /a/ (Shimmer and HNR). Among female subjects, significant differences were observed in F0 standard deviation (F0 SD) of /u/ between the two groups. Additionally, significant differences between PD group and health control were also found in the F3 of /i/ and /n/, whereas other acoustic features showed no significant differences between the two groups. The HNR of vowel /a/ performed the best classification accuracy compared with the other six acoustic features above found to distinguish PD patients and healthy speakers. PD can cause changes in the articulation and phonation of PD patients, wherein increases or decreases occur in some acoustic features. Therefore, the use of acoustic features to detect PD is expected to be a low-cost and large-scale diagnostic method.

Abstraction and decision fusion architecture for resource-aware image understanding with application on handwriting character classification

Resource-aware image understanding aims to achieve a soft equilibrium by effectively managing the constraints imposed by computational resources while improving the inferential capabilities of image processing systems. It serves a broad range of applications, spanning from embedded systems and IoT devices to budget-friendly smartphones and tablets. The proposed Abstraction and Decision Fusion Architecture (ADFA) addresses this problem through three tiers: abstraction, computation, and decision fusion. The first tier contains various views to generate different abstractions from the original data. These views are processed independently by an array of lightweight models forming the computation tier. They make independent decisions, where the final output is produced using a decision fusion tool in the last tier. To assess the capability of the proposed architecture, we have developed several ADFA-based models for the classification of handwriting data. In this regard, we first defined three data abstractions. Then, we trained support vector machines and fully connected neural networks according to the abstractions, which led to a set of independent basic models. Finally, an adaptive neuro-fuzzy inference system is employed as their hub to increase the accuracy by performing the decision fusion. Our experiments on the EMNIST dataset verify the efficiency and high accuracy of the proposed architecture in recognizing handwritten data, where the model size and the number of Multiply-Accumulate (MAC) operations are significantly smaller than state-of-the-art computational models.

Detection of Signal Integrity Issues in Vibration Monitoring Using One-Class Support Vector Machine

AbstractThis paper presents an analysis of the common signal integrity issues in vibration monitoring caused by sensor saturation and signal distortion, or sensor loosening and detachment, and the development of a method of detecting the occurrence of vibration signal integrity issues using a one-class support vector machine. For this, vibration signals with distortions due to sensor saturation and/or sensor detachment are analysed to determine parameters sensitive to common integrity issues. These features are then extracted from training data of good quality vibration signals. Principal Component Analysis is used to dimensionally reduce the parameters which are then used in the training of the one-class support vector machine. The proposed method was validated on trained and untrained health conditions. Additionally, model sensitivity was also tested on trained health conditions with varying defect sizes. The method successfully detected all signal integrity issues tested proving to be an effective pre-processing step in condition monitoring systems for increased reliability and accuracy.

SVM-assisted ANN model with principal component analysis based dimensionality reduction for enhancing state-of-charge estimation in LiFePO4 batteries

Accurate estimation of state-of-charge (SoC) is significant for monitoring the operation of LiFePO4 batteries. This paper addresses the challenges posed by the nonlinear characteristics of LiFePO4 batteries, which adversely affect the accuracy of SoC estimation. The proposed novel methodology for SoC estimation in LiFePO4 batteries involves a Support Vector Machine (SVM) assisted Artificial Neural Network (ANN) model incorporating principal component analysis (PCA) to efficiently interpret the input data. To improve the prediction accuracy, the non-linear characteristics of LiFePO4 are divided into three parts and each of these parts is used to train a separate ANN model. Further, an optimal number of hidden layers and neurons are selected for each ANN model to minimize the prediction errors. The usage of dedicated smaller datasets for each ANN model simplifies the structure. SVM classifies the battery operating regions and selects the most suitable ANN model for SoC estimation. PCA is applied to process the obtained experimental data resulting in three principal components serving as inputs for the SVM-assisted ANN model. Further, with PCA the input dimensions are reduced from four to three, thereby leading to computational simplicity. The input data comprises of current, voltage, open-circuit voltage and temperature of the battery. An experimental prototype, comprising a customized battery pack and sensing mechanisms, is developed for data collection for training SVM and ANN models. With the proposed SVM-assisted ANN involving PCA, the loss function is minimized and an average Root Mean Square Error (RMSE) of 0.3133 is achieved. This demonstrates the feasibility, accuracy and applicability of SoC estimation with the developed SVM-assisted ANN model for LiFePO4 batteries.

Prediction and optimisation of gasoline quality in petroleum refining: The use of machine learning model as a surrogate in optimisation framework

AbstractHardware‐based sensing frameworks such as cooperative fuel research engines are conventionally used to monitor research octane number (RON) in the petroleum refining industry. Machine learning techniques are employed to predict the RON of integrated naphtha reforming and isomerisation processes. A dynamic Aspen HYSYS model was used to generate data by introducing artificial uncertainties in the range of ±5% in process conditions, such as temperature, flow rates, etc. The generated data was used to train support vector machines (SVM), Gaussian process regression (GPR), artificial neural networks (ANN), regression trees (RT), and ensemble trees (ET). Hyperparameter tuning was performed to enhance the prediction capabilities of GPR, ANN, SVM, ET and RT models. Performance analysis of the models indicates that GPR, ANN, and SVM with R2 values of 0.99, 0.978, and 0.979 and RMSE values of 0.108, 0.262, and 0.258, respectively performed better than the remaining models and had the prediction capability to capture the RON dependence on predictor variables. ET and RT had an R2 value of 0.94 and 0.89, respectively. The GPR model was used as a surrogate model for fitness function evaluations in two optimisation frameworks based on genetic algorithm and particle swarm method. Optimal parameter values found by the optimisation methodology increased the RON value by 3.52%. The proposed methodology of surrogate‐based optimisation will provide a platform for plant‐level implementation to realise the concept of industry 4.0 in the refinery.

Enhanced Annotation of CD45RA to Distinguish T cell Subsets in Single Cell RNA-seq via Machine Learning

Abstract T cell heterogeneity presents a challenge for accurate cell identification, understanding their inherent plasticity, and characterizing their critical role in adaptive immunity. With the advent of single-cell RNA sequencing (scRNA-seq), researchers can now investigate the gene expression profiles of these surface proteins at the single-cell level, having a deeper understanding of cell identity. However, CD45RA, the isoform of CD45 which distinguish between naive/central memory T cells and effector memory/effector memory cells re-expressing CD45RA T cells, cannot be well profiled by scRNA-seq due to the difficulty in mapping short reads to genes. In order to facilitate cell type annotation in T cell scRNA-seq analysis, we employed machine learning and trained a CD45RA+/- classifier on single-cell mRNA count data annotated with known CD45RA antibody levels provided by cellular indexing of transcriptomes and epitopes sequencing (CITE-seq) data. Among all algorithms we tested, the trained support vector machine (SVM) with a radial basis function (RBF) kernel with optimized hyperparameters achieved a 99.96% accuracy on an unseen dataset. The multilayer Perceptron (MLP) classifier, the second most predictive method overall, also achieved a decent accuracy of 99.74%. Our simple yet robust machine learning approach provides a valid inference on the CD45RA level, assisting the cell identity annotation and further exploring the heterogeneity within human T cells.