Hybrid Kernel Support Vector Machine Research Articles

Bayesian-Optimized Hybrid Kernel SVM for Rolling Bearing Fault Diagnosis.

We propose a new fault diagnosis model for rolling bearings based on a hybrid kernel support vector machine (SVM) and Bayesian optimization (BO). The model uses discrete Fourier transform (DFT) to extract fifteen features from vibration signals in the time and frequency domains of four bearing failure forms, which addresses the issue of ambiguous fault identification caused by their nonlinearity and nonstationarity. The extracted feature vectors are then divided into training and test sets as SVM inputs for fault diagnosis. To optimize the SVM, we construct a hybrid kernel SVM using a polynomial kernel function and radial basis kernel function. BO is used to optimize the extreme values of the objective function and determine their weight coefficients. We create an objective function for the Gaussian regression process of BO using training and test data as inputs, respectively. The optimized parameters are used to rebuild the SVM, which is then trained for network classification prediction. We tested the proposed diagnostic model using the bearing dataset of the Case Western Reserve University. The verification results show that the fault diagnosis accuracy is improved from 85% to 100% compared with the direct input of vibration signal into the SVM, and the effect is significant. Compared with other diagnostic models, our Bayesian-optimized hybrid kernel SVM model has the highest accuracy. In laboratory verification, we took sixty sets of sample values for each of the four failure forms measured in the experiment, and the verification process was repeated. The experimental results showed that the accuracy of the Bayesian-optimized hybrid kernel SVM reached 100%, and the accuracy of five replicates reached 96.7%. These results demonstrate the feasibility and superiority of our proposed method for fault diagnosis in rolling bearings.

Climate-informed monthly runoff prediction model using machine learning and feature importance analysis

Accurate runoff prediction can provide a reliable decision-making basis for flood and drought disaster prevention and scientific allocation of water resources. Selecting appropriate predictors is an effective way to improve the accuracy of runoff prediction. However, the runoff process is influenced by numerous local and global hydrometeorological factors, and there is still no universal approach about the selection of suitable predictors from these factors. To address this problem, we proposed a runoff prediction model by combining machine learning (ML) and feature importance analysis (FIA-ML). Specifically, take the monthly runoff prediction of Yingluoxia, China as an example, the FIA-ML model uses mutual information (MI) and feature importance ranking method based on random forest (RF) to screen suitable predictors, from 130 global climate factors and several local hydrometeorological information, as the input of ML models, namely the hybrid kernel support vector machine (HKSVM), extreme learning machine (ELM), generalized regression neural network (GRNN), and multiple linear regression (MLR). An improved particle swarm optimization (IPSO) is used to estimate model parameters of ML. The results indicated that the performance of the FIA-ML is better than widely-used long short-term memory neural network (LSTM) and seasonal autoregressive integrated moving average (SARIMA). Particularly, the Nash-Sutcliffe Efficiency coefficients of the FIA-ML models with HKSVM and ELM were both greater than 0.9. More importantly, the FIA-ML models can explicitly explain which physical factors have significant impacts on runoff, thus strengthening the physical meaning of the runoff prediction model.

Temperature drift compensation of a FOG based on an HKSVM optimized by an improved hybrid BAS-GSA algorithm.

In this paper, the optimal hybrid kernel support vector machine is employed to propose a compensation strategy intended for the temperature drift of a fiber optical gyroscope (FOG). First, the mode of the hybrid kernel with an interpolation and extrapolation capability is constructed, which consists of the radial basis function and the polynomial kernel function. Second, the combination model of the beetle antennae search algorithm and gravitational search algorithm that has both local and global search capability is proposed to optimize the structure-related parameters of a hybrid kernel support vector machine (HKSVM). Finally, the proposed approach is trained and tested using the experimental data of temperature drift at two different rates of temperature change (10°C/min and 5°C/min). In addition, the proposed method is validated against those conventional compensation algorithms. According to the research results, the compensation error (mean squared error) of the proposed approach is reduced by 92% compared to the traditional support vector machine based on the radial basis function.

Eye Movement Feature Set and Predictive Model for Dyslexia

Dyslexia is a learning disorder that can cause difficulties in reading or writing. Dyslexia is not a visual problem but many dyslexics have impaired magnocellular system which causes poor eye control. Eye-trackers are used to track eye movements. This research work proposes a set of significant eye movement features that are used to build a predictive model for dyslexia. Fixation and saccade eye events are detected using the dispersion-threshold and velocity-threshold algorithms. Various machine learning models are experimented. Validation is done on 185 subjects using 10-fold cross-validation. Velocity based features gave high accuracy compared to statistical and dispersion features. Highest accuracy of 96% was achieved using the Hybrid Kernel Support Vector Machine- Particle Swarm Optimization model followed by the Xtreme Gradient Boosting model with an accuracy of 95%. The best set of features are the first fixation start time, average fixation saccade duration, the total number of fixations, total number of saccades and ratio between saccades and fixations.

Eye Movement Feature Set and Predictive Model for Dyslexia

Dyslexia is a learning disorder that can cause difficulties in reading or writing. Dyslexia is not a visual problem but many dyslexics have impaired magnocellular system which causes poor eye control. Eye-trackers are used to track eye movements. This research work proposes a set of significant eye movement features that are used to build a predictive model for dyslexia. Fixation and saccade eye events are detected using the dispersion-threshold and velocity-threshold algorithms. Various machine learning models are experimented. Validation is done on 185 subjects using 10-fold cross-validation. Velocity based features gave high accuracy compared to statistical and dispersion features. Highest accuracy of 96% was achieved using the Hybrid Kernel Support Vector Machine- Particle Swarm Optimization model followed by the Xtreme Gradient Boosting model with an accuracy of 95%. The best set of features are the first fixation start time, average fixation saccade duration, the total number of fixations, total number of saccades and ratio between saccades and fixations.

Hybrid Kernel Support Vector Machine Classifier and Grey Wolf Optimization Algorithm Based Intelligent Classification Algorithm for Chronic Kidney Disease

In the present day, distributed algorithms become more popular due to their diversity in several applications. The prediction and reorganization of medical data required more practice and information. We propose a novel approach feature selection based on efficient chronic kidney disease (CKD) prediction and classification. Primarily, the pre-processing pace will be implemented over the input data. Then, the grey wolf optimization (GWO) algorithm gets executed to choose the optimal features from the pre-processed data. Next, the projected technique exploits the Hybrid Kernel Support Vector Machine (HKSVM) as a classification model to identify the presence of CKD or not. The simulation takes place in MATLAB. The validation of the presented model takes place using a benchmark CKD dataset as of machine learning repository such as UCI under the presence of several measures. New outcome specified that the planned categorization arrangement has surpassed by containing enhanced 97.26% accuracy for kidney chronic dataset when contrasted with existing SVM technique only accomplished 94.77% and fuzzy min–max GSO neural network (FMMGNN) classifier accomplished 93.78%.

Study on Evaluation Model of Chinese P2P Online Lending Platform Based on Hybrid Kernel Support Vector Machine

Accurate evaluation of the risk level and operation performances of P2P online lending platforms is not only conducive to better functioning of information intermediaries but also effective protection of investors’ interests. This paper proposes a genetic algorithm (GA) improved hybrid kernel support vector machine (SVM) with an index system to construct such an evaluation model. A hybrid kernel consisting of polynomial function and radial basis function is improved, specifically kernel parameters and the weight of two kernels, by GA method with excellent global optimization and rapid convergence. Empirical testing based on cross-sectional data from Chinese P2P lending market demonstrates the superiority of the improved hybrid kernel SVM model. The classification accuracy of credit risk level and operation quality is higher than the single kernel SVM model as well as the hybrid kernel model with empirical parameter values.

Electric Field Signal Recognition Method of DS Switching Operations Based on Wavelet Packet Analysis and PSO-HSVM

In order to monitor the state of Gas Insulated Substation (GIS), this paper established a fault simulation experimental platform for Disconnecting Switch (DS), and collected data through a 3D radiation electric field (E-field) measurement system. For extract the feature parameters, four-layer wavelet packet decomposition was performed on the data to obtain normalized energy, and the dimension of the eigenvector was reduced by principal component analysis (PCA) algorithm. Then, the model was trained with the hybrid kernel support vector machine (HSVM) algorithm, and the parameters was optimized with the particle swarm optimization(PSO) algorithm. The result shows that compared with the traditional SVM model, the method proposed in this paper improves the diagnosis accuracy of DS defect signals.

A Hybrid Fish – Bee Optimization Algorithm for Heart Disease Prediction using Multiple Kernel SVM Classifier

The patient’s heart disease status is obtained by using a heart disease detection model. That is used for the medical experts. In order to predict the heart disease, the existing technique use optimal classifier. Even though the existing technique achieved the better result, it has some disadvantages. In order to improve those drawbacks, the suggested technique utilizes the effective method for heart disease prediction. At first the input information is preprocessed and then the preprocessed result is forwarded to the feature selection process. For the feature selection process a proficient feature selection is used over the high dimensional medical data. Hybrid Fish Bee optimization algorithm (HFSBEE) is utilized. Thus, the proposed algorithm parallelizes the two algorithms such that the local behavior of artificial bee colony algorithm and global search of fish swarm optimization are effectively used to find the optimal solution. Classification process is performed by the transformation of medical dataset to the Multi kernel support vector machine (MKSVM). The process of our proposed technique is calculated based on the accuracy, sensitivity, specificity, precision, recall and F-measure. Here, for test analysis, the some datasets used i.e. Cleveland, Hungarian and Switzerland etc., that are given based on the UCI machine learning repository. The experimental outcome show that our presented technique is went better than the accuracy of 97.68%. This is for the Cleveland dataset when related with existing hybrid kernel support vector machine (HKSVM) method achieved 96.03% and optimal rough fuzzy classifier obtained 62.25%. The implementation of the proposed method is done by MATLAB platform.

A new expert system based on hybrid colour and structure descriptor and machine learning algorithms for early glaucoma diagnosis

Medical image classification system is widely used by the radiologists to segment the medical images into meaningful regions. Glaucoma is an optic neuropathy defined by characteristic damage to the optic nerve and accompanying visual field deficits. Early diagnosis and treatment are critical to prevent irreversible vision loss and ultimate blindness. Automatic detection of diabetic retinopathy in retinal image is vital as it delivers data about unusual tissues which is essential for planning treatment. Automating, this method is challenging due to the high variabiity in the appearance of tissue among dissimilar patients and in many circumstances, the comparison between abnormal and normal tissue. This paper presents a new methodology and a computerized diagnostic system for diabetic retinopathy. In this article, adaptive histogram equalization is used to convert colour images to gray scale images followed by significant features are selected using hybrid colour and structure descriptor (HCSD). Finally, various classifiers are used for classification of images into normal and glaucomatous classes. The overall classification accuracy of HCSD with Hybrid Radial Basis Kernel based Support vector Machine (HRKSVM) is 97.55%, HCSD with Support vector Machine (SVM) is 94.77% and HCSD with Hybrid Kernel Support Vector Machine (HKSVM) is 95.71%.

Visual and textual features based email spam classification using S-Cuckoo search and hybrid kernel support vector machine

Spam mail classification has been playing a vital role in recent days due to the uncontrollable growth happening in the electronic media. Literature presents several algorithms for email spam classification based on classification methods. In this paper, we propose a spam classification framework using S-Cuckoo and hybrid kernel based support vector machine (HKSVM). At first, the features are extracted from the e-mails based on the text as well as the image. For the textual features, TF-term frequency is used. For the image dependent features, correrlogram and wavelet moment are taken. The hybrid features have then high dimension so the optimum features are identified with the help of hybrid algorithm, called S-Cuckoo search. Then, the classification is done using proposed classifier HKSVM model which is designed based on the hybrid kernel by blending three different kernel functions and then it is used in the SVM classifier. The additional features provided based on image and the modification of SVM classifier provides significant improvement as compared with existing algorithms. The spam classification performance is measured by db1 (combining bare-ling spam and Spam Archive corpus) and db2 (combining lemm-ling spam and Spam Archive corpus). Experimental results show that the proposed spam classification framework has outperformed by having better accuracy of 97.235% when compared with existing approach which is able to achieve only 94.117%.

Multi Class Cervical Cancer Classification by using ERSTCM, EMSD & CFE methods based Texture Features and Fuzzy Logic based Hybrid Kernel Support Vector Machine Classifier

Multi Class Cervical Cancer Classification by using ERSTCM, EMSD & CFE methods based Texture Features and Fuzzy Logic based Hybrid Kernel Support Vector Machine Classifier

A scheduling procedure for a flow shop–like knowledgeable manufacturing cell with self-evolutionary features

As a component of knowledgeable manufacturing systems, the structure of flow shop–like knowledgeable manufacturing cells is similar to that of a flow shop, thus representing an NP-hard issue. Here, we propose a self-evolutionary algorithm that exhibits learning ability and is composed of learning and scheduling modules. Unlike traditional scheduling algorithms, whose performances remain unchanged when the procedure is coded, the performance of the algorithm proposed in this study gradually improves as the learning process continues. The self-evolutionary ability is realized through the training of a hybrid kernel support vector machine. The hybrid kernel support vector machine was designed to approximate the value of the Q-function to select the appropriate action for the scheduling module and thus to obtain the optimal solution. An iterative process of value based on the Q-learning was adopted to train the hybrid kernel support vector machine to gradually enhance the algorithm’s efficiency and accuracy. The extracted state features of the flow shop–like knowledgeable manufacturing cells serve as inputs to hybrid kernel support vector machine for easy generalization of the learning results. The action exerted on a feasible solution is also defined as the input of the hybrid kernel support vector machine. The computational results show that the performance of the proposed procedure improves as the learning process progresses. Data from the computation and comparisons with other algorithms verify the validity and efficiency of the proposed algorithm.

Individual Identification Method for Group-Housed Pigs Based on Optimal Feature Extraction

In order to reduce the workload of farmers on individual identification of pigs, reduce interference to pigs, and raise automation and intelligent level of farms, a Matlab-based automatic classification system is set up. Firstly, top view video sequences are captured for group-housed pigs from pig barn, and the adaptive Gaussian mixture model based on prediction mechanism is used to detect the foreground objects. Then with morphological processing and hole filling, the targets are extracted as completely as possible from the background. Secondly, after building the sample image databases for each pig, color, texture and shape features are extracted and combined as the feature vector. Next, LLE (Locally Linear Embedding) algorithm is adopted to reduce the data dimension. Finally, hybrid kernel SVM (Support Vector Machine) classifier is designed to identify the pigs in test frames. Experimental results show that the recognition rate of pigs is 95.2%. For improving the recognition rate, decreasing cost and interference to pigs, the above method is proposed. Moreover, it can lay a foundation for future researches on group-housed pigs in behaviors, emotions, breathings and so on, which has good practical significance.