Combination Of Support Vector Machine Research Articles

Parametric analysis and soft-computing prediction of sweet potatoes (Ipomoea batatas L) starch drying using machine learning techniques

This study is based on parametric selection and prediction of sweet potatoes starch drying using Regression Tree (RT), Support Vector Machine (SVM) and Neuro-Fuzzy (NF) soft-computing techniques. The drying experiments are conducted at Drying Temperature (DT): 40–60 °C, Drying Time (DTi): 0–780 min, Ambient Temperature (AT): 27.2–30 °C and Relative Humidity (RH): 70–80%. Exhaustive search model is used to determine the most and least relevant drying parameters. NF, RT and SVM programming codes are developed in Matlab 9.2 (2017a) with four, three and two-input variable combination NFs (4-1NF, 3-1NF and 2-1NF), RTs (4-1 RT, 3-1 RT and 2-1 RT) and SVMs (4-1SVM, 3-1SVM and 2-1SVM) for the prediction of the starch drying. Exhaustive NF parametric analysis results show that DT-DTi-AT and DT-DTi are the most influential combined variables for three and two variables combinations respectively. DTi and RH are also the most and least influential parameters, respectively. The 3-1NF with neighbourhood radius 0.7 gave the uppermost correlation coefficient (R2) 0.999; and the lowermost root mean square error as well as mean square error 0.0025 and 0.00000625 respectively. The results obtained show that exhaustive search and 3-1NF models are suitable for the prediction of sweet potatoes starch drying.

RETRACTED ARTICLE: An improved approach for automatic spine canal segmentation using probabilistic boosting tree (PBT) with fuzzy support vector machine

Spine canal segmentation is an emerging zone in research proposed to help interpretation and processing of advanced MRI and CT images. For instance, high resolution three-dimensional volumes can be divided to provide an estimation of spine canal atrophy. Spine canal segmentation is complex because of assortment of MRI contrasts and variation in human life structures. This investigation illustrates the details of spine canal segmentation techniques and gives a few measurements that can be utilized to contrast with other segmentation strategies. The details of background and foreground subtraction techniques, spine canal segmentation approach and optimization approach which are utilized in the different applications have been considered. In this paper, spine canal segmentation on probabilistic booting tree (PBT) with fuzzy support vector machine performance measures and metrics are analysed in state-of-the art technologies. Proposed approach is performed on the base of the automatic spine canal segmentation with the group of data MR. This proposed segmentation continue with fuzzy support vector machine (FSVM) technique to make fully automatic stream pipeline. The declaration in an automatic segmentation of stream pipeline was implemented with flexible voxel wise classification accompanying dimensions analogous with 3D Haar and labelled machine learning algorithms i.e. probabilistic boosting tree combined fuzzy support vector machine (PBT-FSVM). The novel segmentation technique correlated with MR data sets provides better accuracy than the exiting techniques and it is shown in experimental outcomes. To still improve performance of the results, online learning classification method can be in the proposed work.

A Hybrid Deep Learning System for Real-World Mobile User Authentication Using Motion Sensors.

With the popularity of smartphones and the development of hardware, mobile devices are widely used by people. To ensure availability and security, how to protect private data in mobile devices without disturbing users has become a key issue. Mobile user authentication methods based on motion sensors have been proposed by many works, but the existing methods have a series of problems such as poor de-noising ability, insufficient availability, and low coverage of feature extraction. Based on the shortcomings of existing methods, this paper proposes a hybrid deep learning system for complex real-world mobile authentication. The system includes: (1) a variational mode decomposition (VMD) based de-noising method to enhance the singular value of sensors, such as discontinuities and mutations, and increase the extraction range of the feature; (2) semi-supervised collaborative training (Tri-Training) methods to effectively deal with mislabeling problems in complex real-world situations; and (3) a combined convolutional neural network (CNN) and support vector machine (SVM) model for effective hybrid feature extraction and training. The training results under large-scale, real-world data show that the proposed system can achieve 95.01% authentication accuracy, and the effect is better than the existing frontier methods.

Mining Subsidence Prediction by Combining Support Vector Machine Regression and Interferometric Synthetic Aperture Radar Data

Mining subsidence is time-dependent and highly nonlinear, especially in the Loess Plateau region in Northwestern China. As a consequence, and mainly in building agglomerations, the structures can be damaged severely during or after underground extraction, with risks to human life. In this paper, we propose an approach based on a combination of a differential interferometric synthetic aperture radar (DInSAR) technique and a support vector machine (SVM) regression algorithm optimized by grid search (GS-SVR) to predict mining subsidence in a timely and cost-efficient manner. We consider five Advanced Land Observing Satellite (ALOS)/Phased Array type L-band Synthetic Aperture Radar (PALSAR) images encompassing the Dafosi coal mine area in Binxian and Changwu counties, Shaanxi Province. The results show that the subsidence predicted by the proposed InSAR and GS-SVR approach is consistent with the Global Positioning System (GPS) measurements. The maximum absolute errors are less than 3.1 cm and the maximum relative errors are less than 14%. The proposed approach combining DInSAR with GS-SVR technology can predict mining subsidence on the Loess Plateau of China with a high level of accuracy. This research may also help to provide disaster warnings.

Combining SVM and ECOC for Identification of Protein Complexes from Protein Protein Interaction Networks by Integrating Amino Acids' Physical Properties and Complex Topology.

Protein Complexes plays important role in key functional processes in cells by forming Protein Protein Interaction (PPI) networks. Conventionally, they were determined through experimental approaches. For the sake of saving time and cost reduction, many computational methods have been proposed. Fewer computational approaches take into account significant biological information contained within protein amino acid sequence and identified dense sub graphs as complexes from PPI network by considering density and degree statistics. Biological information evaluate the common features for performing a particular biological function among two proteins. Moreover, linear, star and hybrid sub graph structures may be found in PPI network so other topological features of graph are also important. In this article, support vector machine (SVM) in combination with Error-correcting output coding (ECOC) algorithm is utilized to construct an automatic detector for mining multiple protein complexes from PPI network, where amino acid physical properties i.e. kidera factors and a variety of topological constrains are employed as feature vectors. The overall success rates of protein complex identification achieved are 88.6% and 76.0% on MIPS benchmark set by considering DIP and Gavin interactions respectively. Support vector machine was an effective and solid approach for complex detection with amino acid's physical properties and complex topology as dimensional vectors. Error-correcting output coding (ECOC) algorithm is a powerful algorithm for mining multiple protein complexes of small as well as large sizes. The accuracy of complex identification task based on amino acid's physical and complex topological characteristics are strikingly increase when ECOC is integrated with SVM approach. Moreover, this paper implies that ECOC algorithm may succeed over a wide range of applications in biological data mining.

Accuracy improvement of quantitative analysis of calorific value of coal by combining support vector machine and partial least square methods in laser-induced breakdown spectroscopy

Laser-induced breakdown spectroscopy (LIBS) is a potential technology for online coal property analysis, but successful quantitative measurement of calorific value using LIBS suffers from relatively low accuracy caused by the matrix effect. To solve this problem, the support vector machine (SVM) and the partial least square (PLS) were combined to increase the measurement accuracy of calorific value in this study. The combination model utilized SVM to classify coal samples into two groups according to their volatile matter contents to reduce the matrix effect, and then applied PLS to establish calibration models for each sample group respectively. The proposed model was applied to the measurement of calorific values of 53 coal samples, showing that the proposed model could greatly increase accuracy of the measurement of calorific values. Compared with the traditional PLS method, the coefficient of determination (R2) was improved from 0.93 to 0.97, the root-mean-square error of prediction was reduced from 1.68 MJ kg−1 to 1.08 MJ kg−1, and the average relative error was decreased from 6.7% to 3.93%, showing an overall improvement.

Early Diagnosis of Hepatocellular Carcinoma Using Machine Learning Method.

Hepatocellular carcinoma (HCC) is a serious cancer which ranked the fourth in cancer-related death worldwide. Hence, more accurate diagnostic models are urgently needed to aid the early HCC diagnosis under clinical scenarios and thus improve HCC treatment and survival. Several conventional methods have been used for discriminating HCC from cirrhosis tissues in patients without HCC (CwoHCC). However, the recognition successful rates are still far from satisfactory. In this study, we applied a computational approach that based on machine learning method to a set of microarray data generated from 1091 HCC samples and 242 CwoHCC samples. The within-sample relative expression orderings (REOs) method was used to extract numerical descriptors from gene expression profiles datasets. After removing the unrelated features by using maximum redundancy minimum relevance (mRMR) with incremental feature selection, we achieved “11-gene-pair” which could produce outstanding results. We further investigated the discriminate capability of the “11-gene-pair” for HCC recognition on several independent datasets. The wonderful results were obtained, demonstrating that the selected gene pairs can be signature for HCC. The proposed computational model can discriminate HCC and adjacent non-cancerous tissues from CwoHCC even for minimum biopsy specimens and inaccurately sampled specimens, which can be practical and effective for aiding the early HCC diagnosis at individual level.

A comparison of fMRI and behavioral models for predicting inter-temporal choices

In an inter-temporal choice (IteCh) task, subjects are offered a smaller amount of money immediately or a larger amount at a later time point. Here, we are using trial-by-trial fMRI data from 363 recording sessions and machine learning in an attempt to build a classifier that would ideally outperform established behavioral model given that it has access to brain activity specific to a single trial. Such methods could allow for future investigations of state-like factors that influence IteCh choices.To investigate this, coefficients of a GLM with one regressor per trial were used as features for a support vector machine (SVM) in combination with a searchlight approach for feature selection and cross-validation. We then compare the results to the performance of four different behavioral models.We found that the behavioral models reached mean accuracies of 90% and above, while the fMRI model only reached 54.84% at the best location in the brain with a spatial distribution similar to the well-known value-tracking network. This low, though significant, accuracy is in line with simulations showing that classifying based on signals with realistic correlations with subjective value produces comparable, low accuracies. These results emphasize the limitations of fMRI recordings from single events to predict human choices, especially when compared to conventional behavioral models. Better performance may be obtained with paradigms that allow the construction of miniblocks to improve the available signal-to-noise ratio.

Protein Fold Recognition by Combining Support Vector Machines and Pairwise Sequence Similarity Scores.

Protein fold recognition is one of the most essential steps for protein structure prediction, aiming to classify proteins into known protein folds. There are two main computational approaches: one is the template-based method based on the alignment scores between query-template protein pairs and the other is the machine learning method based on the feature representation and classifier. These two approaches have their own advantages and disadvantages. Can we combine these methods to establish more accurate predictors for protein fold recognition? In this study, we made an initial attempt and proposed two novel algorithms: TSVM-fold and ESVM-fold. TSVM-fold was based on the Support Vector Machines (SVMs), which utilizes a set of pairwise sequence similarity scores generated by three complementary template-based methods, including HHblits, SPARKS-X, and DeepFR. These scores measured the global relationships between query sequences and templates. The comprehensive features of the attributes of the sequences were fed into the SVMs for the prediction. Then the TSVM-fold was further combined with the HHblits algorithm so as to improve its generalization ability. The combined method is called ESVM-fold. Experimental results in two rigorous benchmark datasets (LE and YK datasets) showed that the proposed methods outperform some state-of-the-art methods, indicating that the TSVM-fold and ESVM-fold are efficient predictors for protein fold recognition.

Combining Support Vector Machines with Distance-based Relative Competence Weighting for Remote Sensing Image Classification: A Case Study

Abstract A classification problem involving multi-class samples is typically divided into a set of two-class sub-problems. The pairwise probabilities produced by the binary classifiers are subsequently combined to generate a final result. However, only the binary classifiers that have been trained with the unknown real class of an unlabeled sample are relevant to the multi-class problem. A distance-based relative competence weighting (DRCW) combination mechanism can estimate the competence of the binary classifiers. In this work, we adapt the DRCW mechanism to the support vector machine (SVM) approach for the classification of remote sensing images. The application of DRCW can allow the competence of a binary classifier to be estimated from the spectral information. It is therefore possible to distinguish the relevant and irrelevant binary classifiers. The SVM+DRCW classification approach is applied to analyzing the land-use/land-cover patterns in Guangzhou, China from the remotely sensed images from Landsat-5 TM and SPOT-5. The results show that the SVM+DRVW approach can achieve higher classification accuracies compared to the conventional SVM and SVMs combined with other combination mechanisms such as weighted voting (WV) and probability estimates by pairwise coupling (PE).

Machine learning approach to predict medication overuse in migraine patients

Machine learning (ML) is largely used to develop automatic predictors in migraine classification but automatic predictors for medication overuse (MO) in migraine are still in their infancy. Thus, to understand the benefits of ML in MO prediction, we explored an automated predictor to estimate MO risk in migraine. To achieve this objective, a study was designed to analyze the performance of a customized ML-based decision support system that combines support vector machines and Random Optimization (RO-MO). We used RO-MO to extract prognostic information from demographic, clinical and biochemical data. Using a dataset of 777 consecutive migraine patients we derived a set of predictors with discriminatory power for MO higher than that observed for baseline SVM. The best four were incorporated into the final RO-MO decision support system and risk evaluation on a five-level stratification was performed. ROC analysis resulted in a c-statistic of 0.83 with a sensitivity and specificity of 0.69 and 0.87, respectively, and an accuracy of 0.87 when MO was predicted by at least three RO-MO models. Logistic regression analysis confirmed that the derived RO-MO system could effectively predict MO with ORs of 5.7 and 21.0 for patients classified as probably (3 predictors positive), or definitely at risk of MO (4 predictors positive), respectively. In conclusion, a combination of ML and RO – taking into consideration clinical/biochemical features, drug exposure and lifestyle – might represent a valuable approach to MO prediction in migraine and holds the potential for improving model precision through weighting the relative importance of attributes.

MLP, CNN, LSTM and Hybrid SVM for Stock Index Forecasting Task to INDU and FTSE100

The aim of this paper is to investigate the Support Vector Machine (SVM), the Binary Gravity Search Algorithm combined Support Vector Machine (BGSA-SVM), the Multi-layer Perceptron (MLP), the Convolution Neural Network (CNN) and the Long Short-Term Memory (LSTM) neural network, when applied to the task of forecasting and trading FTSE100 and INDU indexes from 2000 to 2018. Results show that the performance of the SVM is unstable as it displays sensitivity to inputs and parameters. The other Machine Learning models (BGSA-SVM, MLP, CNN and LSTM) outperform Buy-and-Hold and Random Walk (RW). Additionally, this paper finds no significant difference between the performance of BGSA-SVM, MLP, CNN and LSTM.

Nonlinear Soft Fault Diagnosis of Analog Circuits Based on RCCA-SVM

In the soft fault diagnosis of nonlinear analog filter circuits, the single feature can't maximally reveal the behaviors hidden in signals. In order to overcome such shortcomings, a fusion algorithm weighted feature from multi-group is proposed. This method use reliefF algorithm to optimize canonical correlation analysis combines support vector machine(RCCA-SVM) for diagnosis. The fault characteristics used in this method are extracted from the time-domain, statistical features and frequency-domain by wavelet packet transform (WPT). And then the CCA algorithm is used to improve the correlation of features according to the weights of the features. Finally, the fusion features are dimension reduced by principal component analysis(PCA), support vector machine(SVM) is the classifier of the diagnosis. The simulations show that the proposed method has a good diagnostic effect on circuit fault diagnosis of non-linear analog circuits.

Developing a dust storm detection method combining Support Vector Machine and satellite data in typical dust regions of Asia

Enhancing the dust storm detection is a key part for the environmental protection, human healthy and economic development. The goal of this paper is to propose a new Support Vector Machine (SVM)-based method to automatically detect dust storms using remote sensing data. Existing methods dealing with this problem are usually threshold-based that are of great complexity and uncertainty. In this paper we propose a simple and reliable method combining SVM with MODIS L1 data and explore the optimal band combinations used as the feature vectors of SVM. The developed method was evaluated by MODIS and OMI data qualitatively and quantitatively on three study sites located in the Arabian Desert, Gobi Desert and Taklimakan Desert, and it was also compared to three other traditional methods based on their accuracy, complexity, reliability and sensitivity to thresholds. The detection results demonstrated that the combination of (Band7 − Band3)/(Band7 + Band3) ((B7 − B3)/(B7 + B3)), Band20 − Band31 (B20 − B31), and Band31/Band32 (B31/B32) can detect the dust storms more precisely than other individual bands or their combination. The comparison among those cases indicated that the proposed automatic method exhibited an advantage of minimizing the uncertainty and complexity, which were the limits of defining thresholds based on the threshold-based methods. The conclusions can provide references for studies that focus on statistical-based dust storm detection.

DeepSVM-fold: protein fold recognition by combining support vector machines and pairwise sequence similarity scores generated by deep learning networks.

Protein fold recognition is critical for studying the structures and functions of proteins. The existing protein fold recognition approaches failed to efficiently calculate the pairwise sequence similarity scores of the proteins in the same fold sharing low sequence similarities. Furthermore, the existing feature vectorization strategies are not able to measure the global relationships among proteins from different protein folds. In this article, we proposed a new computational predictor called DeepSVM-fold for protein fold recognition by introducing a new feature vector based on the pairwise sequence similarity scores calculated from the fold-specific features extracted by deep learning networks. The feature vectors are then fed into a support vector machine to construct the predictor. Experimental results on the benchmark dataset (LE) show that DeepSVM-fold obviously outperforms all the other competing methods.

Traffic Flow Prediction using Combination of Support Vector Machine and Rough Set

Congestion is the primary issue related to traffic flow. Avoiding congestion after getting into is not possible. So the only way is to make the informed decision by knowing the traffic situation in advance. This can be achieved with the help of traffic flow prediction. In the proposed work, short term traffic flow prediction is performed using support vector machine in combination with rough set. Traffic data used for analysis is collected from three adjacent intersections of Nagpur city and traffic flow is predicted at downstream junction. The work has attempted to study the effect of aggregation intervals and past samples on the prediction performance using MSE threshold variation. Rough set is used as a post processor to validate the prediction result. Accurate and timely prediction can provide reliability for optimized traffic control and guidance.

Short-term wind power forecasting based on support vector machine with improved dragonfly algorithm

Abstract It is hard to predict wind power with high-precision due to its non-stationary and stochastic nature. The wind power has developed rapidly around the world as a promising renewable energy industry. The uncertainty of wind power brings difficult challenges to the operation of the power system with the integration of wind farms into power grid. Accurate wind power prediction is increasingly important for the stable operation of wind farms and the power grid. This study is combined support vector machine and improved dragonfly algorithm to forecast short-term wind power for a hybrid prediction model. The adaptive learning factor and differential evolution strategy are introduced to improve the performance of traditional dragonfly algorithm. The improved dragonfly algorithm is used to choose the optimal parameters of support vector machine. The effectiveness of the proposed model has been confirmed on the real datasets derived from La Haute Borne wind farm in France. The proposed model has shown better prediction performance compared with the other models such as back propagation neural network and Gaussian process regression. The proposed model is suitable for short-term wind power prediction.

Categorized Image Classification uing CNN Features with ECOC Framework

Image Classification technique is used to classify images into categories. In this study, an application is presented to examine category based image classification by combining Support Vector Machine with error correcting output codes (ECOC) framework. The ResNet50 used as Network architecture, our image dataset include caltech101 images from 9 categories (classes) which builds our classification task a multiclass problem. ECOC is a commonly used framework to model multiclass classification problem. We present one-verses-all coding design of ECOC and apply to SVM classifier. A pre-trained CNN (convolution neural network) is used for extracting image feature and as a classifier Multiclass Support Vector Machine is used. The extracted features are then passed for classification via ECOC approach. The final classification result predicts the class labels. The application is implemented in Matlab using pre-trained CNN. The prediction accuracy of each category is evaluated and presented. The experimental result shows an accuracy of 97.6%. Further experiments are carried out on different dataset which showed that best accuracy is achieved using CNN with ECOC for multiclass problem.

A Hybrid Physiological Approach of Emotional Reaction Detection Using Combined FCM and SVM Classifier.

Users' emotional reaction capturing is one of the primary issues for brain computer interface applications. Despite the intuitive feedback provided by the qualitative methods, emotional reactions are expected to be detected and classified quantitatively. Based on the human emotion representation on physiological signal, this paper offers an hybrid approach combining electroencephalogram (EEG) and facial expression together to classify the human emotion. Several advanced signal processing techniques are used to simplify the data and extract the features involving local binary patterns (LBP), Compressed Sensing (CS) and Wavelet Transform (WT). A novel machine learning algorithm, combined Fuzzy Cognitive Maps (FCM) and Support Vector Machine (SVM) are implemented to recognise the feature patterns. The result illustrates a stable emotion classification system with 75.64% accuracy. This design can provide fast and precise emotional feedback, which would further improve the communication between human and computer.

Tool wear state recognition based on GWO–SVM with feature selection of genetic algorithm

Tool wear is an important consideration for Computerized Numerical Control (CNC) machine tools as it directly affects machining precision. To realize the online recognition of tool wear degree, this research develops a tool wear monitoring system using an indirect measurement method which selects signal characteristics that are strongly correlated with tool wear to recognize tool wear status. The system combines support vector machine (SVM) and genetic algorithm (GA) to establish a nonlinear mapping relationship between a sample of cutting force sensor signal and tool wear level. The cutting force signal is extracted using time domain statistics, frequency domain analysis, and wavelet packet decomposition. GA is employed to select the sensitive features which have a high correlation with tool wear states. SVM is also applied to obtain the state recognition results of tool wear. The gray wolf optimization (GWO) algorithm is used to optimize the SVM parameters and to improve prediction accuracy and reduce internal parameters’ adjustment time. A milling experiment on AISI 1045 steel showed that when comparing with SVM optimized by commonly used optimization algorithms (grid search, particle swarm optimization, and GA), the proposed tool wear monitoring system can accurately reflect the degree of tool wear and achieves strong generalizability. A set of vibration signals are adopted to verify the presented research. Results show that the proposed tool wear monitoring system is robust.