Fuzzy Support Vector Machine Method Research Articles

Fuzzy support vector machine for classification of time series data: A simulation study

Support vector machine (SVM) has become one of most developed methods for classification, focusing on cross-sectional analysis. However, classification of time series data is an important issue in statistics and data mining. Classification of time series data using SVMs that focus on cross-sectional data leads to improper classification, and hence, the SVM needs to be extended for handling time series dataset. As with cross-section data, the problem of imbalanced data is also common in time series data. Fuzzy method has been proven to be capable of overcoming the case of imbalanced data. In this paper, we developed a Fuzzy Support Vector Machine (FSVM) model to classify time series data with imbalanced class. The proposed method puts the fuzzy membership function on the constraint function. Through simulation studies, this research aims to assess the performance of the developed FSVM in classifying time series data. Based on the classification accuracy criteria, we prove that the proposed FSVM method outperforms the standard SVM method for the classification of multiclass time series data.

Enhancement in Quality Estimation of Resistance Spot Welding Using Vision System and Fuzzy Support Vector Machine

The current nondestructive testing methods such as ultrasonic, magnetic, or eddy current signals, and even the existing image processing methods, present certain challenges and show a lack of flexibility in building an effective and real-time quality estimation system of the resistance spot welding (RSW). This paper provides a significant improvement in the theory and practices for designing a robotized inspection station for RSW at the car manufacturing plants using image processing and fuzzy support vector machine (FSVM). The weld nuggets’ positions on each of the used car underbody models are detected mathematically. Then, to collect perfect pictures of the weld nuggets on each of these models, the required end-effector path is planned in real-time by establishing the Denavit-Hartenberg (D-H) model and solving the forward and inverse kinematics models of the used six-degrees of freedom (6-DOF) robotic arm. After that, the most frequent resistance spot-welding failure modes are reviewed. Improved image processing methods are employed to extract new features from the elliptical-shaped weld nugget’s surface and obtain a three-dimensional (3D) reconstruction model of the weld’s surface. The extracted artificial data of thousands of samples of the weld nuggets are divided into three groups. Then, the FSVM learning algorithm is formed by applying the fuzzy membership functions to each group. The improved image processing with the proposed FSVM method shows good performance in classifying the failure modes and dealing with the image noise. The experimental results show that the improvement of comprehensive automatic real-time quality evaluation of RSW surfaces is meaningful: the quality estimation could be processed within 0.5 s in very high accuracy.

A New Comprehensive Evaluation Method for Water Quality: Improved Fuzzy Support Vector Machine

With the pressure of population growth and environmental pollution, it is particularly important to develop and utilize water resources more rationally, safely, and efficiently. Due to safety concerns, the government today adopts a pessimistic method, single factor assessment, for the evaluation of domestic water quality. At the same time, however, it is impossible to grasp the timely comprehensive pollution status of each area, so effective measures cannot be taken in time to reverse or at least alleviate its deterioration. Thus, the main propose of this paper is to establish a comprehensive evaluation model of water quality, which can provide the managers with timely information of water pollution in various regions. After considering various evaluation methods, this paper finally decided to use the fuzzy support vector machine method (FSVM) to establish the model that is mentioned above. The FSVM method is formed by applying the membership function to the support vector machine. However, the existing membership functions have some shortcomings, so after some improvements in these functions, a new membership function is finally formed. The model is then tested on the artificial data, UCI dataset, and water quality evaluation historical data. The results show that the improvement is meaningful, the improved fuzzy support vector machine has good performance, and it can deal with noise and outliers well. Thus, the model can completely solve the problem of comprehensive evaluation of water quality.

Support Vector Machine-Based Brain Image Classification and Its Application in Diagnosis of Mental Diseases

Since the training samples are usually limited in medical image segmentation, it is usually difficult for traditional model classification methods to obtain good results, the purpose of this paper was to deeply study support vector machine (SVM) method and its application in the diagnosis of mental diseases in medical image segmentation. This paper adopted SVM method which had a good classification performance in the small sample, nonlinear and high-dimensional feature space to study the characteristics of medical image segmentation. Results indicated that the S type function-based fuzzy support vector machine method had more accurate effect than the traditional support vector machine. A conclusion can be drawn that the method of determining the degree of membership based on tightness can effectively distinguish outliers or noisy samples from valid samples in the sample set relative to distance-based membership degree.

Pathological brain detection in MRI scanning by wavelet packet Tsallis entropy and fuzzy support vector machine.

An computer-aided diagnosis system of pathological brain detection (PBD) is important for help physicians interpret and analyze medical images. We proposed a novel automatic PBD to distinguish pathological brains from healthy brains in magnetic resonance imaging scanning in this paper. The proposed method simplified the PBD problem to a binary classification task. We extracted the wavelet packet Tsallis entropy (WPTE) from each brain image. The WPTE is the Tsallis entropy of the coefficients of the discrete wavelet packet transform. The, the features were submitted to the fuzzy support vector machine (FSVM). We tested the proposed diagnosis method on 3 benchmark datasets with different sizes. A ten runs of K-fold stratified cross validation was carried out. The results demonstrated that the proposed WPTE + FSVM method excelled 17 state-of-the-art methods w.r.t. classification accuracy. The WPTE is superior to discrete wavelet transform. The Tsallis entropy performs better than Shannon entropy. The FSVM excels standard SVM. In closing, the proposed method “WPTE + FSVM” is effective in PBD.

Protein-protein interaction site prediction in Homo sapiens and E. coli using an interaction-affinity based membership function in fuzzy SVM.

Protein-protein interaction (PPI) site prediction aids to ascertain the interface residues that participate in interaction processes. Fuzzy support vector machine (F-SVM) is proposed as an effective method to solve this problem, and we have shown that the performance of the classical SVM can be enhanced with the help of an interaction-affinity based fuzzy membership function. The performances of both SVM and F-SVM on the PPI databases of the Homo sapiens and E. coli organisms are evaluated and estimated the statistical significance of the developed method over classical SVM and other fuzzy membership-based SVM methods available in the literature. Our membership function uses the residue-level interaction affinity scores for each pair of positive and negative sequence fragments. The average AUC scores in the 10-fold cross-validation experiments are measured as 79.94% and 80.48% for the Homo sapiens and E. coli organisms respectively. On the independent test datasets, AUC scores are obtained as 76.59% and 80.17% respectively for the two organisms. In almost all cases, the developed F-SVM method improves the performances obtained by the corresponding classical SVM and the other classifiers, available in the literature.

New Fuzzy Support Vector Machine Method Based on Entropy and Ant-Colony Optimization

Concerning the defect of fuzzy membership as a function of distance between the point and its class center in feature space for some current Fuzzy Support Vector Machines (FSVM), a new FSVM based on entropy and Genetic Algorithm (GA) named EGFSVM was proposed in this paper. Making use of evaluation of entropy and intelligence of GA, EGFSVM enhances the classification capability and makes clustering center more suitable and membership more accurate. Experimental results show EGFSVM has better precision and classification performance, especially to multi-class and large scale data.

Wavelet Correlation Feature Scale Entropy and Fuzzy Support Vector Machine Approach for Aeroengine Whole-Body Vibration Fault Diagnosis

In order to correctly analyze aeroengine whole-body vibration signals, Wavelet Correlation Feature Scale Entropy (WCFSE) and Fuzzy Support Vector Machine (FSVM) (WCFSE-FSVM) method was proposed by fusing the advantages of the WCFSE method and the FSVM method. The wavelet coefficients were known to be located in high Signal-to-Noise Ratio (S/N or SNR) scales and were obtained by the Wavelet Transform Correlation Filter Method (WTCFM). This method was applied to address the whole-body vibration signals. The WCFSE method was derived from the integration of the information entropy theory and WTCFM, and was applied to extract the WCFSE values of the vibration signals. Among the WCFSE values, theWFSE1andWCFSE2values on the scale 1 and 2 from the high band of vibration signal were believed to acceptably reflect the vibration feature and were selected to construct the eigenvectors of vibration signals as fault samples to establish the WCFSE-FSVM model. This model was applied to aeroengine whole-body vibration fault diagnosis. Through the diagnoses of four vibration fault modes and the comparison of the analysis results by four methods (SVM, FSVM, WESE-SVM, WCFSE-FSVM), it is shown that the WCFSE-FSVM method is characterized by higher learning ability, higher generalization ability and higher anti-noise ability than other methods in aeroengine whole-vibration fault analysis. Meanwhile, this present study provides a useful insight for the vibration fault diagnosis of complex machinery besides an aeroengine.

Wavelet Correlation Feature Scale Entropy and Fuzzy Support Vector Machine Approach for Aeroengine Whole-Body Vibration Fault Diagnosis

In order to correctly analyze aeroengine whole-body vibration signals, Wavelet Correlation Feature Scale Entropy (WCFSE) and Fuzzy Support Vector Machine (FSVM) (WCFSE-FSVM) method was proposed by fusing the advantages of the WCFSE method and the FSVM method. The wavelet coefficients were known to be located in high Signal-to-Noise Ratio (S/N or SNR) scales and were obtained by the Wavelet Transform Correlation Filter Method (WTCFM). This method was applied to address the whole-body vibration signals. The WCFSE method was derived from the integration of the information entropy theory and WTCFM, and was applied to extract the WCFSE values of the vibration signals. Among the WCFSE values, the WFSE1 and WCFSE2 values on the scale 1 and 2 from the high band of vibration signal were believed to acceptably reflect the vibration feature and were selected to construct the eigenvectors of vibration signals as fault samples to establish the WCFSE-FSVM model. This model was applied to aeroengine whole-body vibration fault diagnosis. Through the diagnoses of four vibration fault modes and the comparison of the analysis results by four methods (SVM, FSVM, WESE-SVM, WCFSE-FSVM), it is shown that the WCFSE-FSVM method is characterized by higher learning ability, higher generalization ability and higher anti-noise ability than other methods in aeroengine whole-vibration fault analysis. Meanwhile, this present study provides a useful insight for the vibration fault diagnosis of complex machinery besides an aeroengine.

Fuzzy Support Vector Machine for PolSAR Image Classification

Fully Polarimetric Synthetic Aperture Radar (PolSAR) image classification, with the complexity for its data’s scattering mechanism and statistical property, has expected to be performed by an automatic categorization. This paper presents a supervised method called Fuzzy support vector machine (FSVM), which is a variant of the SVM algorithm to classify the PolSAR image data. In order to take advantages of PolSAR data, five scattering features (entropy, total power, three Eigenvalues of Coherent Matrix: λ1,λ2,λ3) are input as original data space of the FSVM algorithm. The feasibility of this approach is examined by the JPL/AIRSAR PolSAR data. The classification results show that the proposed FSVM method has out-performed the SVM method.

Application of Fuzzy Support Vector Machine in Chalky Rice Identification

In order to improve the identification accuracy of fuzzy support vector machine for chalky rice, this paper puts forward a fuzzy support vector machine method based on fuzzy K nearest-neighbor. This method firstly gets a sample center by calculating sample mean aimed at every class sample; and then it calculates the initial membership of sample by calculating the distance between sample and center; finally, it calculates K neighbor points of each sample, calculates the membership of sample according to the fuzzy K neighbor method, and integrates the initial membership with fuzzy K neighbor membership at a certain proportion, to get the ultimate membership values of samples. Combined with image detection problems of rice, verify the validity of this method. Experiments show that this method not only can improve the accuracy of identification but also can improve its speed, with a better result than common fuzzy support vector machine.

An Circuit Fault Diagnosis Method with K-Means Kernel Density Estimation

A K-Means kernel density estimation was proposed and it was used in the pretreatment process of circuit fault diagnosis. The unequal division and losing division problem caused by the traditional method are solved by this method. It also avoid the singular problem which is usually caused by the high dimension of characteristic data. A kernel function is designed and it was integrated with fuzzy support vector machine method to solve the classification problem of multi-faults . At last, a solution of optimal bandwidth is given to improve the proposed method.

Fuzzy Support Vector Machine Method for Evaluating Innovation Sources in Service Firms

Fuzzy Support Vector Machine Method for Evaluating Innovation Sources in Service Firms

New Fuzzy Support Vector Machine method based on entropy and Ant Colony Optimization

Concerning the defect of fuzzy membership as a function of distance between the point and its class center in feature space for some current Fuzzy Support Vector Machines(FSVM),a new FSVM based on entropy and Ant Colony Optimization(ACO) named EAFSVM was proposed in this paper.Making use of evaluation of entropy and intelligence of ACO,EAFSVM enhances the classification capability and makes clustering center more suitable and membership more accurate.Experimental results show EAFSVM has better precision and classification performance,especially to multi-class and large scale data.

A complete fuzzy discriminant analysis approach for face recognition

In this paper, some studies have been made on the essence of fuzzy linear discriminant analysis (F-LDA) algorithm and fuzzy support vector machine (FSVM) classifier, respectively. As a kernel-based learning machine, FSVM is represented with the fuzzy membership function while realizing the same classification results with that of the conventional pair-wise classification. It outperforms other learning machines especially when unclassifiable regions still remain in those conventional classifiers. However, a serious drawback of FSVM is that the computation requirement increases rapidly with the increase of the number of classes and training sample size. To address this problem, an improved FSVM method that combines the advantages of FSVM and decision tree, called DT-FSVM, is proposed firstly. Furthermore, in the process of feature extraction, a reformative F-LDA algorithm based on the fuzzy k-nearest neighbors (FKNN) is implemented to achieve the distribution information of each original sample represented with fuzzy membership grade, which is incorporated into the redefinition of the scatter matrices. In particular, considering the fact that the outlier samples in the patterns may have some adverse influence on the classification result, we developed a novel F-LDA algorithm using a relaxed normalized condition in the definition of fuzzy membership function. Thus, the classification limitation from the outlier samples is effectively alleviated. Finally, by making full use of the fuzzy set theory, a complete F-LDA (CF-LDA) framework is developed by combining the reformative F-LDA (RF-LDA) feature extraction method and DT-FSVM classifier. This hybrid fuzzy algorithm is applied to the face recognition problem, extensive experimental studies conducted on the ORL and NUST603 face images databases demonstrate the effectiveness of the proposed algorithm.