Fuzzy Least Squares Support Vector Machine Research Articles

Prediction of the ground temperature with ANN, LS-SVM and fuzzy LS-SVM for GSHP application

Ground source heat pump (GSHP) system has received more and more attentions for its energy-conserving and environmental-friendly properties. Acquisition of the undisturbed ground temperature is the prerequisite for designing of GSHP system. Measurement by burying temperature sensors underground is the conventional means for obtaining the ground temperature data. However, this way is usually time consuming and high investment, and also easily encounter with certain technical difficulties. The rapid development of intelligent computation algorithm provides solutions for many realistic difficult problems. Basing on a great number of the measured data of the ground temperature from two boreholes with 100m depth located in Chongqing, ground temperature prediction models basing on artificial neural network (ANN) and support vector machine based on least square (LS-SVM) are established, respectively. And then, two kinds of validation works, i.e., holdout validation and k-fold validation are conducted toward the two models, respectively. Furthermore, a new method that correlating fuzzy theory with LS-SVM is proposed to solve the big computation burden problem encountered by LS-SVM model. By comparing with the above two models, it is concluded that the newly proposed model can not only improve the calculation speed obviously but also be able to promote the prediction accuracy, especially superior to the single LS-SVM model.

Using fuzzy least squares support vector machine with metric learning for object tracking

Some researchers have introduced the fuzzy learning into tracking and the kernelized fuzzy least squares support vector machine (FLS-SVM) has achieved great success in building the appearance model. However, the kernel used in FLS-SVM is fixed, which may potentially limit the adaptivity to different conditions. In this paper, we introduce metric learning into the FLS-SVM classifier and propose a novel tracking method based on the combination of fuzzy learning and metric learning to address the above issue. First, we propose a new fuzzy least squares support vector machine with metric learning (FLS-SVM-ML) algorithm, which embeds metric learning into the FLS-SVM method and is used to learn the kernel in FLS-SVM adaptively. Moreover, we present a two-stage iterative optimization process to solve the optimization problem. Second, we apply the proposed FLS-SVM-ML method into tracking based on the FLS-SVM tracking framework. By introducing the metric learning, the FLS-SVM-ML method can be used to improve the adaptivity of the appearance model to different video sequences and different frames in the same sequence. Experimental results demonstrate that the proposed tracking method can achieve competitive tracking results and outperform many state-of-the-art methods in the benchmark datasets.

Geometric correction based color image watermarking using fuzzy least squares support vector machine and Bessel K form distribution

This paper presents a robust color image watermarking algorithm based on fuzzy least squares support vector machine (FLS-SVM) and Bessel K form (BKF) distribution, which is a recently developed geometric correction algorithm. We firstly compute the quaternion discrete Fourier transform (QDFT) of the maximum central region of the original color image. Then the watermark is embedded into the magnitudes of low-frequency information of QDFT. In watermark decoding process, the synchronous correction based on FLS-SVM model is used. When training the FLS-SVM model, we firstly perform the quaternion wavelet transform (QWT) of the grayscale images that correspond to the color training images, and then use BKF distribution to fit the empirical histogram of coefficients of the QWT, and finally use the shape parameters and scale parameters of BKF distribution to construct image feature vector. Experimental results show that the proposed algorithm is not only invisible, but also has outstanding robustness against common image processing attacks and geometric attacks.

Single Object Tracking With Fuzzy Least Squares Support Vector Machine.

Single object tracking, in which a target is often initialized manually in the first frame and then is tracked and located automatically in the subsequent frames, is a hot topic in computer vision. The traditional tracking-by-detection framework, which often formulates tracking as a binary classification problem, has been widely applied and achieved great success in single object tracking. However, there are some potential issues in this formulation. For instance, the boundary between the positive and negative training samples is fuzzy, and the objectives of tracking and classification are inconsistent. In this paper, we attempt to address the above issues from the fuzzy system perspective and propose a novel tracking method by formulating tracking as a fuzzy classification problem. First, we introduce the fuzzy strategy into tracking and propose a novel fuzzy tracking framework, which can measure the importance of the training samples by assigning different memberships to them and offer more strict spatial constraints. Second, we develop a fuzzy least squares support vector machine (FLS-SVM) approach and employ it to implement a concrete tracker. In particular, the primal form, dual form, and kernel form of FLS-SVM are analyzed and the corresponding closed-form solutions are derived for efficient realizations. Besides, a least squares regression model is built to control the update adaptively, retaining the robustness of the appearance model. The experimental results demonstrate that our method can achieve comparable or superior performance to many state-of-the-art methods.

Fuzzy least squares support vector machine soft measurement model based on adaptive mutative scale chaos immune algorithm

In order to enhance measuring precision of the real complex electromechanical system, complex industrial system and complex ecological & management system with characteristics of multi-variable, non-liner, strong coupling and large time-delay, in terms of the fuzzy character of this real complex system, a fuzzy least squares support vector machine (FLS-SVM) soft measurement model was established and its parameters were optimized by using adaptive mutative scale chaos immune algorithm. The simulation results reveal that fuzzy least squares support vector machines soft measurement model is of better approximation accuracy and robustness. And application results show that the relative errors of the soft measurement model are less than 3.34%.

Researching output correction of coal ash content apparatus based on Fuzzy LS-SVM

Researching output correction of coal ash content apparatus based on Fuzzy LS-SVM

Structural Damage Detection Based on Fuzzy LS-SVM Integrated Quantum Genetic Algorithm

Structural damage detection and health monitoring is very important in many applications, and a key related issue is the method of damage detection. In this paper, Fuzzy Least Square Support Vector Machine (FLS-SVM) is constructed by combining Fuzzy Logic with LS-SVM, and a real-coded Quantum Genetic Algorithm (QGA) is applied to optimize parameters of FLS-SVM. Then, the method of FLS-SVM integrated QGA is used to detect damages for fiber smart structures. The testing results show FLS-SVM possesses the higher detecting accuracy and the bitter dissemination ability than LS-SVM under the same conditions, and the parameters of FLS-SVM can be effectively optimized by the real-coded QGA. The proposed method of FLS-SVM integrated QGA is effective and efficient for structural damage detection.

Joint application of rough set-based feature reduction and Fuzzy LS-SVM classifier in motion classification

This paper presents an effective classification scheme consisting of the rough set theory (RST)-based feature selection and the fuzzy least squares support vector machine (LS-SVM) classifier for the surface electromyographic (sEMG)-based motion classification. The wavelet packet transform (WPT) is exploited to decompose the four-class motion EMG signals to the non-overlapped sub-bands and the energy characteristic of each sub-band is adopted to form the original feature set. In order to reduce the computation complexity, the RST is utilized to get the reduction feature set without compromising classification accuracy. In the feature reduction phase, cluster separation index (CSI) is introduced to evaluate the performance of the proposed algorithm. In the sequel, the Fuzzy LS-SVM is constructed for the multi-class classification task. The RST-based feature selection is independent of the classifier design. Consequently the classification performance will vary with different classifiers. We make the comparison between the proposed classification scheme and the commonly used classification scheme, such as the combination of the principal component analysis (PCA)-based feature selection and the neural network (NN) classifier. The results of comparative experiments show that the diverse motions can be identified with high accuracy by the proposed scheme. Compared with other feature extraction and selection algorithms and classifiers, superior performance of the proposed classification scheme illustrates the potential of the SVM techniques combined with WPT and RST in EMG motion classification.

New Least Squares Support Vector Machines Based on Matrix Patterns

Support vector machine (SVM), as an effective method in classification problems, tries to find the optimal hyperplane that maximizes the margin between two classes and can be obtained by solving a constrained optimization criterion using quadratic programming (QP). This QP leads to higher computational cost. Least squares support vector machine (LS-SVM), as a variant of SVM, tries to avoid the above shortcoming and obtain an analytical solution directly from solving a set of linear equations instead of QP. Both SVM and LS-SVM operate directly on patterns represented by vector, i.e., before applying SVM or LS-SVM to a pattern, any non-vector pattern such as an image has to be first vectorized into a vector pattern by some techniques like concatenation. However, some implicit structural or local contextual information may be lost in this transformation. Moreover, as the dimension d of the weight vector in SVM or LS-SVM with the linear kernel is equal to the dimension d 1 × d 2 of the original input pattern, as a result, the higher the dimension of a vector pattern is, the more space is needed for storing it. In this paper, inspired by the method of feature extraction directly based on matrix patterns and the advantages of LS-SVM, we propose a new classifier design method based on matrix patterns, called MatLSSVM, such that the new method can not only directly operate on original matrix patterns, but also efficiently reduce memory for the weight vector (d) from d 1 × d 2 to d 1 + d 2. However like LS-SVM, MatLSSVM inherits LS-SVM's existence of unclassifiable regions when extended to multi-class problems. Thus with the fuzzy version of LS-SVM, a corresponding fuzzy version of MatLSSVM (MatFLSSVM) is further proposed to remove unclassifiable regions effectively for multi-class problems. Experimental results on some benchmark datasets show that the proposed method is competitive in classification performance compared to LS-SVM, fuzzy LS-SVM (FLS-SVM), more-recent MatPCA and MatFLDA. In addition, more importantly, the idea used here has a possibility of providing a novel way of constructing learning model.

Support vector machine-based multi-source multi-attribute information integration for situation assessment

Understanding any given situation requires integrating many pieces of information. Such information has in most cases multiple attributes and is obtained from multiple data sources within multiple time slots. Situation assessors’ experience and preference will naturally influence the result of information integration, and hence influence the awareness generated for a situation. This study focuses on how multi-source multi-attribute information about a situation is integrated and how the awareness information for the situation is derived. A learning-based information integration approach, which embeds the fuzzy least squares support vector machine (FLS-SVM) technique, is developed in this study. This approach can assess a situation through integrating and inference obtained information and analyzing related data sources. A series of experiments show that the proposed approach has an accuracy learning ability from assessors’ experience in the information integration for generating awareness for a situation.