Fuzzy Learning Vector Quantization Research Articles

Fuzzy Learning Vector Quantization for Classification of Mixed Meat Image Based on Character of Color and Texture

Beef consumption is quite high and expensive in the world. In Indonesia, beef prices are relatively expensive because the meat supply chain from farmers to the market is quite long. The high demand for beef and the difficulty of obtaining meat are factors in the high price of meat. This makes some meat traders cheat by mixing beef and pork (oplosan). Mixing beef and pork is detrimental to beef consumers, especially those who are Muslim. In this paper, we proposed a new strategy for identifying beef, pig, and mixed meat utilizing Fuzzy learning vector quantization (FLVQ) Based on the color and texture aspects of the meat. The HSV (Hue saturation value) approach is used for color features, whereas the GLCM (Gray level co-occurrence matrix) method is used for texture features. This study makes use of primary data collected from the Pasar Bawah Tourism and Cipuan Market in Pekanbaru, Riau Province. The data set consists of 600 photos, 200 each of beef, pork, and mixed. Based on the test scenario, the coefficient of fuzzyness and learning rate affect the accuracy of meat image identification. The proposed strategy has succeeded in classifying pork, beef and mixed meat with the best percentage of accuracy results in theclasses of beef and pork, beef and mixed, pork and mixed meat, respectively, at 100%, 97.5%, and 95%. This demonstrates that the proposed strategy has succeeded in classifying the image of pork, beef, and mixed.

A New Competitive Neural Architecture for Object Classification

In this paper, we propose a new neural architecture for object classification, made up from a set of competitive layers whose number and size are dynamically learned from training data using a two-step process that combines unsupervised and supervised learning modes. The first step consists in finding a set of one or more optimal prototypes for each of the c classes that form the training data. For this, it uses the unsupervised learning and prototype generator algorithm called fuzzy learning vector quantization (FLVQ). The second step aims to assess the quality of the learned prototypes in terms of classification results. For this, the c classes are reconstructed by assigning each object to the class represented by its nearest prototype, and the obtained results are compared to the original classes. If one or more constructed classes differ from the original ones, the corresponding prototypes are not validated and the whole process is repeated for all misclassified objects, using additional competitive layers, until no difference persists between the constructed and the original classes or a maximum number of layers is reached. Experimental results show the effectiveness of the proposed method on a variety of well-known benchmark data sets.

A new fuzzy learning vector quantization method for classification problems based on a granular approach

In this paper, a new Fuzzy Learning Vector Quantization (FuzzLVQ) method for classification is presented. FuzzLVQ is a hybrid method based on LVQ neural networks and fuzzy systems. FuzzLVQ was implemented using modular architectures based on a granular approach, to further improve its performance in complex classification problems. The contribution of this research work is the development of the new fuzzy learning quantization method (FuzzLVQ) for classification problems, which is a hybrid method based on LVQ neural networks and fuzzy inference systems. In this work, a set of 15 experiments were performed for each presented architecture and a comparison between the classical LVQ algorithm and the new FuzzLVQ is presented. The obtained results are favorable, and the classification accuracy is slightly higher with the FuzzLVQ method. The hybridization proved to be beneficial also in other aspects of the method, such as in the training times of the neural network, and the number of cluster centers, which are reduced in respect to the classical LVQ performance. A proper optimization method could help improve the classification accuracy even more.

Classification of Apple Varieties Using FT-NIR Spectroscopy and Possibilistic Learning Vector Quantization

Red Fuji, Huaniu and Gala were classified by Fourier transform near infrared (FT-NIR) spectroscopy and possibilistic learning vector quantization (PLVQ) which was proposed to solve the noise sensitivity problem of fuzzy learning vector quantization (PLVQ). Firstly, apple NIR spectra were measured by FT-NIR spectrophotometer. Secondly, principal component analysis (PCA) was used to compress the dimensionality of NIR spectra which was high dimensional. Thirdly, fuzzy c-means (FCM) clustering was run to termination to obtain the cluster vectors for PLVQ. Finally, PLVQ was performed to classify the data. Experimental results showed that this classification method was fast, nondestructive and effective for classifying the variety of apples.

Rapid Classification of Pork NIR Speca Using PCA and FLVQ

Pork storage time is relevant to its freshness which influences pork quality. To achieve the rapid and effective discrimination of pork storage time, near infrared spectroscopy was used to collect the near infrared reflectance (NIR) spectra of pork in different storage time. The high-dimensional NIR spectra was firstly compressed by principal component analysis (PCA) and then classified by fuzzy learning vector quantization (FLVQ). PCA plus FLVQ is a completely unsupervised learning algorithm which finds hidden patterns in unlabeled data. Experimental results showed that PCA plus FLVQ could classify pork NIR spectra effectively.

Performance Analysis of Fuzzy Competitive Learning Algorithms for MR Image Segmentation

fuzzy approach have attracted considerable attention in the computational intelligence and segmentation algorithms have been increasingly in developed in improving the accuracy of medical diagnosis. Fuzzy set attempts to represent the human perception whereas neural network attempt to emulate the architecture and information representation scheme of human brain. In this paper a comparative study on the performance of the FCM and the variant fuzzy competitive learning algorithms including the generalized Kohonen's competitive learning (GKCL)-based algorithms (KCL, fuzzy KCL (FKCL), fuzzy soft KCL (FSKCL)) and the learning vector quantization (LVQ)-based algorithms (LVQ, fuzzy LVQ (FLVQ), fuzzy soft LVQ (FSLVQ)) for MR image segmentation is presented. The performance of the algorithms are evaluated using the standard image quality indices such as MSE (mean squared error) and IQI (image quality index) and the results indicate that the soft versions of fuzzy competitive learning algorithms produces more promising results and require less CPU time than the other learning algorithms. Further, the LVQ-based algorithms have better performance according to the values of MSE and IQI as compared to the KCL based algorithms and the FCM algorithm. Keywordssegmentation, fuzzy set, KCL, LVQ.

Wavelet fuzzy LVQ based speaker verification system

This work evaluates the performance of speaker verification system based on Wavelet based Fuzzy Learning Vector Quantization (WLVQ) algorithm. The parameters of Gaussian mixture model (GMM) are designed using this proposed algorithm. Mel Frequency Cepstral Coefficients (MFCC) are extracted from the speech data and vector quantized through Wavelet based FLVQ algorithm. This algorithm develops a multi resolution codebook by updating both winning and nonwinning prototypes through an unsupervised learning process. This codebook is used as mean vector of GMM. The other two parameters, weight and covariance are determined from the clusters formed by the WLVQ algorithm. The multi resolution property of wavelet transform and ability of FLVQ in regulating the competition between prototypes during learning are combined in this algorithm to develop an efficient codebook for GMM. Because of iterative nature of Expectation Maximization (EM) algorithm, the applicability of alternative training algorithms is worth investigation. In this work, the performance of speaker verification system using GMM trained by LVQ, FLVQ and WLVQ algorithms are evaluated and compared with EM algorithm. FLVQ and WLVQ based training algorithms for modeling speakers using GMM yields better performance than EM based GMM.

Hyperspectral image classification using an unsupervised neuro-fuzzy system

An unsupervised neuro-fuzzy system, Gaussian fuzzy self-organizing map (GFSOM), is proposed for hyperspectral image classification. This algorithm operates by integrating an unsupervised neural network with a Gaussian function-based fuzzy system. We also explore the potential for hyperspectral image analysis of three other artificial intelligence (AI)-based unsupervised techniques popular for multispectral image analysis: self-organizing map (SOM), fuzzy c-mean (FCM), and descending fuzzy learning vector quantization (DFLVQ). To apply these methods effectively and efficiently to hyperspectral imagery, an optimal learning sample selection strategy and a prototype initialization system are developed. An experimental study on classifying an EO-1/Hyperion hyperspectral image illustrates that GFSOM achieves the best accuracy, since it can model both the central tendency characteristics of input samples and capture the dispersion characteristics of data within a cluster. By adopting the system initialization approach developed here, all the AI-based techniques have the capability to classify hyperspectral images and can deliver acceptable accuracy, which could consequently accelerate their transitions from the multispectral to the hyperspectral field.

Clustering and Classification in Option Pricing

This paper reviews the recent option pricing literature and investigates how clustering and classification can assist option pricing models. Specifically, we consider non-parametric modular neural network (MNN) models to price the S&P-500 European call options. The focus is on decomposing and classifying options data into a number of sub-models across moneyness and maturity ranges that are processed individually. The fuzzy learning vector quantization (FLVQ) algorithm we propose generates decision regions (i.e., option classes) divided by ‘intelligent’ classification boundaries. Such an approach improves generalization properties of the MNN model and thereby increases its pricing accuracy.

Fuzzy Learning Vector Quantization based on Fuzzy k-Nearest Neighbor Prototypes

In this paper, a new competition strategy for learning vector quantization is proposed. The simple competitive strategy used for learning vector quantization moves the winning prototype which is the closest to the newly given data pattern. We propose a new learning strategy based on k-nearest neighbor prototypes as the winning prototypes. The selection of several prototypes as the winning prototypes guarantees that the updating process occurs more frequently. The design is illustrated with the aid of numeric examples that provide a detailed insight into the performance of the proposed learning strategy.

Noise Fuzzy Learning Vector Quantization

Fuzzy learning vector quantization (FLVQ) benefits from using the membership values coming from fuzzy c-means (FCM) as learning rates and it overcomes several problems of learning vector quantization (LVQ). However, FLVQ is sensitive to noises because it is a FCM-based algorithm (FCM is sensitive to noises). Here, a new fuzzy learning vector quantization model, called noise fuzzy learning vector quantization (NFLVQ), is proposed to handle the noises sensitivity problem of FLVQ. NFLVQ integrates LVQ and generalized noise clustering (GNC), uses the membership values from GNC as learning rates and clusters data containing noisy data better than FLVQ. Experimental results show the better performances of NFLVQ.

Neuro-fuzzy Based Analysis of Hyperspectral Imagery

A neuro-fuzzy system, namely Gaussian Fuzzy Learning Vector Quantization (GFLVQ), was developed based on the synergy of a neural network and a fuzzy system. GFLVQ is both a fuzzy neural network and a neural fuzzy system with supervised learning and unsupervised self-organizing capabilities. In this paper, GFLVQ was further improved to efficiently and effectively process hyperspectral data through training data informed initialization and a simplified fuzzy learning algorithm. A geovisualization tool was developed to facilitate knowledge discovery and understanding of the hyperspectral image. A case study was conducted using a Hyperion image. The results obtained from the improved neuro-fuzzy system were found to be significantly better than those from conventional statistics-based and endmember-based classifiers. The fuzzy spectral profiles produced from the geovisualization tool provided an extra insight into the neuro-fuzzy learning process, further opening up the black box of the neural network.

Improved batch fuzzy learning vector quantization for image compression

In this paper, we develop a batch fuzzy learning vector quantization algorithm that attempts to solve certain problems related to the implementation of fuzzy clustering in image compression. The algorithm’s structure encompasses two basic components. First, a modified objective function of the fuzzy c-means method is reformulated and then is minimized by means of an iterative gradient-descent procedure. Second, the overall training procedure is equipped with a systematic strategy for the transition from fuzzy mode, where each training vector is assigned to more than one codebook vectors, to crisp mode, where each training vector is assigned to only one codebook vector. The algorithm is fast and easy to implement. Finally, the simulation results show that the method is efficient and appears to be insensitive to the selection of the fuzziness parameter.

Multi-resolution border segmentation for measuring spatial heterogeneity of mixed population biofilm bacteria

Multi-resolution image clustering and segmentation interactive system has been developed to analyze the interaction between clusters of heterogeneous microbial populations residing in biofilms. Biofilms are biological microorganisms attached to surfaces, which develop a complex heterogeneous three-dimensional structure. The hierarchical structural analysis concept underlying multi-resolution image segmentation is that the clusters will be more complex and noisy for higher-resolution while less complex and smoother for lower-resolution image. This hierarchical structure analysis can be used to simplify the image storage and retrieval in well-mixed populations. We are proposing an algorithm that combines Fuzzy C-Means, SOM and LVQ neural networks to segment and identify clusters. The outcome of the image segmentation is quantified by the number of cluster objects of each kind of microorganism within sections of the biofilm, and the centroid distances between the identified cluster objects. Experimental evaluations of the algorithm showed its effectiveness in enumerating cluster objects of bacteria in dual-species biofilms at the substratum and measuring the associated intercellular distances.

Effect of Continuum Removal on Hyperspectral Coastal Vegetation Classification Using a Fuzzy Learning Vector Quantizer

Continuum removal (CR) is often used for geologic mapping; however, more research is needed to better establish the utility of CR for vegetation classification, particularly when used with artificial neural networks (ANNs). In this paper, fuzzy learning vector quantization (FLVQ) was applied to hyperspectral Airborne Visible/Infrared Imaging Spectrometer imagery for coastal vegetation classification. FLVQ performance was compared with that of a multilayer perceptron (MLP), a self-organizing map (SOM), and an endmember-based algorithm [spectral feature fitting (SFF)]. The objective was to assess the effect of CR as an input vector-preprocessing step for ANN model development on classification accuracy. Compared with a related study, continuum intact (CI) reflectance data generally yielded higher classification accuracies than those based on CR. Thus, CR may not be a preferred preprocessing method for coastal vegetation mapping over broad wavelength ranges. MLP slightly outperformed FLVQ when applied to CI data, but FLVQ yielded higher accuracy than MLP with CR. However, there was no significant difference between them for both data treatments at the 95% confidence level. All ANNs tested yielded significantly higher classification accuracies than SFF. For model development, the 588-neuron FLVQ required only 8.2% of MLP training time, 27.8% of the 400-neuron SOM time, and 8.8% of the 729-neuron 3-D SOM time

Fuzzy learning vector quantization for hyperspectral coastal vegetation classification

Artificial neural networks (ANNs) may be of significant value in extracting vegetation type information in complex vegetation mapping problems, particularly in coastal wetland environments. Unsupervised, self-organizing ANNs have not been employed as frequently as supervised ANNs for vegetation mapping tasks, and further remote sensing research involving fuzzy ANNs is also needed. In this research, the utility of a fuzzy unsupervised ANN, specifically a fuzzy learning vector quantization (FLVQ) ANN, was investigated in the context of hyperspectral AVIRIS image classification. One key feature of the neural approach is that unlike conventional hyperspectral data processing methods, endmembers for a given scene, which can be difficult to determine with confidence, are not required for neural analysis. The classification accuracy of FLVQ was comparable to a conventional supervised multi-layer perceptron, trained with backpropagation (MLP) (KHAT ( Kˆ) accuracy: 82.82% and 84.66%, respectively; normalized accuracy: 74.60% and 75.85%, respectively), with no significant difference at the 95% confidence level. All neural algorithms in the experiment yielded significantly higher classification accuracies than the conventional endmember-based hyperspectral mapping method assessed (i.e., matched filtering, where Kˆ accuracy = 61.00% and normalized accuracy = 57.96%). FLVQ was also dramatically more computationally efficient than the baseline supervised and unsupervised ANN algorithms tested, including the MLP and the Kohonen self-organizing map (SOM), respectively. The 400-neuron FLVQ network required only 3.6% of the computation time used by the MLP network, and only 5.9% of the MLP time was used by the 588-neuron FLVQ network. In addition, the 400-neuron FLVQ used only 16.7% of the time used by the 400-neuron SOM for model development.

Drill flank wear estimation using supervised vector quantization neural networks

Drill wear detection and prognosis is one of the most important considerations in reducing the cost of rework and scrap and to optimize tool utilization in hole making industry. This study presents the development and implementation of two supervised vector quantization neural networks for estimating the flank-land wear size of a twist drill. The two algorithms are; the learning vector quantization (LVQ) and the fuzzy learning vector quantization (FLVQ). The input features to the neural networks were extracted from the vibration signals using power spectral analysis and continuous wavelet transform techniques. Training and testing were performed under a variety of speeds and feeds in the dry drilling of steel plates. It was found that the FLVQ is more efficient in assessing the flank wear size than the LVQ. The experimental procedure for acquiring vibration data and extracting features in the time-frequency domain using the wavelet transform is detailed. Experimental results demonstrated that the proposed neural network algorithms were effective in estimating the size of the drill flank wear.

Soft learning vector quantization and clustering algorithms based on non-Euclidean norms: multinorm algorithms

This paper presents the development of soft clustering and learning vector quantization (LVQ) algorithms that rely on multiple weighted norms to measure the distance between the feature vectors and their prototypes. Clustering and LVQ are formulated in this paper as the minimization of a reformulation function that employs distinct weighted norms to measure the distance between each of the prototypes and the feature vectors under a set of equality constraints imposed on the weight matrices. Fuzzy LVQ and clustering algorithms are obtained as special cases of the proposed formulation. The resulting clustering algorithm is evaluated and benchmarked on three data sets that differ in terms of the data structure and the dimensionality of the feature vectors. This experimental evaluation indicates that the proposed multinorm algorithm outperforms algorithms employing the Euclidean norm as well as existing clustering algorithms employing weighted norms.

Fuzzy-neuro LVQ and its comparison with fuzzy algorithm LVQ in artificial odor discrimination system

Abstract The human sensory test is often used for obtaining the sensory quantities of odors, however, the fluctuation of results due to the expert's condition can cause discrepancies among panelists. Authors have studied the artificial odor discrimination system using a quartz resonator sensor and a back-propagation neural network as the recognition system, however, the unknown category of odor is always recognized as the known category of odor. In this paper, a kind of fuzzy algorithm for learning vector quantization (LVQ) is developed and used as a pattern classifier. In this type of fuzzy LVQ, the neuron activation is derived through fuzziness of the input data, so that the neural system could deal with the statistics of the measurement error directly. During learning, the similarity between the training vector and the reference vectors are calculated, and the winning reference vector is updated by shifting the central position of the fuzzy reference vector toward or away from the input vector, and by modifying its fuzziness. Two types of fuzziness modifications are used, i.e., a constant modification factor and a variable modification factor. This type of fuzzy-neuro (FN) LVQ is different in nature from fuzzy algorithm (FA) LVQ, and in this paper, the performance of FNLVQ network is compared with that of FALVQ in an artificial odor recognition system. Experimental results show that both FALVQ and FNLVQ could provide high recognition probability in determining various known categories of odors, however, the FNLVQ neural system has the ability to recognize the unknown category of odor that could not be recognized by the FALVQ neural system.

A fuzzy-soft learning vector quantization

This paper presents a batch competitive learning method called fuzzy-soft learning vector quantization (FSLVQ). The proposed FSLVQ is a batch type of clustering learning network by fusing the batch learning, soft competition and fuzzy membership functions. The comparisons between the well-known fuzzy LVQ and the proposed FSLVQ are made. In a series of designed simulations for the parameter estimations of normal mixtures, the performances including the accuracy (mean square error) and computational efficiency (number of iterations) are measured. FSLVQ shows good accuracy and high performance.