Fuzzy Perceptron Research Articles

Image Enhancement by Using Fuzzy Firefly Optimization and Fuzzy Perceptron Neural Network

The image enhancement methods play an important role in digital image processing. And by using a different kinds of image enhancement techniques, such as artificial intelligence techniques methods. The aim of this methods is to enhance the visual appearance of the digital image and to reduce image noise. In this paper, to enhance the corrupted image and de-noise image, we used swarm optimization algorithms such as a firefly algorithm (FA) and also used neural network such as the perceptron neural network algorithm (PNN). And then after we added the fuzzy membership function to these two algorithms, we obtained to a new method called a fuzzy firefly algorithm (FFA) and fuzzy perceptron neural network algorithm (FPNN). And was computed the performance and efficiency measures for all methods, such as RMSE and PSNR. And the FFA method was the best among the other methods used in this paper.

Uncertain fault diagnosis problem using neuro-fuzzy approach and probabilistic model for manufacturing systems

This paper is concerned with fault detection and diagnosis problem in manufacturing systems. In such industrial environment, production systems are subject to several faults caused by a number of factors including the environment, the accumulated wearing, usage, etc. However, due to the lack of accuracy or fluctuation of data, it is oftentimes impossible to evaluate precisely the correct classification rate of faults. In order to classify each type of fault, neural networks and fuzzy logic are two different intelligent diagnosis methods that are more applied now, and each has its own advantages and disadvantages. A new hybrid fault diagnosis approach is introduced in this paper that considers the combined learning algorithm and knowledge base (Fuzzy rules) to handle ambiguous and even erroneous information. Therefore, to enhance the classification accuracy, three perceptron models including: linear perceptron (LP), multilayer perceptron (MLP) and fuzzy perceptron (FP) have been respectively established and compared. The conditional risk function “PDF” that measures the expectation of loss when taking an action is presented at the same time. We evaluate the proposed hybrid approach “Variable Learning Rate Gradient Descent with Bayes’ Maximum Likelihood formula” VLRGD-BML on dataset of milk pasteurization process and compare our approach with other similar published works for fault diagnosis in the literature. Comparative results indicate the higher efficiency and effectiveness of the proposed approach with fuzzy perceptron for uncertain fault diagnosis problem.

Learning Algorithm for Fuzzy Perceptron with Max-Product Composition

Fuzzy neural networks is a powerful computational model, which integrates fuzzy systems with neural networks, and fuzzy perceptron is a kind of this neural networks. In this paper, a learning algorithm is proposed for a fuzzy perceptron with max-product composition, and the topological structure of this fuzzy perceptron is the same as conventional linear perceptrons. The inner operations involved in the working process of this fuzzy perceptron are based on the max-product logical operations rather than conventional multiplication and summation etc. To illustrate the finite convergence of proposed algorithm, some numerical experiments are provided.

AN FUZZY NEURAL APPROACH FOR MEDICAL IMAGE RETRIEVAL

Image retrieval based on a query image is necessary for effective and efficient use the information that is stored in medical image databases. Medical Image Retrieval is difficult as not only the localization and directionality of human visual system is to be considered but also the pathological condition. Image identification and segmentation for feature extraction pose a challenge to image retrieval process. Challenges posed include large number of images to be processed for the image retrieval and identifying the region of interest automatically to optimize the search. In this study, we propose a novel image segmentation algorithm Fuzzy Edge Detection and Segmentation (FEDS). The proposed FEDS algorithm is tested on medical images and for classification of images, a bell fuzzy multilayer perceptron is proposed. The proposed neural network Bell Fuzzy Multi Layer Perceptron (BF-MLP) Neural network is constructed by introducing a fuzzy logic in hidden layer with the sugeno model and bell function. The proposed neural network consists of two layers with the first layer being a tanh activation function and the second layer containing the bell fuzzy activation function. The proposed FEDS method was implemented using Matlab and Modelsim. A total of 44 images were considered with three class labels. The edge obtained for which segmentation is done using the proposed segmentation algorithm. The proposed BF-MLP neural network algorithm was implemented using Visual Studio and the classification accuracy compared with MLP Neural Network with sigmoid activation function. In this study, a fuzzy segmentation algorithm and a fuzzy classification algorithm is proposed to improve the medical image retrieval accuracy. The proposed segmentation algorithm, Fuzzy Edge Detection and Segmentation (FEDS), was implemented using Matlab and features were extracted using Fast Hartley Transform (FHT). The extracted features were used to train the proposed neural network, Bell Fuzzy Multi Layer Perceptron Neural Network (BF-MLP). 44 images with 3 class labels were used to test the algorithm and classification accuracy of 93.2% was obtained.

Tuning Fuzzy Perceptron using Parallelized Evolutionary Algorithms

Evolutionary computation can be used as independent instrument to establish the neural network weights. We assume that the network architecture is known. Some evolutionary algorithms as training procedures of fuzzy perceptron have been proposed before. In this paper, we presented a new hybridization between evolutionary algorithms (used as training procedures of fuzzy perceptron) and parallel algorithms. Using a high performance processor cluster with 28 nodes we will try to get better results in much smaller intervals of time. The kernels used to solve the problem are of the same type, they are eight on each node and each of them is working on the same frequency. The computational results show the validity of new approach in terms runtime, accuracy and flexibility.

APPLICATION OF GRAY SYSTEM THEORY IN MRI CLASSIFICATION

This article presents a new multispectral signature detection approach to magnetic resonance (MR) image classification. It is called the gray system theory (GST) method. In recent years, although GST has been used in various fields, applying the GST to medical images is very rare. The theoretical basis of GST is the gray hazy set; the main element is composed of an uncertain or abstract set and through a series of algorithms, the gray messages or phenomena are transformed into white ones. The concept of the theory is based on the information coverage, which establishes a new regular set based on source data and then the set is mapped to a 2D space. A series of experiments are conducted and compared to the commonly used fuzzy C-means (FCM) method, extension theory, and perceptron for performance evaluation. The results show that the GST method is a promising and effective spectral technique for MR image classification.

Time series pattern recognition using s-transform and soft computing

This paper presents a new approach to time series pattern classification using a modified wavelet transform for feature extraction of non-stationary time series data and a fuzzy multilayer perceptron network to generate the rules and classify the patterns. Also simple rule based event detection systems are used in a hybrid manner to classify all the categories of the non-stationary data that occur in a power distribution network during faults, sudden switching operations, and transient disturbances. The choice of modified wavelet transform known as multiresolution S-transform is essential for transient time series data of very short duration as they can not be handled by conventional Fourier and other transform methods for extraction of relevant features pertinent for temporal pattern recognition applications. The trained network infers the output class membership value of an input pattern and a certainty measure is also presented to facilitate rule generation. Several simulated data patterns along with the classification scores are presented in this paper.

Is bias dispensable for fuzzy neural networks?

It is well known that a conventional feedforward neural network always has bias terms, which is necessary for it to solve classification or approximation problems. But for fuzzy neural networks (FNNs), it seems not quite clear yet whether the bias is dispensable or not. Some authors introduce the bias, while the others do not. This note tries to partly answer this question for two simple building blocks of FNNs: fuzzy perceptron and max–min FNN. It is shown that the bias is basically dispensable for fuzzy perceptrons (max–min FNNs plus a sign function), which are usually used for classification. On the other hand, the bias is dispensable for max–min FNNs, which are used for both approximation and classification, if and only if a special condition is valid. But this special condition is generally not valid, or not easy to justify in practice. So the bias is generally indispensable for max–min FNNs.

An Empirical Evaluation of the Fuzzy Kernel Perceptron

J.-H. Chen and C.-S. Chen have recently proposed a nonlinear variant of Keller and Hunt's fuzzy perceptron algorithm, based on the now familiar "kernel trick." In this letter, we demonstrate experimentally that J.-H. Chen and C.-S. Chen's assertion that the fuzzy kernel perceptron (FKP) outperforms the support vector machine (SVM) cannot be sustained. A more thorough model comparison exercise, based on a much wider range of benchmark data sets, shows that the FKP algorithm is not competitive with the SVM.

Fuzzy kernel hyperball perceptron

Abstract In this paper the novel fuzzy kernel hyperball perceptron is presented. The proposed method first maps the input data into a high-dimensional feature space using some Mercer kernel function. Then, the decision function for each class is derived by the learning rules of the fuzzy kernel hyperball perceptron. The fuzzy membership functions, which resolve unclassifiable zones among classes, are incorporated into its classification algorithm to further enhance the perceptron’s adaptability and classification accuracy effectively. Unlike SVM, the fuzzy kernel hyperball perceptron has no convergence problem and avoids solving so-called quadratic programming problem which often makes SVM ineffective for large data sets. Especially, unlike the classical SVMs, we can directly utilize the fuzzy kernel hyperball perceptrons to solve multiclass problems, without using any pairwise combination. Our experimental results demonstrate its effectiveness.

Fuzzy kernel perceptron

A new learning method, the fuzzy kernel perceptron (FKP), in which the fuzzy perceptron (FP) and the Mercer kernels are incorporated, is proposed in this paper. The proposed method first maps the input data into a high-dimensional feature space using some implicit mapping functions. Then, the FP is adopted to find a linear separating hyperplane in the high-dimensional feature space. Compared with the FP, the FKP is more suitable for solving the linearly nonseparable problems. In addition, it is also more efficient than the kernel perceptron (KP). Experimental results show that the FKP has better classification performance than FP, KP, and the support vector machine.

뉴로-퍼지 모델을 이용한 항공다중분광주사기 영상의 지표면 분류

In this paper, we propose and apply new classification method to the remotely sensed image acquired from airborne multi-spectral scanner. This is a neuro-fuzzy image classifier derived from the generic model of a 3-layer fuzzy perceptron. We implement a classification software system with the proposed method for land cover image classification. Comparisons with the proposed and maximum-likelihood classifiers are also presented. The results show that the neuro-fuzzy classification method classifies more accurately than the maximum likelihood method. In comparing the maximum-likelihood classification map with the neuro-fuzzy classification map, it is apparent that there is more different as amount as 7.96% in the overall accuracy. Most of the differences are in the "Building" and "Pine tree", for which the neuro-fuzzy classifier was considerably more accurate. However, the "Bare soil" is classified more correctly with the maximum-likelihood classifier rather than the neuro-fuzzy classifier.

선형분류 경계면을 찾기위한 Interval 제2종 퍽지퍼셉트론

This paper presents an interval type-2 fuzzy perceptron algorithm that is an extension of the type-1 fuzzy perceptron algorithm proposed in [1]. In our proposed method, the membership values for each pattern vector are extended as interval type-2 fuzzy memberships by assigning uncertainty to the type-1 memberships. By doing so, the decision boundary obtained by interval type-2 fuzzy memberships can converge to a more desirable location than the boundary obtained by crisp and type-1 fuzzy perceptron methods. Experimental results are given to show the effectiveness of our method.

Fuzzy perceptron neural networks for classifiers with numerical data and linguistic rules as inputs

This paper presents a novel learning algorithm of fuzzy perceptron neural networks (FPNNs) for classifiers that utilize expert knowledge represented by fuzzy IF-THEN rules as well as numerical data as inputs. The conventional linear perceptron network is extended to a second-order one, which is much more flexible for defining a discriminant function. In order to handle fuzzy numbers in neural networks, level sets of fuzzy input vectors are incorporated into perceptron neural learning. At different levels of the input fuzzy numbers, updating the weight vector depends on the minimum of the output of the fuzzy perceptron neural network and the corresponding nonfuzzy target output that indicates the correct class of the fuzzy input vector. This minimum is computed efficiently by employing the modified vertex method. Moreover, the fuzzy pocket algorithm is introduced into our fuzzy perceptron learning scheme to solve the nonseparable problems. Simulation results demonstrate the effectiveness of the proposed FPNN model.

Hybrid modeling approach to on-line estimation of yeast biomass concentration in industrial bioreactor

The industrial fed-batch yeast cultivation process has been divided into four different metabolic phases (adaptation, carbon limited, oxygen limited and maturation) by a neuro-fuzzy classification model that consists of 4 applied linguistic rules on 2 state variables: oxygen uptake rate and liquid volume. The membership functions have been automatically adapted by this fuzzy perceptron, i.e., by a supervised learning algorithm initialized by prior operator's knowledge. Process compartmentalization has made easier and more realistic a subsequent state estimation of the biomass concentration with separate artificial neural networks combined with balance equations. Static networks with local recurrent memory structures were used, and the inputs were standard cultivation state variables: respiratory quotient, molasses feed rate, ethanol concentration, etc. This hybrid approach is generally applicable to state estimation or prediction when different sources of process information and knowledge have to be integrated.

An Investigation of the Effects of Variable Vigilance within the RePART Neuro-Fuzzy Network

RePART is a variation of fuzzy ARTMAP to which a reward/punishment concept has been added. Previously, an improvement in performance of RePART had been noted compared with other ARTMAP-based models, such as fuzzy ARTMAP and ARTMAP-IC. In this paper, a wider investigation of RePART performance is described, in which RePART is analysed in relation to a multi-layer perceptron and a RAM-based network in a handwritten numeral recognition task. In the RePART network, a variable vigilance parameter is proposed in order to smooth the poor-generalisation problem of RePART. Firstly, the same vigilance is associated within every neuron – general variable vigilance. Secondly, an individual variable vigilance for each neuron – which takes into account its average and frequency of activation – is used. In a handwritten numeral recognition task using individual variable vigilance, RePART performance improved and demonstrated a performance comparable with alternative architectures such as fuzzy multi-layer perceptron and Radial RAM.

Novel neural algorithms based on fuzzy δ rules for solving fuzzy relation equations: Part III

In our previous work (Li and Ruan, 1997) we proposed a max–min operator network and a series of training algorithms, called fuzzy δ rules, which could be used to solve fuzzy relation equations. The most basic and important result is the convergence theorem of fuzzy perceptron based on max–min operators. This convergence theorem has been extended to the max-times operator network in (Li and Ruan 1997). In this paper, we will further extend the fuzzy δ rule and its convergence theorem to the case of max- ∗ operator network in which ∗ is a t-norm. An equivalence theorem points out that the neural algorithm in solving this kind of fuzzy relation equations is equivalent to the fuzzy solving method (non-neural) in Di Nola et al. (1984) and Gottwald (1984). The proof and simulation will be given.

SPEAKER ADAPTATION OF FUZZY-PERCEPTRON-BASED SPEECH RECOGNITION

In this paper, we propose a speech recognition algorithm which utilizes hidden Markov models (HMM) and Viterbi algorithm for segmenting the input speech sequence, such that the variable-dimensional speech signal is converted into a fixed-dimensional speech signal, called TN vector. We then use the fuzzy perceptron to generate hyperplanes which separate patterns of each class from the others. The proposed speech recognition algorithm is easy for speaker adaptation when the idea of "supporting pattern" is used. The supporting patterns are those patterns closest to the hyperplane. When a recognition error occurs, we include all the TN vectors of the input speech sequence with respect to the segmentations of all HMM models as the supporting patterns. The supporting patterns are then used by the fuzzy perceptron to tune the hyperplane that can cause correct recognition, and also tune the hyperplane that resulted in wrong recognition. Since only two hyperplane need to be tuned for a recognition error, the proposed adaptation scheme is time-economic and suitable for on-line adaptation. Although the adaptation scheme cannot ensure to correct the wrong recognition right after adaptation, the hyperplanes are tuned in the direction for correct recognition iteratively and the speed of adaptation can be adjusted by a "belief" parameter set by the user. Several examples are used to show the performance of the proposed speech recognition algorithm and the speaker adaptation scheme.

Rough knowledge-based network, fuzziness and classification

A method of integrating rough sets and fuzzy multilayer perceptron (MLP) for designing a knowledge-based network for pattern recognition problems is described. Rough set theory is used to extract crude knowledge from the input domain in the form of rules. The syntax of these rules automatically determines the optimal number of hidden nodes while the dependency factors are used in the initial weight encoding. Results on classification of speech data demonstrate the superiority of the system over the fuzzy and conventional versions of the MLP.

Fuzzy neural network for invariant optical pattern recognition

A novel fuzzy neural network (FNN) model for invariant pattern recognition is presented that combines fuzzy set reasoning and artificial neural network techniques. The presented FNN consists of three blocks: fuzzifier, fuzzy perceptron, and defuzzifier. It fuzzifies the input patterns and trains the interconnection weights according to membership functions instead of traditional binary values. The proposed FNN has been applied to 2-D binary-image pattern recognition under shift and some other types of distortions. In comparison with the classical multilayer perceptron, the FNN possesses a higher recognition rate and is more robust to input distortions.