Design of Iterative Fuzzy Radial Basis Function Neural Networks Based on Iterative Weighted Fuzzy C-Means Clustering and Weighted LSE Estimation

Abstract

In this article, a reinforced iterative fuzzy radial basis function neural networks (IFRBFNN) is introduced as an augmented FRBFNN architecture generated through the iterative refinement process of weighted fuzzy C-means (WFCM) clustering and weighted least square error estimation. It is well known that the location of the clusters have an effect on the classification performance of the FRBFNN. The underlying idea behind this article is how to define the center points of clusters based on the data distribution analysis as well as the improvement of classification performance. In a nutshell, while the fuzzy C-means clustering to define the positions of radial basis functions (RBFs) based in the unsupervised learning manner is usually used in a FRBFNN, the parameters (cluster centers and their ensuing polynomial coefficients) refinement of FRBFNN through the proposed iterative method lead to superb classification performance by relocating the positions of RBFs over the input space implied by supervised learning. The idea of the proposed approach is to relocate the centers (prototypes) of the fuzzy clusters by using WFCM clustering algorithm and to re-estimate the coefficients by weighted least square estimation with the aid of the cross-entropy loss values of data so that the classification performance is improved. The weight related to each data is determined by some auxiliary information (i.e., the modified version of the cross-entropy loss value of each data). When it comes to the estimation of the coefficients of the consequent polynomial in IFRBFNN, they are estimated by the weighted least square error estimation technique, where the weights of the coefficients are defined based on the cross-entropy loss values. The auxiliary information such as the weights for relocation of the centers of RBFs and the weights for the re-estimation of the polynomial coefficients should be defined from the viewpoint of enhancement of the classification performance. The cross-entropy loss value of each data is able to meet the necessity of the required supervision signal. Several numerical experiments are provided to demonstrate the usefulness of the proposed design method for the FRBFNN for classification problems.