Abstract

Radial basis function (RBF) networks are widely adopted to solve problems in the field of pattern classification. However, in the construction phase of such networks, there are several issues encountered, such as the determination of the number of nodes in the hidden layer, the form and initialization of the basis functions, and the learning of the parameters involved in the networks. In this paper, we present a novel approach for constructing RBF networks for pattern classification problems. An iterative self-constructing clustering algorithm is used to produce a desired number of clusters from the training data. Accordingly, the number of nodes in the hidden layer is determined. Basis functions are then formed, and their centers and deviations are initialized to be the centers and deviations of the corresponding clusters. Then, the parameters of the network are refined with a hybrid learning strategy, involving hyperbolic tangent sigmoid functions, steepest descent backpropagation, and least squares method. As a result, optimized RBF networks are obtained. With this approach, the number of nodes in the hidden layer is determined and basis functions are derived automatically, and higher classification rates can be achieved. Furthermore, the approach is applicable to construct RBF networks for solving both single-label and multi-label pattern classification problems.

Highlights

  • Pattern classification is a process related to categorization, concerned with classifying patterns into one or more categories

  • The parameters of the network are refined with a hybrid learning strategy, involving hyperbolic tangent sigmoid functions, steepest descent backpropagation and least squares method

  • The codes of ML-k-nearest neighbors (KNN), MLPC, and ML-SVC are downloaded from the scikitlearn library, while the codes of ML-Radial basis function (RBF) is downloaded from the public domain: http://cse.seu.edu.cn/people/zhangml/resources.htm

Read more

Summary

Introduction

Pattern classification is a process related to categorization, concerned with classifying patterns into one or more categories. As pointed out in [34,35], in the construction phase of such networks, there are several issues encountered, such as the determination of the number of nodes in the hidden layer, the form and initialization of the basis functions, and the learning of the parameters involved in the networks. We present a novel approach for constructing RBF networks for pattern classification problems. The number of nodes in the hidden layer is determined and basis functions are derived automatically, and higher classification rates can be achieved through the hybrid learning process. The approach is applicable to construct RBF networks for solving both single-label and multi-label pattern classification problems. An iterative self-constructing clustering algorithm is applied to determine the number of hidden nodes and associated basis functions.

Related Work
Proposed Approach n o
Network Setup Phase
Initialization of Basis Functions
Initialization of Weights and Biases
Parameter Refinement Phase
Centers and Deviations
Weights and Biases
Experimental Results
Experiment 1—Single-Label Data Sets
Experiment 2—Multi-Label Data Sets
Discussions
Concluding Remarks

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.