An Improved Radial Basis Function Neuron Network Based on the l1 Regularization

Abstract

The radial basis function neural network (RBFNN) is a widely used tool for interpolation and prediction problems. In this paper, we propose to improve the traditional RBFNN by automatically identifying core neurons in the hidden layer, based on the [Formula: see text] regularization. Our proposed approach will greatly reduce the number of neurons required, which will save the memory and also the computational cost. To determine the radial parameter [Formula: see text] in the RBFs, we propose to use the [Formula: see text]-fold cross-validation method. Moreover, the principal component analysis (PCA) method is used to reconstruct the distance between samples for high-dimensional data sets. Numerical experiments are provided to demonstrate the effectiveness of the proposed approach.