Universal approximation by radial basis function networks of Delsarte translates

Abstract

We prove that, under certain mild conditions on the kernel function (or activation function), the family of radial basis function neural networks obtained by replacing the usual translation with the Delsarte one, and taking the same smoothing factor in all kernel nodes, has the universal approximation property.