Neural networks for optimal approximation of continuous functions in ℝ d

Abstract

Using some regular matrices we present a method to express any multivariate alge- braic polynomial of total order n in a normal form. Consequently, we prove constructively that, to approximate continuous target functions defined on some compact set of R d ,n eural networks are at least as good as algebraic polynomials.