Adaptive two-layer ReLU neural network: II. Ritz approximation to elliptic PDEs

Abstract

In the companion paper [1], we introduce adaptive network enhancement (ANE) method for the best least-squares approximation to a target function by using two-layer ReLU neural networks (NNs). In this paper, we apply the ANE method for solving self-adjoint second-order elliptic partial differential equations (PDEs). The underlying PDE is discretized by the Ritz method using a two-layer spline neural network based on either the primal or dual formulations that minimize the respective energy or complimentary functionals. Essential boundary conditions are imposed weakly through the functionals with proper norms. It is proved that the Ritz approximation is the best approximation in the energy norm; moreover, effect of numerical integration for the Ritz approximation is analyzed as well. Two estimators for adaptive neuron enhancement method are introduced, one is the so-called recovery estimator and the other is the least-squares estimator. Finally, numerical results for diffusion problems with either corner or intersecting interface singularities are presented.