The hyperpower family of iterative methods with arbitrary convergence order is one of the most used methods for estimating matrix inverses and generalized inverses, whereas the zeroing neural network (ZNN) is a type of neural dynamics developed to solve time-varying problems in science and engineering. Since the discretization of ZNN dynamics leads to the Newton iterative method for solving the matrix inversion and generalized inversion, this study proposes and investigates a family of ZNN dynamical models known as higher-order ZNN (HOZNN) models, which are defined on the basis of correlation with hyperpower iterations of arbitrary order. Because the HOZNN dynamical system requires error function powers, it is only applicable to square error functions. In this paper, we extend the original HOZNN dynamic flows to arbitrary time-dependent real matrices, both square and rectangular, and sign-bi-power activation is used to investigate the finite-time convergence of arbitrary order HOZNN dynamics. The proposed models are theoretically and numerically tested under three activation functions, and an application in solving the angle-of-arrival (AoA) localization problem demonstrates the effectiveness of the proposed design.