The widely known “Energy Gap Law” (EGL) predicts a monotonically exponential increase in the non-radiative decay rate (knr) as the energy gap narrows, which hinders the development of near-infrared (NIR) emissive molecular materials. Recently, several experiments proposed that the exciton delocalization in molecular aggregates could counteract EGL to facilitate NIR emission. In this work, the nearly exact time-dependent density matrix renormalization group (TD-DMRG) method is developed to evaluate the non-radiative decay rate for exciton-phonon coupled molecular aggregates. Systematical numerical simulations show, by increasing the excitonic coupling, knr will first decrease, then reach a minimum, and finally start to increase to follow EGL, which is an overall result of two opposite effects of a smaller energy gap and a smaller effective electron-phonon coupling. This anomalous non-monotonic behavior is found robust in a number of models, including dimer, one-dimensional chain, and two-dimensional square lattice. The optimal excitonic coupling strength that gives the minimum knr is about half of the monomer reorganization energy and is also influenced by system size, dimensionality, and temperature.