New Statistical Residuals for Regression Models in the Exponential Family: Characterization, Simulation, Computation, and Applications

Abstract

Residuals are essential in regression analysis for evaluating model adequacy, validating assumptions, and detecting outliers or influential data. While traditional residuals perform well in linear regression, they face limitations in exponential family models, such as those based on the binomial and Poisson distributions, due to heteroscedasticity and dependence among observations. This article introduces a novel standardized combined residual for linear and nonlinear regression models within the exponential family. By integrating information from both the mean and dispersion sub-models, the new residual provides a unified diagnostic tool that enhances computational efficiency and eliminates the need for projection matrices. Simulation studies and real-world applications demonstrate its advantages in efficiency and interpretability over traditional residuals.