Abstract
This paper establishes a comprehensive theory of the optimality, robustness, and cross-validation selection-consistency for the ridge regression under factor-augmented models with possibly dense idiosyncratic information. Using spectral analysis for random matrices, we show that the ridge regression is asymptotically efficient in capturing both factor and idiosyncratic information, by minimizing the limiting predictive loss among the entire class of spectral regularized estimators under large-dimensional factor models and mixed-effects hypothesis. We derive an asymptotically optimal ridge penalty in closed form, and prove that a bias-corrected k-fold cross-validation procedure can select the best ridge penalty adaptively in large samples. We extend the theory to the autoregressive models with many exogenous variables and establish a consistent cross-validation procedure using the what-we-called double ridge regression method. Our results allow for non-parametric distributions for martingale difference errors and idiosyncratic random coefficients, and adapt to both the cross-sectional and temporal dependence structures of the large-dimensional predictors. A simulation study shows the efficiency of the ridge regression estimators under dense models and its robustness against sparsity. We apply our methods to forecast the growth rate of US industrial production and S\&P 500 index using the FRED-MD database. Our double ridge regression improves the autoregressive prediction and outperforms the principal component regression and the factor-adjusted LASSO regression consistently.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.