Variable selection and parameter estimation for partially linear models via Dantzig selector

Abstract

Variable selection plays an important role in the high dimensionality data analysis, the Dantzig selector performs variable selection and model fitting for linear and generalized linear models. In this paper we focus on variable selection and parametric estimation for partially linear models via the Dantzig selector. Large sample asymptotic properties of the Dantzig selector estimator are studied when sample size n tends to infinity while p is fixed. We see that the Dantzig selector might not be consistent. To remedy this drawback, we take the adaptive Dantzig selector motivated by Dicker and Lin (submitted). Moreover, we obtain that the adaptive Dantzig selector estimator for the parametric component of partially linear models has the oracle properties under some appropriate conditions. As generalizations of the Dantzig selector, both the adaptive Dantzig selector and the Dantzig selector optimization can be implemented by the efficient algorithm DASSO proposed by James et al. (J R Stat Soc Ser B 71:127–142, 2009). Choices of tuning parameter and bandwidth are also discussed.