Penalized Likelihood-type Estimators for Generalized Nonparametric Regression

Abstract

We consider the asymptotic analysis of penalized likelihood type estimators for generalized nonparametric regression problems in which the target parameter is a vector-valued function defined in terms of the conditional distribution of a response given a set of covariates. A variety of examples including ones related to generalized linear models and robust smoothing are covered by the theory. Linear approximations to the estimator are constructed using Taylor expansions in Hilbert spaces. An application which is treated is upper bounds on rates of convergence for the penalized likelihood-type estimators.