Abstract
Recently, some nonparametric regression ideas have been extended to the case of functional regression. Within that framework, the main concern arises from the infinite dimensional nature of the explanatory objects. Specifically, in the classical multivariate regression context, it is well-known that any nonparametric method is affected by the so-called “curse of dimensionality”, caused by the sparsity of data in high-dimensional spaces, resulting in a decrease in fastest achievable rates of convergence of regression function estimators toward their target curve as the dimension of the regressor vector increases. Therefore, it is not surprising to find dramatically bad theoretical properties for the nonparametric functional regression estimators, leading many authors to condemn the methodology. Nevertheless, a closer look at the meaning of the functional data under study and on the conclusions that the statistician would like to draw from it allows to consider the problem from another point-of-view, and to justify the use of slightly modified estimators. In most cases, it can be entirely legitimate to measure the proximity between two elements of the infinite dimensional functional space via a semi-metric, which could prevent those estimators suffering from what we will call the “curse of infinite dimensionality”.
Highlights
Consider the classical multivariate regression model Y = m(X) + ε, (1.1)where Y is a scalar response, X a p-dimensional vector of continuous covariates, m(·) a smooth function from Rp to R, and ε a random disturbance such that E(ε|X) = 0 almost surely
This unacceptable logarithmic rate, consequence of what we could call the curse of infinite dimensionality, has brought many authors to forget about nonparametric estimators for functional regression
The introduction of semi-norms as proximity measures is often presented as a technical tool used for dimension reduction purposes, in order to get around the curse of infinite dimensionality; see the closely related work of [16]
Summary
In light of the usual observations related to the curse of dimensionality in the multivariate setting, this extreme sparsity of data in the functional space of interest is expected to yield poor theoretical properties for the estimator (2.1), and it can be shown that the rate of convergence of μtoward μ is of order (log n)−γ, for some γ > 0. This unacceptable logarithmic rate, consequence of what we could call the curse of infinite dimensionality, has brought many authors to forget about nonparametric estimators for functional regression.
Published Version (
Free)
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have