Abstract

We study Bayes procedures for nonparametric regression problems with Gaussian errors, giving conditions under which a Bernstein-von Mises result holds for the marginal posterior distribution of the error standard deviation. We apply our general results to show that a single Bayes procedure using a hierarchical spline-based prior on the regression function and an independent prior on the error variance, can simultaneously achieve adaptive, rate-optimal estimation of a smooth, multivariate regression function and efficient, n−√-consistent estimation of the error standard deviation.

Highlights

  • We study Bayes procedures for nonparametric regression problems with Gaussian errors, giving conditions under which a Bernstein–von Mises result holds for the marginal posterior distribution of the error standard deviation

  • We apply our general results to show that a single Bayes procedure using a hierarchical spline-based prior on the regression function and an independent prior on the error variance, can simultaneously achieve adaptive, rate-optimal estimation of a smooth, multivariate regression function and efficient, √n-consistent estimation of the error standard deviation

  • In this paper we study the asymptotic behavior of the marginal posterior for the error standard deviation in a nonparametric, fixed design regression model with Gaussian errors

Read more

Summary

Introduction

In this paper we study the asymptotic behavior of the marginal posterior for the error standard deviation in a nonparametric, fixed design regression model with Gaussian errors. We give details for two specific popular families of Gaussian priors: multiply integrated Brownian motions and the class of Matern processes In both cases we find that BvM holds if the prior is rough enough relative to the degree of smoothness of the true regression function f0. In De Jonge and Van Zanten (2012) it was shown that when properly constructed, such a prior yields adaptive, nearly rate-optimal estimation of a smooth regression function f. We investigate this prior in this paper because we are interested in the question whether or not we can have adaptive estimation of f and BvM for σ at the same time. This result is essentially known, but a proof has never been published

Prelude
Semiparametric Bernstein–von Mises
General Gaussian priors
Specific Gaussian priors
Matern prior
Riemann-Liouville prior
Hierarchical spline-based priors
Proof of the general theorem
Statement of the result
Proof of the theorem
Lower bound for the denominator
Term I
Findings
Term II
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call