Abstract

Pseudo-marginal Markov chain Monte Carlo methods for sampling from intractable distributions have gained recent interest and have been theoretically studied in considerable depth. Their main appeal is that they are exact, in the sense that they target marginally the correct invariant distribution. However, the pseudo-marginal Markov chain can exhibit poor mixing and slow convergence towards its target. As an alternative, a subtly different Markov chain can be simulated, where better mixing is possible but the exactness property is sacrificed. This is the noisy algorithm, initially conceptualised as Monte Carlo within Metropolis, which has also been studied but to a lesser extent. The present article provides a further characterisation of the noisy algorithm, with a focus on fundamental stability properties like positive recurrence and geometric ergodicity. Sufficient conditions for inheriting geometric ergodicity from a standard Metropolis–Hastings chain are given, as well as convergence of the invariant distribution towards the true target distribution.Electronic supplementary materialThe online version of this article (doi:10.1007/s11222-015-9604-3) contains supplementary material, which is available to authorized users.

Highlights

  • 1.1 Intractable target densities and the pseudo-marginal algorithmSuppose our aim is to simulate from an intractable probability distribution π for some random variable X, which takes values in a measurable space (X, B(X ))

  • The noisy Markov kernels considered are perturbed Metropolis–Hastings kernels defined by a collection of state-dependent distributions for non-negative weights all with expectation 1

  • Two different sets of sufficient conditions were provided under which the noisy chain inherits geometric ergodicity from the marginal chain

Read more

Summary

Intractable target densities and the pseudo-marginal algorithm

Suppose our aim is to simulate from an intractable probability distribution π for some random variable X , which takes values in a measurable space (X , B(X )). 2009) falls into this category since it is a Metropolis–Hastings (MH) algorithm targeting a distribution π N , associated to the random vector (X, W ) defined on the product space (X × W, B(X ) × B(W)) where W ⊆ R+0 := [0, ∞). Andrieu and Roberts (2009), Andrieu and Vihola (2014, 2015), Doucet et al (2015), Girolami et al (2013), Maire et al (2014) and Sherlock et al (2015) These studies typically compare the pseudo-marginal Markov chain with a “marginal” Markov chain, arising in the case where all the weights are almost surely equal to 1, and (3) is the standard Metropolis–Hastings acceptance probability associated with the target density π and the proposal q

Examples of pseudo-marginal algorithms
The noisy algorithm
Objectives of the article
Outline of the paper
Homogeneous weights with a random walk proposal
Particle MCMC
Transient noisy chain with homogeneous weights
Transient noisy chain with non-homogeneous weights
Inheritance of ergodic properties
Conditions involving a negative moment
Conditions on the proposal distribution
Conditions for arithmetic averages
Remarks on results
Convergence of the noisy invariant distribution
Convergence in total variation
Discussion
E E min min
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call