Online Bayesian learning in dynamic models: an illustrative introduction to particle methods

Abstract

This chapter provides a step-by-step review of Monte Carlo (MC) methods for filtering in general nonlinear and non-Gaussian dynamic models, also known as state-space models or hidden Markov models. The chapter is organized as follows. Section 11.2 introduces the basic notation, results, and references for the general class of Gaussian dynamic linear models (DLM), the AR(1) plus noise model, and the standard stochastic volatility model with AR(1) dynamics. Sections 11.3 and 11.4 discuss particle filters for state learning with fixed parameters (also known as pure filtering) and particle filters for state and parameter learning, respectively. Section 11.5 deals with general issues, such as MC error, sequential model checking, particle smoothing, and the interaction between particle filters and Markov chain Monte Carlo (MCMC) schemes.