Approximate importance sampling Monte Carlo for data assimilation

Abstract

Importance sampling Monte Carlo offers powerful approaches to approximating Bayesian updating in sequential problems. Specific classes of such approaches are known as particle filters. These procedures rely on the simulation of samples or ensembles of the unknown quantities and the calculation of associated weights for the ensemble members. As time evolves and/or when applied in high-dimensional settings, such as those of interest in many data assimilation problems, these weights typically display undesirable features. The key difficulty involves a collapse toward approximate distributions concentrating virtually all of their probability on an implausibly few ensemble members. After reviewing ensembling, Monte Carlo, importance sampling and particle filters, we present some approximations intended to moderate the problem of collapsing weights. The motivations for these suggestions are combinations of (i) the idea that key dynamical behavior in many systems actually takes place on a low dimensional manifold, and (ii) notions of statistical dimension reduction. We illustrate our suggestions in a problem of inference for ocean surface winds and atmospheric pressure. Real observational data are used.