Conditioning out rare events for exponential families has negligible effect on inference

Abstract

ABSTRACTSuppose that we observe X ∼Binomial(n, p). Inference on p is difficult if X = 0 or n. One way around this is to condition on these events not happening. We show that this has only an exponentially small effect on its cumulants. This is also true if we condition away other rare events. Our results are presented for exponential families, with applications to the binomial, multinomial and negative multinomial distributions.