Asymptotic expansions on moments of the first ladder height in Markov random walks with small drift

Abstract

Let {(Xn, Sn), n ≥ 0} be a Markov random walk in which Xn takes values in a general state space and Sn takes values on the real line R. In this paper we present some results that are useful in the study of asymptotic approximations of boundary crossing problems for Markov random walks. The main results are asymptotic expansions on moments of the first ladder height in Markov random walks with small positive drift. In order to establish the asymptotic expansions we study a uniform Markov renewal theorem, which relates to the rate of convergence for the distribution of overshoot, and present an analysis of the covariance between the first passage time and the overshoot.