Finite dams with inputs forming a Markov chain

Abstract

This paper considers a finite dam fed by inputs forming a Markov chain. Relations for the probability of first emptiness before overflow and with overflow are obtained and their probability generating functions are derived; expressions are obtained in the case of a three state transition probability matrix. An equation for the probability that the dam ever dries up before overflow is derived and it is shown that the ratio of these probabilities is independent of the size of the dam. A time dependent formula for the probability distribution of the dam content is also obtained.