A method for studying the integral functionals of stochastic processes with applications: I. Markov chain case

Abstract

The subject of this paper is the study of the distribution of integrals of the type where {X(t); t ≧ 0} is some appropriately defined continuous-time parameter stochastic process, and f is a suitable non-negative function of its arguments. This subject has also sometimes been labelled as “the occupation time or the sojourn time problem” in literature. These integrals arise in several domains of applications such as in the theory of inventories and storage (see Moran [14], Naddor [15]), in the study of the cost of the flow-stopping incident involved in the automobile traffic jams (see Gaver [8], Daley [3], Daley and Jacobs [4]). The author encountered such integrals while studying certain stochastic models suitable for the study of response time distributions arising in various live situations. In fact in [19], it was shown that such a distribution is equivalent to the study of an integral of the type (1). Again, in the study of response of host to injection of virulent bacteria, Y(t) with f(X(t), t) = bX(t), with b > 0, could be regarded as a measure of the total amount of toxins produced by the bacteria during (0, t), assuming a constant toxin-excretion rate per bacterium. Here X(t) denotes the number of live bacteria at time t, the growth of which is governed by a birth and death process (see Puri [16], [17] and [18]).