State aggregation and discrete-state Markov chains embedded in a class of point processes

Abstract

One result that is of both theoretical and practical importance regarding point processes is the method of thinning. The basic idea of this method is that under some conditions, there exists an embedded Poisson process in any point process such that all its arrival points form a sub-sequence of the Poisson process. We extend this result by showing that on the embedded Poisson process of a uni- or multi-variable marked point process in which interarrival time distributions may depend on the marks, one can define a Markov chain with a discrete state that characterizes the stage of the interarrival times. This implies that one can construct embedded Markov chains with countable state spaces for the state processes of many practical systems that can be modeled by such point processes.