Cyclic behaviour and asymptotic stability of non-homogeneous Markov systems

Abstract

In this paper we study the cyclic behaviour of non-homogeneous Markov systems, i.e. the behaviour of the system under the assumption of periodic sequences of transition matrices, input probabilities, output probabilities and total numbers in the system. We provide a general theorem for the limiting structure of such a system under the cyclic behaviour. We also study the asymptotic stability of non-homogeneous Markov systems and theorems are given which characterize asymptotic stability. An application of the above results is given for a British firm, BS.