Some results about randomized binary Markov chains: theory, computing and applications

Abstract

ABSTRACTThis paper is addressed to give a generalization of the classical Markov methodology allowing the treatment of the entries of the transition matrix and initial condition as random variables instead of deterministic values lying in the interval . This permits the computation of the first probability density function (1-PDF) of the solution stochastic process taking advantage of the so-called Random Variable Transformation technique. From the 1-PDF relevant probabilistic information about the evolution of Markov models can be calculated including all one-dimensional statistical moments. We are also interested in determining the computation of distribution of some important quantities related to randomized Markov chains (steady state, hitting times, etc.). All theoretical results are established under general assumptions and they are illustrated by modelling the spread of a technology using real data.