Randomizing the parameters of a Markov chain to model the stroke disease: A technical generalization of established computational methodologies towards improving real applications

Abstract

Classical Markov models are defined through a stochastic transition matrix, i.e., a matrix whose columns (or rows) are deterministic values representing transition probabilities. However, in practice these quantities could often not be known in a deterministic manner, therefore, it is more realistic to consider them as random variables. Following this approach, this paper is aimed to give a technical generalization of classical Markov methodology in order to improve modelling of stroke disease when dealing with real data. With this goal, we randomize the entries of the transition matrix of a Markov chain with three states (susceptible, reliant and deceased) that has been previously proposed to model the stroke disease. This randomization of the classical Markov model permits the computation of the first probability density function of the solution stochastic process taking advantage of the so-called Random Variable Transformation technique. Afterwards, punctual and probabilistic predictions are computed from the first probability density function. In addition, the probability density functions of the time instants until a certain proportion of the total population remains susceptible, reliant and deceased are also computed. The study is completed showing the usefulness of our computational approach to determine, from a probabilistic point of view, key quantities in medical decision making, such as the cost-effectiveness ratio. • A randomization of a Markov model for study the stroke is proposed. • Random Variable Transformation method gives a probabilistic solution of the model. • First probability density of the solution to randomized Markov model is determined. • Time until a certain proportion of susceptibles remains in the population is given. • Key quantities in medical decision making are determined.