An invariant subspace approach in m/g/l and g/m/l type markov chains

Abstract

Let , be a sequence ofmtimes;mnonnegative matrices and let be such that A(1) is an irreducible stochastic matrix. The unique power-bounded solution of the nonlinear matrix equation has been shown to play a key role in the analysis of Markov chains of M/G/l type. Assuming that the matrix A(z) is rational, we show that the solution of this matrix equation reduces to finding an invariant subspace of a certain matrix. We present an iterative method for computing this subspace which is globally convergent. Moreover, the method can be implemented with quadratic or higher convergence rate matrix sign function iterations, which brings in a new dimension to the analysis of M/G/l type Markov chains for which the existing algorithms may suffer from low linear convergence rates. The method can be viewed as a “ bridge ” between the matrix analytic methods and transform techniques whereas it circumvents the requirement for a large number of iterations which may be encountered in the methods of the former type and the root finding problem of the techniques of the latter type. Similar results are obtained for computing the unique power-summable solution of the matrix equation which appears in the analysis of G/M/l type Markov chains