Abstract

Abstract We present an approximation for the stationary distribution T of a countably infinite-state Markov chain with transition probability matrix P = (pq) of upper Hessenberg form. Our approximation makes use of an associated upper Hessenberg matrix which is spatially homogeneous one P ( ~ ) except for a finite number of rows obtained by letting p q = pj-i+l, i > N + 1, for some distribution p = {pj } with mean p 1. We prove that there exists an optimal p, say p*(N) with which our method provides exact probabilities up to the level N . However, in general to find this optimal p*(N) is practically impossible unless one has the exact distribution v . Therefore, we propose a number of approximations to p* (N) and prove that a better approximation than that given by finite truncation methods can be obtained in the sense of smaller li-distance between exact distribution of its approximation. Numerical experiments are implemented for the M/h4/ l retrial queue.

Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.