Abstract

We investigate a Markov chain with a state space 1,2,…,r stopping at appearance of patterns consisting of two consecutive states. It is observed that the expected stopping times of the chain have surprising oscillating dependencies on starting positions. Analogously, the stopping probabilities also have oscillating dependencies on terminal states. In a nonstopping Markov chain the frequencies of appearances of two consecutive states are found explicitly.

Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call