Abstract

Let $P$ be the transition matrix of a finite, irreducible and reversible Markov chain. We say the continuous time Markov chain $X$ has transition matrix $P$ and speed $\lambda $ if it jumps at rate $\lambda $ according to the matrix $P$. Fix $\lambda _X,\lambda _Y,\lambda _Z\geq 0$, then let $X,Y$ and $Z$ be independent Markov chains with transition matrix $P$ and speeds $\lambda _X,\lambda _Y$ and $\lambda _Z$ respectively, all started from the stationary distribution. What is the chance that $X$ and $Y$ meet before either of them collides with $Z$? For each choice of $\lambda _X,\lambda _Y$ and $\lambda _Z$ with $\max (\lambda _X,\lambda _Y)>0$, we prove a lower bound for this probability which is uniform over all transitive, irreducible and reversible chains. In the case that $\lambda _X=\lambda _Y=1$ and $\lambda _Z=0$ we prove a strengthening of our main theorem using a martingale argument. We provide an example showing the transitivity assumption cannot be removed for general $\lambda _X,\lambda _Y$ and $\lambda _Z$.

Highlights

  • Consider three independent random walks X, Y, Z over the same finite connected graph

  • What is the probability that X, Y meet at the same vertex before either of them meets Z? If the initial distributions of the three walkers are the same, this probability is at least 1/3 by symmetry, at least if we assume that ties are broken symmetrically

  • What is the probability that X and Y meet before hitting Z? There are several examples of bounds [1, 4, 5] relating the meeting time of two random walks to the hitting time of a fixed vertex by a single random walk

Read more

Summary

Introduction

Consider three independent random walks X, Y, Z over the same finite connected graph. If the initial distributions of the three walkers are the same, this probability is at least 1/3 by symmetry, at least if we assume that ties (i.e. triple meetings) are broken symmetrically. There are several examples of bounds [1, 4, 5] relating the meeting time of two random walks to the hitting time of a fixed vertex by a single random walk. These typically provide upper bounds for meeting times in terms of worst-case or average hitting times, sometimes up to constant factors.

Main results
Towards the theorem for general speeds
Small time estimates for hitting times
The occupation time identity
Non transitive chains
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call