Abstract

In this paper we consider some questions of the theory and practice of mean first passage time quasi-metric, a generalized metric structure closely related to ergodic homogeneous Markov chains. In particular, we consider the structure and properties of mean first passage time quasimetrics based on several graph models, including simple cycles, simple paths and their oriented analogues. The introduction contains the history of the problem and provides an overview of the main ideas and results presented in the article. The second section gives basic concepts of the theory of Markov chains. In fact, a Markov chain is a mathematical model of some random process describing a sequence of possible events in which the probability of each event depends only on the state attained in the previous event. This section collects basic definitions needed to consider the role of graph models in the presentation and study of ergodic homogeneous Markov chains. The Markov chain can be depicted as an oriented weighted graph of transitions whose vertices correspond to the states of the chain and the arcs correspond to the transitions between them. The process will be ergodic if this weighted oriented graph is weakly connected, and the largest common divisor of the lengths of all its cycles is equal to 1. On the other hand, any connected graph can be used as a basis for building a model of the simplest Markov chain: if a vertex 𝑖 has degree 𝑘, all incident edges are converted into arcs with the weights 1/𝑘 . Moreover, in the second section the definition of the mean first passage time for an ergodic homogeneous Markov chain is given. The algorithm of finding the mean first passage time is analyzed in detail by using converging trees of the oriented graph, related to the transition matrix of the ergodic homogeneous Markov chain. At last, a mean first passage time is analyzed as the quasi-metric 𝑚 of mean first passage time on the vertices 𝑉 = {1, 2, ..., 𝑛} of the oriented graph corresponding to the transition matrix of a given ergodic homogeneous Markov chain: 𝑚(𝑖, 𝑗) is the expected number of steps (arcs) for random wandering on the oriented graph Γ, starting at 𝑖, to reach 𝑗 for the first time. This quasi-metric has a number of important theoretical and applied properties. The third section deals with the construction and research of mean first passage time quasimetrics for the undirected cycles 𝐶𝑛, 𝑛 ≥ 3. Examples of constructions of mean first passage time quasi-metrics of undirected cycles for small values of 𝑛 are considered. Illustrations of the ”graphical“ procedure of building the matrix 𝑀 are given. Properties of the resulting generalized metric structures are analyzed. In the fourth section, similar considerations for mean first passage time quasi-metrics of the undirected paths 𝑃𝑛, 𝑛 ≥ 2, are represented. The fifth section deals with the construction and research of mean first passage time quasimetrics for the directed (oriented) cycles 𝐶𝑛, 𝑛 ≥ 3. Examples of constructions of mean first passage time quasi-metrics of undirected (oriented) cycles for small values of 𝑛 are considered. Illustrations of the ”graphical“ procedure of building the matrix 𝑀 are given. Properties of the resulting generalized metric structures are analyzed. In the sixth section, similar considerations for mean first passage time quasi-metrics of the directed (oriented) paths 𝑃𝑛, 𝑛 ≥ 2, are represented. In the conclusion, the results of the work are summed up and possible directions of further research are outlined.

Highlights

  • N the second section the definition of the mean first passage time for an ergodic homogeneous Markov chain is given

  • Марковская цепь называется эргодической, если для каждого i = 1, . . . , k существует предел lim n−→∞

  • On quasi-metric spaces // American Journal of Mathematics

Read more

Summary

Квазиметрики на графах

В статье рассмотрены свойства квазиметрики среднего времени первого прохода Дано определение среднего времени первого прохода для однородной эргодической цепи Маркова. Проанализирован алгоритм нахождения среднего времени первого прохода с помощью использования сходящихся деревьев ориентированного графа, связанного с матрицей перехода эргодической однородной цепи. В третьем разделе рассмотрены вопросы построения и исследования квазиметрики среднего времени первого прохода для неориентированного цикла Cn, n ≥ 3. Рассмотрены примеры построения квазиметрики среднего времени первого прохода для неориентированного цикла для малых значений n. В четвертом разделе аналогичные рассуждения проведены для квазиметрики среднего времени первого прохода для неориентированного пути Pn, n ≥ 2. В пятом разделе рассмотрены вопросы построения и исследования квазиметрики среднего времени первого прохода для ориентированного цикла −C→n, n ≥ 3. Рассмотрены примеры построения квазиметрики среднего времени первого прохода для ориентированного цикла для малых значений n. Квазиметрики на графах // Чебышевcкий сборник, 2021, т. 22, вып. 2, с. 48–75

Основные понятия теории цепей Маркова
Представление цепей Маркова графовыми моделями
Среднее время первого прохода для цепей Маркова
Среднее время первого прохода как квазиметрика орграфа
Неориентированный цикл на четырех вершинах
Так как
Неориентированный цикл на пяти вершинах
Неориентированный путь на двух вершинах
Неориентированный путь на трех вершинах
Неориентированный путь на четырех вершинах
Пользуясь определением сходящихся дерева орграфа
Ориентированный цикл на четырех вершинах четырех вершинах
Ориентированный цикл на пяти вершинах пяти вершинах
Поскольку в случае орграфа
СПИСОК ЦИТИРОВАННОЙ ЛИТЕРАТУРЫ
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call