Abstract

We consider a Markov process in continuous time with a finite number of discrete states. The time-dependent probabilities of being in any state of the Markov chain are governed by a set of ordinary differential equations, whose dimension might be large even for trivial systems. Here, we derive a reduced ODE set that accurately approximates the probabilities of subspaces of interest with a known error bound. Our methodology is based on model reduction by balanced truncation and can be considerably more computationally efficient than solving the chemical master equation directly. We show the applicability of our method by analysing stochastic chemical reactions. First, we obtain a reduced order model for the infinitesimal generator of a Markov chain that models a reversible, monomolecular reaction. Later, we obtain a reduced order model for a catalytic conversion of substrate to a product (a so-called Michaelis-Menten mechanism), and compare its dynamics with a rapid equilibrium approximation method. For this example, we highlight the savings on the computational load obtained by means of the reduced-order model. Furthermore, we revisit the substrate catalytic conversion by obtaining a lower-order model that approximates the probability of having predefined ranges of product molecules. In such an example, we obtain an approximation of the output of a model with 5151 states by a reduced model with 16 states. Finally, we obtain a reduced-order model of the Brusselator.

Highlights

  • Markov chains are dynamical systems that model a broad spectrum of physical, biological, and engineering systems

  • Once the reduced model is obtained, the time required for its numerical solution is significantly smaller compared to the time required for the numerical solution of the full chemical master equation (CME). To illustrate this reduction on the computational time, we obtained the CME of the reaction network (28) with an equal initial number of molecules for the substrate and enzyme and zero molecules for the rest of the species; later, we obtained the reduced order model via balanced realisation, which represents the state of total conversion of the substrate to the product; and we compared the time required for obtaining the numerical solution of the full CME and the reduced model with the expression g~ log10

  • In this paper we addressed the order reduction of the infinitesimal generator of a homogeneous, continuous-time, finite and discrete state-space Markov chain via the reduction of its balanced realisation

Read more

Summary

Introduction

Markov chains are dynamical systems that model a broad spectrum of physical, biological, and engineering systems. We obtain a reduced order model that approximates the probability of being in selected states of the underlying Markov chain.

Results
Conclusion
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.