Stochastic Models Of Gene Expression Research Articles

Probabilistic and Piecewise Deterministic models in Biology

We present recent results on Piecewise Deterministic Markov Processes (PDMPs), involved in biological modeling. PDMPs, first introduced in the probabilistic literature by Davis (1984), are a very general class of Markov processes and are being increasingly popular in biological applications. They also give new interesting challenges from the theoretical point of view. We give here different examples on the long time behavior of switching Markov models applied to population dynamics, on uniform sampling in general branching models applied to structured population dynamic, on time scale separation in integrate-and-fire models used in neuroscience, and, finally, on moment calculus in stochastic models of gene expression.

Frequency modulation of stochastic gene expression bursts by strongly interacting small RNAs.

The sporadic nature of gene expression at the single-cell level-long periods of inactivity punctuated by bursts of mRNA or protein production-plays a critical role in diverse cellular processes. To elucidate the cellular role of bursting in gene expression, synthetic biology approaches have been used to design simple genetic circuits with bursty mRNA or protein production. Understanding how such genetic circuits can be designed with the ability to control burst-related parameters requires the development of quantitative stochastic models of gene expression. In this work, we analyze stochastic models for the regulation of gene expression bursts by strongly interacting small RNAs. For the parameter range considered, results based on mean-field approaches are significantly inaccurate and alternative analytical approaches are needed. Using simplifying approximations, we obtain analytical results for the corresponding steady-state distributions that are in agreement with results from stochastic simulations. These results indicate that regulation by small RNAs, in the strong interaction limit, can be used to effectively modulate the frequency of bursting. We explore the consequences of such regulation for simple genetic circuits involving feedback effects and switching between promoter states.

Time-dependent solutions for a stochastic model of gene expression with molecule production in the form of a compound Poisson process.

We study a stochastic model of gene expression, in which protein production has a form of random bursts whose size distribution is arbitrary, whereas protein decay is a first-order reaction. We find exact analytical expressions for the time evolution of the cumulant-generating function for the most general case when both the burst size probability distribution and the model parameters depend on time in an arbitrary (e.g., oscillatory) manner, and for arbitrary initial conditions. We show that in the case of periodic external activation and constant protein degradation rate, the response of the gene is analogous to the resistor-capacitor low-pass filter, where slow oscillations of the external driving have a greater effect on gene expression than the fast ones. We also demonstrate that the nth cumulant of the protein number distribution depends on the nth moment of the burst size distribution. We use these results to show that different measures of noise (coefficient of variation, Fano factor, fractional change of variance) may vary in time in a different manner. Therefore, any biological hypothesis of evolutionary optimization based on the nonmonotonic dependence of a chosen measure of noise on time must justify why it assumes that biological evolution quantifies noise in that particular way. Finally, we show that not only for exponentially distributed burst sizes but also for a wider class of burst size distributions (e.g., Dirac delta and gamma) the control of gene expression level by burst frequency modulation gives rise to proportional scaling of variance of the protein number distribution to its mean, whereas the control by amplitude modulation implies proportionality of protein number variance to the mean squared.

Analytical approximations for spatial stochastic gene expression in single cells and tissues.

Gene expression occurs in an environment in which both stochastic and diffusive effects are significant. Spatial stochastic simulations are computationally expensive compared with their deterministic counterparts, and hence little is currently known of the significance of intrinsic noise in a spatial setting. Starting from the reaction–diffusion master equation (RDME) describing stochastic reaction–diffusion processes, we here derive expressions for the approximate steady-state mean concentrations which are explicit functions of the dimensionality of space, rate constants and diffusion coefficients. The expressions have a simple closed form when the system consists of one effective species. These formulae show that, even for spatially homogeneous systems, mean concentrations can depend on diffusion coefficients: this contradicts the predictions of deterministic reaction–diffusion processes, thus highlighting the importance of intrinsic noise. We confirm our theory by comparison with stochastic simulations, using the RDME and Brownian dynamics, of two models of stochastic and spatial gene expression in single cells and tissues.

Exploiting Natural Fluctuations to Identify Kinetic Mechanisms in Sparsely Characterized Systems

From biochemistry to ecology, many biological systems are stochastic, complex, and sparsely characterized. In such systems, each component may respond to changes in any directly or indirectly connected components, thus requiring knowledge of the whole to predict the dynamics of the parts. Here, we address this challenge by deriving relations between properties of fluctuations that only reflect local interactions between a subset of components but are invariant to all indirectly connected dynamics. This greatly reduces the number of assumptions when evaluating dynamic models experimentally. We illustrate the approach by revisiting systematic single-cell gene expression data, and we show that the observed fluctuations contradict the assumptions made in most published models of stochastic gene expression, even when accounting for the possibility of systematic experimental artifacts.

Dimension of invariant measures for continuous random dynamical systems

We consider continuous random dynamical systems with jumps. We estimate the dimension of the invariant measures and apply the results to a model of stochastic gene expression. Copyright © 2016 John Wiley & Sons, Ltd.

Quantitative analysis of gene expression systems

Gene expression is a complex biochemical process, involving many specific processes such as transcription, translation, switching between promoter states, and regulation. All these biochemical processes inevitably lead to fluctuations in mRNA and protein abundances. This noise has been identified as an important factor underlying the observed phenotypic variability of genetically identical cells in homogeneous environments. Quantifying the contributions of different sources of noise using stochastic models of gene expression is an important step towards understanding fundamental cellular processes and cell‐to‐cell variability in expression levels. In this paper, we review progresses in quantitative study of simple gene expression systems, including some results that we have not published. We analytically show how specific processes associated with gene expression affect expression levels. In particular, we derive the analytical decomposition of expression noise, which is important for understanding the roles of the factorial noise in controlling phenotypic variability. We also introduce a new index (called attribute factor) to quantify expression noise, which has more advantages than the commonly‐used noise indices such as noise intensity and Fano factor.

Transcriptional Bursting in Gene Expression: Analytical Results for General Stochastic Models.

Gene expression in individual cells is highly variable and sporadic, often resulting in the synthesis of mRNAs and proteins in bursts. Such bursting has important consequences for cell-fate decisions in diverse processes ranging from HIV-1 viral infections to stem-cell differentiation. It is generally assumed that bursts are geometrically distributed and that they arrive according to a Poisson process. On the other hand, recent single-cell experiments provide evidence for complex burst arrival processes, highlighting the need for analysis of more general stochastic models. To address this issue, we invoke a mapping between general stochastic models of gene expression and systems studied in queueing theory to derive exact analytical expressions for the moments associated with mRNA/protein steady-state distributions. These results are then used to derive noise signatures, i.e. explicit conditions based entirely on experimentally measurable quantities, that determine if the burst distributions deviate from the geometric distribution or if burst arrival deviates from a Poisson process. For non-Poisson arrivals, we develop approaches for accurate estimation of burst parameters. The proposed approaches can lead to new insights into transcriptional bursting based on measurements of steady-state mRNA/protein distributions.

On a stochastic gene expression with pre-mRNA, mRNA and protein contribution

In this paper we develop a model of stochastic gene expression, which is an extension of the model investigated in the paper [T. Lipniacki, P. Paszek, A. Marciniak-Czochra, A.R. Brasier, M. Kimmel, Transcriptional stochasticity in gene expression, J. Theor. Biol. 238 (2006) 348–367]. In our model, stochastic effects still originate from random fluctuations in gene activity status, but we precede mRNA production by the formation of pre-mRNA, which enriches classical transcription phase. We obtain a stochastically regulated system of ordinary differential equations (ODEs) describing evolution of pre-mRNA, mRNA and protein levels. We perform mathematical analysis of a long-time behavior of this stochastic process, identified as a piece-wise deterministic Markov process (PDMP). We check exact results using numerical simulations for the distributions of all three types of particles. Moreover, we investigate the deterministic (adiabatic) limit state of the process, when depending on parameters it can exhibit two specific types of behavior: bistability and the existence of the limit cycle. The latter one is not present when only two kinds of gene expression products are considered.

Effect and evolution of gene expression noise on the fitness landscape.

Gene expression is a stochastic process that affects cellular and population fitness. Noise in gene expression can enhance fitness by increasing cell to cell variability as well as the time cells spend in favorable expression states. Using a stochastic model of gene expression together with a fitness function that incorporates the costs and benefits of gene expression in a stressful environment, we show that the fitness landscape is shaped by gene expression noise in more complex ways than previously anticipated. We find that mutations modulating the properties of expression noise enable cell populations to optimize their position on the fitness landscape. Additionally, we find that low levels of expression noise evolve under conditions where the fitness benefits of expression exceed the fitness costs, and that high levels of expression noise evolve when the expression costs exceed the fitness benefits. The results presented in this study expand our understanding of the interplay between stochastic gene expression and fitness in selective environments.

Nonspecific transcription factor binding can reduce noise in the expression of downstream proteins

Transcription factors (TFs) interact with a multitude of binding sites on DNA and partner proteins inside cells. We investigate how nonspecific binding/unbinding to such decoy binding sites affects the magnitude and time-scale of random fluctuations in TF copy numbers arising from stochastic gene expression. A stochastic model of TF gene expression, together with decoy site interactions is formulated. Distributions for the total (bound and unbound) and free (unbound) TF levels are derived by analytically solving the chemical master equation under physiologically relevant assumptions. Our results show that increasing the number of decoy binding sides considerably reduces stochasticity in free TF copy numbers. The TF autocorrelation function reveals that decoy sites can either enhance or shorten the time-scale of TF fluctuations depending on model parameters. To understand how noise in TF abundances propagates downstream, a TF target gene is included in the model. Intriguingly, we find that noise in the expression of the target gene decreases with increasing decoy sites for linear TF-target protein dose-responses, even in regimes where decoy sites enhance TF autocorrelation times. Moreover, counterintuitive noise transmissions arise for nonlinear dose-responses. In summary, our study highlights the critical role of molecular sequestration by decoy binding sites in regulating the stochastic dynamics of TFs and target proteins at the single-cell level.

Optimizing information flow in small genetic networks. IV. Spatial coupling.

We typically think of cells as responding to external signals independently by regulating their gene expression levels, yet they often locally exchange information and coordinate. Can such spatial coupling be of benefit for conveying signals subject to gene regulatory noise? Here we extend our information-theoretic framework for gene regulation to spatially extended systems. As an example, we consider a lattice of nuclei responding to a concentration field of a transcriptional regulator (the input) by expressing a single diffusible target gene. When input concentrations are low, diffusive coupling markedly improves information transmission; optimal gene activation functions also systematically change. A qualitatively different regulatory strategy emerges where individual cells respond to the input in a nearly steplike fashion that is subsequently averaged out by strong diffusion. While motivated by early patterning events in the Drosophila embryo, our framework is generically applicable to spatially coupled stochastic gene expression models.

Exact distributions for stochastic gene expression models with bursting and feedback.

Stochasticity in gene expression can give rise to fluctuations in protein levels and lead to phenotypic variation across a population of genetically identical cells. Recent experiments indicate that bursting and feedback mechanisms play important roles in controlling noise in gene expression and phenotypic variation. A quantitative understanding of the impact of these factors requires analysis of the corresponding stochastic models. However, for stochastic models of gene expression with feedback and bursting, exact analytical results for protein distributions have not been obtained so far. Here, we analyze a model of gene expression with bursting and feedback regulation and obtain exact results for the corresponding protein steady-state distribution. The results obtained provide new insights into the role of bursting and feedback in noise regulation and optimization. Furthermore, for a specific choice of parameters, the system studied maps on to a two-state biochemical switch driven by a bursty input noise source. The analytical results derived provide quantitative insights into diverse cellular processes involving noise in gene expression and biochemical switching.

Probability Distributions for Stochastic Gene Expression with Multiple Binding Sites

While regulation of intrinsic stochasticity in gene expression is essential for many cellular functions, there is considerable interest in understanding how different molecular mechanisms of gene expression impact variations in protein levels across a population of cells. Stochastic properties of the corresponding gene systems are usually examined by directly finding the probability distributions of mRNA or protein governed by chemical master equations. Here, we analyze four stochastic models of gene expression, each describing a representative topology of binding sites. The total mRNA or protein probability distributions are derived by the weight assignment method that we propose here. These distributions indicate that the total mRNA or protein number obeys a beta distribution or a linear superposition of two beta distributions in spite of differences in the local mRNA or protein numbers distributed in individual binding sites among the models. Our results reveal essential mechanisms of gene expression in terms of the probability distribution rather than finite-order moments, as was done in previous studies.

Stochastic holin expression can account for lysis time variation in the bacteriophageλ

The inherent stochastic nature of biochemical processes can drive differences in gene expression between otherwise identical cells. While cell-to-cell variability in gene expression has received much attention, randomness in timing of events has been less studied. We investigate event timing at the single-cell level in a simple system, the lytic pathway of the bacterial virus phage λ. In individual cells, lysis occurs on average at 65 min, with an s.d. of 3.5 min. Interestingly, mutations in the lysis protein, holin, alter both the lysis time (LT) mean and variance. In our analysis, LT is formulated as the first-passage time (FPT) for cellular holin levels to cross a critical threshold. Exact analytical formulae for the FPT moments are derived for stochastic gene expression models. These formulae reveal how holin transcription and translation efficiencies independently modulate the LT mean and variation. Analytical expressions for the LT moments are used to evaluate previously published single-cell LT data for λ phages with mutations in the holin sequence or its promoter. Our results show that stochastic holin expression is sufficient to account for the intercellular LT differences in both wild-type phages, and phage variants where holin transcription and the threshold for lysis have been experimentally altered. Finally, our analysis reveals regulatory motifs that enhance the robustness of lysis timing to cellular noise.

Oscillations in probability distributions for stochastic gene expression.

The phenomenon of oscillations in probability distribution functions of number of components is found for a model of stochastic gene expression. It takes place in cases of low levels of molecules or strong intracellular noise. The oscillations distinguish between more probable even and less probable odd number of particles. The even-odd symmetry restores as the number of molecules increases with the probability distribution function tending to Poisson distribution. We discuss the possibility of observation of the phenomenon in gene, protein, and mRNA expression experiments.

Distribution of population-averaged observables in stochastic gene expression

Observation of phenotypic diversity in a population of genetically identical cells is often linked to the stochastic nature of chemical reactions involved in gene regulatory networks. We investigate the distribution of population-averaged gene expression levels as a function of population, or sample, size for several stochastic gene expression models to find out to what extent population-averaged quantities reflect the underlying mechanism of gene expression. We consider three basic gene regulation networks corresponding to transcription with and without gene state switching and translation. Using analytical expressions for the probability generating function of observables and large deviation theory, we calculate the distribution and first two moments of the population-averaged mRNA and protein levels as a function of model parameters, population size, and number of measurements contained in a data set. We validate our results using stochastic simulations also report exact results on the asymptotic properties of population averages which show qualitative differences among different models.

Quantifying Intrinsic and Extrinsic Variability in Stochastic Gene Expression Models

Genetically identical cell populations exhibit considerable intercellular variation in the level of a given protein or mRNA. Both intrinsic and extrinsic sources of noise drive this variability in gene expression. More specifically, extrinsic noise is the expression variability that arises from cell-to-cell differences in cell-specific factors such as enzyme levels, cell size and cell cycle stage. In contrast, intrinsic noise is the expression variability that is not accounted for by extrinsic noise, and typically arises from the inherent stochastic nature of biochemical processes. Two-color reporter experiments are employed to decompose expression variability into its intrinsic and extrinsic noise components. Analytical formulas for intrinsic and extrinsic noise are derived for a class of stochastic gene expression models, where variations in cell-specific factors cause fluctuations in model parameters, in particular, transcription and/or translation rate fluctuations. Assuming mRNA production occurs in random bursts, transcription rate is represented by either the burst frequency (how often the bursts occur) or the burst size (number of mRNAs produced in each burst). Our analysis shows that fluctuations in the transcription burst frequency enhance extrinsic noise but do not affect the intrinsic noise. On the contrary, fluctuations in the transcription burst size or mRNA translation rate dramatically increase both intrinsic and extrinsic noise components. Interestingly, simultaneous fluctuations in transcription and translation rates arising from randomness in ATP abundance can decrease intrinsic noise measured in a two-color reporter assay. Finally, we discuss how these formulas can be combined with single-cell gene expression data from two-color reporter experiments for estimating model parameters.

StochPy: A Comprehensive, User-Friendly Tool for Simulating Stochastic Biological Processes

Single-cell and single-molecule measurements indicate the importance of stochastic phenomena in cell biology. Stochasticity creates spontaneous differences in the copy numbers of key macromolecules and the timing of reaction events between genetically-identical cells. Mathematical models are indispensable for the study of phenotypic stochasticity in cellular decision-making and cell survival. There is a demand for versatile, stochastic modeling environments with extensive, preprogrammed statistics functions and plotting capabilities that hide the mathematics from the novice users and offers low-level programming access to the experienced user. Here we present StochPy (Stochastic modeling in Python), which is a flexible software tool for stochastic simulation in cell biology. It provides various stochastic simulation algorithms, SBML support, analyses of the probability distributions of molecule copy numbers and event waiting times, analyses of stochastic time series, and a range of additional statistical functions and plotting facilities for stochastic simulations. We illustrate the functionality of StochPy with stochastic models of gene expression, cell division, and single-molecule enzyme kinetics. StochPy has been successfully tested against the SBML stochastic test suite, passing all tests. StochPy is a comprehensive software package for stochastic simulation of the molecular control networks of living cells. It allows novice and experienced users to study stochastic phenomena in cell biology. The integration with other Python software makes StochPy both a user-friendly and easily extendible simulation tool.

Reaction dynamics under confinement: an exact path integral treatment of a two-stage model of stochastic gene expression

Gene expression in living systems is inherently stochastic, and tends to produce varying numbers of proteins over repeated cycles of transcription and translation. In this paper, an expression is derived for the steady-state protein number distribution starting from a two-stage kinetic model of the gene expression process involving p proteins and r mRNAs. The derivation is based on an exact path integral evaluation of the joint distribution, P(p,r,t), of p and r at time t, which can be expressed in terms of the coupled Langevin equations for p and r that represent the two-stage model in continuum form. The steady-state distribution of p alone, P(p), is obtained from P(p,r,t) (a bivariate Gaussian) by integrating out the r degrees of freedom and taking the limit t → ∞. P(p) is found to be proportional to the product of a Gaussian and a complementary error function. It provides a generally satisfactory fit to simulation data on the same two-stage process when the translational efficiency (a measure of intrinsic noise levels in the system) is relatively low; it is less successful as a model of the data when the translational efficiency (and noise levels) are high.