Class Of Markov Processes Research Articles

Criteria for Davies irreducibility of Markovian quantum dynamics

The dynamics of Markovian open quantum systems are described by Lindblad master equations, generating a quantum dynamical semigroup. An important concept for such systems is (Davies) irreducibility, i.e. the question whether there exist non-trivial invariant subspaces. Steady states of irreducible systems are unique and faithful, i.e. they have full rank. In the 1970s, Frigerio showed that a system is irreducible if the Lindblad operators span a self-adjoint set with trivial commutant. We discuss a more general and powerful algebraic criterion, showing that a system is irreducible if and only if the multiplicative algebra generated by the Lindblad operators La and the operator iH+∑aLa†La , involving the Hamiltonian H, is the entire operator space. Examples for two-level systems, show that a change of Hamiltonian terms as well as the addition or removal of dissipators can render a reducible system irreducible and vice versa. Examples for many-body systems show that a large class of spin chains can be rendered irreducible by dissipators on just one or two sites. Additionally, we discuss the decisive differences between (Davies) reducibility and Evans reducibility for quantum channels and dynamical semigroups which has lead to some confusion in the recent physics literature, especially, in the context of boundary-driven systems. We give a criterion for quantum reducibility in terms of associated classical Markov processes and, lastly, discuss the relation of the main result to the stabilization of pure states and argue that systems with local Lindblad operators cannot stabilize pure Fermi-sea states.

Quantum Theory in Finite Dimension Cannot Explain Every General Process with Finite Memory

Arguably, the largest class of stochastic processes generated by means of a finite memory consists of those that are sequences of observations produced by sequential measurements in a suitable generalized probabilistic theory (GPT). These are constructed from a finite-dimensional memory evolving under a set of possible linear maps, and with probabilities of outcomes determined by linear functions of the memory state. Examples of such models are given by classical hidden Markov processes, where the memory state is a probability distribution, and at each step it evolves according to a non-negative matrix, and hidden quantum Markov processes, where the memory is a finite-dimensional quantum system, and at each step it evolves according to a completely positive map. Here we show that the set of processes admitting a finite-dimensional explanation do not need to be explainable in terms of either classical probability or quantum mechanics. To wit, we exhibit families of processes that have a finite-dimensional explanation, defined manifestly by the dynamics of an explicitly given GPT, but that do not admit a quantum, and therefore not even classical, explanation in finite dimension. Furthermore, we present a family of quantum processes on qubits and qutrits that do not admit a classical finite-dimensional realization, which includes examples introduced earlier by Fox, Rubin, Dharmadikari and Nadkarni as functions of infinite-dimensional Markov chains, and lower bound the size of the memory of a classical model realizing a noisy version of the qubit processes.

Statistical features of systems driven by non-Gaussian processes: theory & practice

Nowadays many tools, e.g. fluctuation relations, are available to characterize the statistical properties of non-equilibrium systems. However, most of these tools rely on the assumption that the driving noise is normally distributed. Here we consider a class of Markov processes described by Langevin equations driven by a mixture of Gaussian and Poissonian noises, focusing on their non-equilibrium properties. In particular, we prove that detailed balance does not hold even when correlation functions are symmetric under time reversal. In such cases, a breakdown of the time reversal symmetry can be highlighted by considering higher order correlation functions. Furthermore, the entropy production may be different from zero even for vanishing currents. We provide analytical expressions for the average entropy production rate in several cases. We also introduce a scale dependent estimate for entropy production, suitable for inference from experimental signals. The empirical entropy production allows us to discuss the role of spatial and temporal resolutions in characterizing non-equilibrium features. Finally, we revisit the Brownian gyrator introducing an additional Poissonian noise showing that it behaves as a two dimensional linear ratchet. It has also the property that when Onsager relations are satisfied its entropy production is positive although it is minimal. We conclude discussing estimates of entropy production for partially accessible systems, comparing our results with the lower bound provided by the thermodynamic uncertainty relations.

Recurrence and transience of quantum Markov semigroups constructed form quantum Bernoulli noises

Quantum exclusion semigroup constructed form quantum Bernoulli noises can be written on diagonal and off-diagonal operators space, respectively. The diagonal parts describe a classical Markov process. In this paper, we first produce a decomposition into the sum of irreducible components determined by the class states of the associated classical Markov process and prove that each irreducible component is recurrent or transient if and only if its diagonal restriction is recurrent or transient. We then give conditions for existence of invariant states and study properties of invariant states such as detailed balance, uniqueness and convergence towards as time approaches infinity.

Unifying speed limit, thermodynamic uncertainty relation and Heisenberg principle via bulk-boundary correspondence

The bulk-boundary correspondence provides a guiding principle for tackling strongly correlated and coupled systems. In the present work, we apply the concept of the bulk-boundary correspondence to thermodynamic bounds described by classical and quantum Markov processes. Using the continuous matrix product state, we convert a Markov process to a quantum field, such that jump events in the Markov process are represented by the creation of particles in the quantum field. Introducing the time evolution of the continuous matrix product state, we apply the geometric bound to its time evolution. We find that the geometric bound reduces to the speed limit relation when we represent the bound in terms of the system quantity, whereas the same bound reduces to the thermodynamic uncertainty relation when expressed based on quantities of the quantum field. Our results show that the speed limits and thermodynamic uncertainty relations are two aspects of the same geometric bound.

Non-reversible processes: GENERIC, hypocoercivity and fluctuations

We consider two approaches to study non-reversible Markov processes, namely the hypocoercivity theory and general equations for non-equilibrium reversible–irreversible coupling; the basic idea behind both of them is to split the process into a reversible component and a non-reversible one, and then quantify the way in which they interact. We compare such theories and provide explicit formulas to pass from one formulation to the other; as a bi-product we give a simple proof of the link between reversibility of the dynamics and gradient flow structure of the associated Fokker–Planck equation. We do this both for linear Markov processes and for a class of nonlinear Markov process as well. We then characterise the structure of the large deviation functional of generalised-reversible processes; this is a class of non-reversible processes of large relevance in applications. Finally, we show how our results apply to two classes of Markov processes, namely non-reversible diffusion processes and a class of piecewise deterministic Markov processes (PDMPs), which have recently attracted the attention of the statistical sampling community. In particular, for the PDMPs we consider we prove entropy decay.

The decoherence effect of qubit in 1D transverse Ising model

With the development of lab technology, the low-order correlation function can no longer describe the main effect of decoherence in the quantum many-body system, so it is imperative to study the higher-order correlation function of the system. In this paper, the higher-order correlation function is discussed analytically in the 1D transverse Ising model, and it is searched when the third-order or higher correlation functions play a key role in the decoherence effect. Under the cases of strong coupling and long coherence time, it is indicated that the effect of high-order correlation functions cannot be ignored, and the approximation of the classical Markov process is limited. But the low-order correlation function can describe well in the case of weak coupling and short coherence time.

Inner Law and Models for Forecasting the Results of Air Defense Battle

The purpose of the article was to find the inner properties and regularities of anti-aircraft missile grouping’s air defense battle, and based on these regularities to develop and evaluate the adequacy of models as tools for forecasting the results of a battle. To achieve the goal, an example of a real battle and a special model development method were used. The method made it possible to identify the main properties and the inner law of battle, to select a statistically valid mathematical modeling tool in the class of Markov processes with continuous time and discrete states, to develop the desired models with an analytical representation of the inner law of battle, to check their adequacy and to evaluate the accuracy of forecasting by models using the example of a real air defense battle.

Markov-modulated affine processes

We study Markov-modulated affine processes (abbreviated MMAPs), a class of Markov processes that are created from affine processes by allowing some of their coefficients to be a function of an exogenous Markov process X. MMAPs largely preserve the tractability of standard affine processes, as their characteristic function has a computationally convenient functional form. Our setup is a substantial generalization of earlier work, since we consider the case where the generator of X is an unbounded operator. We prove existence of MMAPs via a martingale problem approach, we derive the formula for their characteristic function and we study various mathematical properties.

Quantum Markov monogamy inequalities

Markovianity lies at the heart of communication problems. This in turn makes the information-theoretic characterization of Markov processes worthwhile. Data processing inequalities are ubiquitous in this sense, assigning necessary conditions for all Markov processes. We address here the problem of the information-theoretic analysis of constraints on Markov processes in the quantum regime. We show the existence of a novel class of quantum data processing inequalities called here quantum Markov monogamy inequalities. This new class of necessary conditions on quantum Markov processes is inspired by its counterpart for classical Markov processes, and thus providing a strong link between classical and quantum constraints on Markovianity. We go on to construct a family of multitime quantum Markov monogamy inequalities, based on the process tensor formalism and that exploits multitime correlations. We then show, by means of an explicit example, that the Markov monogamy inequalities can be stronger than the usual quantum data processing inequalities.

Subdiffusion and Many-Body Quantum Chaos with Kinetic Constraints.

We investigate the spectral and transport properties of many-body quantum systems with conserved charges and kinetic constraints. Using random unitary circuits, we compute ensemble-averaged spectral form factors and linear-response correlation functions, and find that their characteristic timescales are given by the inverse gap of an effective Hamiltonian-or equivalently, a transfer matrix describing a classical Markov process. Our approach allows us to connect directly the Thouless time, t_{Th}, determined by the spectral form factor, to transport properties and linear-response correlators. Using tensor network methods, we determine the dynamical exponent z for a number of constrained, conserving models. We find universality classes with diffusive, subdiffusive, quasilocalized, and localized dynamics, depending on the severity of the constraints. In particular, we show that quantum systems with "Fredkin" constraints exhibit anomalous transport with dynamical exponent z≃8/3.

Assessment of Border Patrol Group Ammunition Amount Required for Border Fighting

he purpose of the article was to assess the amount of ammunition required by the border guard during the battle with the sabotage and reconnaissance group until the arrival of reinforcements. To achieve the goal, a method of mathematical modeling of combat processes in the class of Markov processes with continuous time and discrete states was chosen. As a result, the method made it possible to construct the required models, check their adequacy, due to the found internal law of battle, and evaluate the performance on a specific practical example.

Thermodynamic Uncertainty Relation for General Open Quantum Systems

We derive a thermodynamic uncertainty relation for general open quantum dynamics, described by a joint unitary evolution on a composite system comprising a system and an environment. By measuring the environmental state after the system-environment interaction, we bound the counting observables in the environment by the survival activity, which reduces to the dynamical activity in classical Markov processes. Remarkably, the relation derived herein holds for general open quantum systems with any counting observable and any initial state. Therefore, our relation is satisfied for classical Markov processes with arbitrary time-dependent transition rates and initial states. We apply our relation to continuous measurement and the quantum walk to find that the quantum nature of the system can enhance the precision. Moreover, we can make the lower bound arbitrarily small by employing appropriate continuous measurement.

Green measures for Markov processes

In this paper we study Green measures of certain classes of Markov processes. In particular Brownian motion and processes with jump generators with different tails. The Green measures are represented as a sum of a singular and a regular part given in terms of the jump generator. The main technical question is to find a bound for the regular part. <br><br> Ми вивчаємо міри Ґріна для деяких класів марківських процесів. Зокрема для броунівського руху і стрибкових процесів. Міри Ґріна містять сингулярну і регулярну компоненти. Основна задача полягає в оцінці регулярної частини.

Dissipative generation of pure steady states and a gambler's ruin problem

We consider an open quantum system, with dissipation applied only to a part of its degrees of freedom, evolving via a quantum Markov dynamics. We demonstrate that, in the Zeno regime of large dissipation, the relaxation of the quantum system towards a pure quantum state is linked to the evolution of a classical Markov process towards a single absorbing state. The rates of the associated classical Markov process are determined by the original quantum dynamics. Extension of this correspondence to absorbing states with internal structure allows us to establish a general criterion for having a Zeno-limit nonequilibrium stationary state of arbitrary finite rank. An application of this criterion is illustrated in the case of an open XXZ spin-1/2 chain dissipatively coupled at its edges to baths with fixed and different polarizations. For this system, we find exact nonequilibrium steady-state solutions of ranks 1 and 2.

On sub-geometric ergodicity of diffusion processes

In this article, we discuss ergodicity properties of a diffusion process given through an Itô stochastic differential equation. We identify conditions on the drift and diffusion coefficients which result in sub-geometric ergodicity of the corresponding semigroup with respect to the total variation distance. We also prove sub-geometric contractivity and ergodicity of the semigroup under a class of Wasserstein distances. Finally, we discuss sub-geometric ergodicity of two classes of Markov processes with jumps.

Rigorous measurement error correction

We review an experimental technique used to correct state preparation and measurement errors on gate-based quantum computers, and discuss its rigorous justification. Within a specific biased quantum measurement model, we prove that nonideal measurement of an arbitrary n-qubit state is equivalent to ideal projective measurement followed by a classical Markov process Γ acting on the output probability distribution. Measurement errors can be removed, with rigorous justification, if Γ can be learned and inverted. We show how to obtain Γ from gate set tomography (Blume-Kohout et al arXiv:1310.4492) and apply the rigorous correction technique to single IBM Q superconducting qubits.

A perturbation analysis of Markov chains models with time-varying parameters

We study some regularity properties in locally stationary Markov models which are fundamental for controlling the bias of nonparametric kernel estimators. In particular, we provide an alternative to the standard notion of derivative process developed in the literature and that can be used for studying a wide class of Markov processes. To this end, for some families of $V$-geometrically ergodic Markov kernels indexed by a real parameter $u$, we give conditions under which the invariant probability distribution is differentiable with respect to $u$, in the sense of signed measures. Our results also complete the existing literature for the perturbation analysis of Markov chains, in particular when exponential moments are not finite. Our conditions are checked on several original examples of locally stationary processes such as integer-valued autoregressive processes, categorical time series or threshold autoregressive processes.

Classical and Quantum Markov Processes Associated with q-Bessel Operators

We study the fundamental properties of classical and quantum Markov processes generated by q-Bessel operators and their extension to the algebra of all bounded operators on the Hilbert space [Formula: see text]. In particular, we find a suitable generalized Gorini–Kossakowski–Sudarshan–Lindblad representation for the infinitesimal generator of q-Bessel operator and show that both the classical and quantum Markov processes are transient for α &gt; 0 and recurrent for α = 0. We also show that they do not admit invariant states and, moreover that the support projection of any initial state instantaneously fills the full space.

Monotone increment processes, classical Markov processes, and Loewner chains

We prove one-to-one correspondences between certain decreasing Loewner chains in the upper half-plane, a special class of real-valued Markov processes, and quantum stochastic processes with monotonically independent additive increments. This leads us to a detailed investigation of probability measures on $\mathbb{R}$ with univalent Cauchy transform. We discuss several subclasses of such measures and obtain characterizations in terms of analytic and geometric properties of the corresponding Cauchy transforms. Furthermore, we obtain analogous results for the setting of decreasing Loewner chains in the unit disk, which correspond to quantum stochastic processes of unitary operators with monotonically independent multiplicative increments.