Entropy analysis of stochastic processes at finite resolution

Abstract

The time evolution of complex systems usually can be described through stochastic processes. These processes are measured at finite resolution, which necessarily reduces them to finite sequences of real numbers. In order to relate these data sets to realizations of the original stochastic processes (to any functions, indeed) it is obligatory to choose an interpolation space (for example, the space of band-limited functions). Clearly, this choice is crucial if the intent is to approximate optimally the original processes inside the interval of measurement. Here, we argue that discrete wavelets are suitable to this end. The wavelet approximations of stochastic processes allow us to define an entropy measure for the order–disorder balance of evolution regimes of complex systems, where order is understood as confinement of energy in simple local modes. We calculate exact results for the fractional Brownian motion (fBm), with application to Kolmogorov K41 theory for fully developed turbulence.