Abstract
We present a probabilistic model for natural images that is based on mixtures of Gaussian scale mixtures and a simple multiscale representation. We show that it is able to generate images with interesting higher-order correlations when trained on natural images or samples from an occlusion-based model. More importantly, our multiscale model allows for a principled evaluation. While it is easy to generate visually appealing images, we demonstrate that our model also yields the best performance reported to date when evaluated with respect to the cross-entropy rate, a measure tightly linked to the average log-likelihood. The ability to quantitatively evaluate our model differentiates it from other multiscale models, for which evaluation of these kinds of measures is usually intractable.
Highlights
Probabilistic models of natural images are used in many fields related to vision
The cross-entropy rate is typically difficult to estimate in undirected models so that these models are often evaluated only with respect to simple statistics computed from model samples or based on the samples’ visual appearance
Evaluation of the crossentropy rate is crucial for the comparison of natural image models and an important step in measuring the progress which has been made in capturing the statistics of natural images
Summary
Probabilistic models of natural images are used in many fields related to vision In computational neuroscience, they are used as a means to understand the structure of the input to which biological vision systems have adapted and as a basis for normative theories of how those inputs are optimally processed [1,2]. The cross-entropy rate is typically difficult to estimate in undirected models so that these models are often evaluated only with respect to simple statistics computed from model samples or based on the samples’ visual appearance. These measures, are less objective and need to be used with great caution. Evaluation of the crossentropy rate is crucial for the comparison of natural image models and an important step in measuring the progress which has been made in capturing the statistics of natural images
Published Version (
Free)
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have