Метод нейроморфного кодирования / восстановления изображений, заданных пуассоновскими отсчетами

Abstract

The paper discusses one of the possible neuromorphic methods for processing relatively large volumes of streaming data. The method is mainly motivated by the known mechanisms of sensory perception of living systems, in particular, methods of visual perception. In this regard, the main provisions of the method are discussed in the context of problems of encoding/recovering images on the periphery of the visual system. The proposed method is focused on representing input data in the form of a stream of discrete events (samples), similar to the discharge events of retinal neurons. For these purposes, a special representation of data streams is used in the form of a controlled size sample of counts (sampling representations). Based on the specifics of the sampling representation, the generative data model is naturally formalized in the form of a system of components distributed over the field of view. Within the framework of the generative model, the optimal coding problem is formulated into the problem of searching for maximum likelihood estimates. The solution to the last problem was carried out on the basis of structuring an array of components in the form of receptive fields model, embodying universal principles (including lateral inhibition) of the neural network of the brain. The mechanism of lateral inhibition is implemented in the model in the form of an antagonistic center / environment structure of the RP. Issues of image decoding are considered in the context of restoring spatial contrasts, which partly emulates the work of the so-called simple cells of the visual cortex. It is shown that the model of coupled ON-OFF decoding allows for the restoration of sharp image details in the form of emphasizing edges, and the connection of the method with the so-called retinex theory is noted.