The Linear Estimation Problem and Information in Big-Data Systems

Abstract

This paper addresses the problem of transforming the optimal linear estimation procedure in such a way that separate fragments of initial data are processed individually and concurrently. A representation of intermediate information is proposed that allows an algorithm to concurrently extract this information from each initial data set, combine it, and use it for estimation. It is shown that, on an information space constructed, an ordering is induced that reflects the concept of information quality.