Big Data in Official Statistics: A View of the Problem

Abstract

This article addresses the use of Big Data in official statistics, a much-discussed topic in the statistical community. The idea of replacing official statistics' indicators with a new information source, Big Data, was actively promoted in an overwhelming number of publications by foreign and domestic researchers several years ago. A more realistic perspective of this issue has gained ground in recent years; the issue is how to incorporate this unconventional source into statistical production and use Big Data for official statistical evaluations. The UN Statistical Commission's proactive stance greatly contributed to the discussion's shift in focus. The UN Statistical Commission was able to make the conversation about issues with Big Data application in official statistics a constructive process, leveraging its authority and opportunities. This process included all regional statistical platforms of the UN, specialized organizations and programs and other international agencies. The creation, testing, and implementation of novel approaches in official statistical surveys also involved national statisticians working for the government in universities, research centers and business. The article analyzes the practical application of Big Data in national statisticians' line of work, outlines the benefits and drawbacks of Big Data regarding its potential application in official statistics, outlines the directions of this activity, and formulates suggestions for the involvement of the Russian statistical community in this process. The author argues the need to avoid contrasting Big Data as information on society and economy versus official statistics based on traditional sources. In his opinion, Big Data is currently not a complete alternative to data collected on the basis of classical natural phenomena but can be built into national systems for collecting information on specific characteristics of socio-economic phenomena. The expansion of their use largely depends on the level of development of information and communication technologies as well as ICT integration in public life.