Research on Big Data Analysis Data Acquisition and Data Analysis

Abstract

Using big data analysis algorithm, this paper discusses the source of data acquisition, points out the technical characteristics of data source, and explains the data acquisition methods and requirements. Clear the purpose of big data analysis, build data analysis system, describe the process of data analysis. There are four steps in big data analysis: data acquisition, data storage, data analysis and data mining. Data acquisition can be divided into two parts: acquisition and preprocessing, which is just narrow data acquisition. The data analysis of the Internet of things is a process of organizing and purposefully collecting data, processing data and analyzing data to form information. The analysis process is the support and execution process of the algorithm. In the data processing cycle, data analysis should be used properly in every link from data acquisition in the field perception layer to data transmission in the communication layer to data processing in the application layer, so as to improve the effectiveness and rationality of data processing.