Analysis of Spatio-temporal Behavior of Research Travelers Based on Spark Big Data Computing Model

Abstract

There are still many defects in the process of data processing, storage and analysis, which cannot adapt to the needs of big data processing and analysis. In order to more fully reflect the value of big data processing, it is necessary to realize efficient data processing. Therefore, people invented the Spark operating system and integrated the idea of SIMBA, built a big data analysis system, and searched the information through the database query method. In Spark operating system can import search mechanism, in order to improve the search effect of information, through the establishment of segment tree storage method can improve the retrieval effect, in big data analysis can use partition strategy method for big data partition, and adopted the global filtering and local search method, make in information retrieval can achieve high throughput and low delay performance.