Improvement and parallelization of k-means clustering algorithm based on Spark platform

Abstract

Clustering algorithm analysis is a very common data mining technology in the current industry research, and has been widely promoted and applied in many social marketing and other related industries. It can not only classify, identify and optimize customers accurately, but also design documents by various data processing methods. K-means clustering algorithm is based on the relevant ideological content of “birds of a feather flock together” to split and synthesize data, so that the similarity of data between different clusters can reach the highest. This paper discusses and improves the algorithm based on Spark.