A projection-based split-and-merge clustering algorithm

Abstract

A novel split-and-merge clustering algorithm is proposed by using projection technology and K-means method. There are two key technologies in the proposed method: shape recognition based on projection and split-and-merge process based on K-means. By projecting the data onto the connection of any two cluster centers, no matter how large the dimension of data is, we can always obtain an one-dimension density curve of the projection to guarantee an acceptable amount of calculation. Further embedded the kernel density estimate, we can determine the distribution of clusters by the shape of the one-dimensional density curve. In the split-and-merge process, this algorithm not only addresses the sensitivity in selecting initial cluster centers, but also automatically give a reasonable number of clusters. We also discuss the possibility to extend the projection split-and-merge method from K-means to density based methods (as EM algorithm and Cross-entropy clustering). Both simulation and real data experimental results show that our method performance well especially under strict data conditions.