Abstract
A cluster validity index is to evaluate the correct number of clusters when partitioning a dataset. In this paper, we propose a new cluster validity index based on two measures called dispersion and overlap for Gaussian-distributed clusters. The dispersion measure is used to estimate the situation of data spreading in a cluster. A small dispersion measure for a cluster means that data points are distributed closely in that cluster. The overlap measure represents the degree of overlap between any pair of clusters in the dataset. By combining these two metrics, we obtain a very effective new cluster validity index. Several experiments were conducted to demonstrate the effectiveness of our validity index by exercising eight synthetic datasets and four real datasets. The results show that our validity index can correctly find the optimal number of clusters that may widely differ in size, dispersion and overlapping. As compared to other ten cluster validity indices, our new index has the best performance in term of accuracy.
Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
