Visualization of big high dimensional data in a three dimensional space

Abstract

This paper studies feasibility and scalable computing processes for visualizing big high dimensional data in a 3 dimensional space by using dimension reduction techniques. More specifically, we propose an unsupervised approach to compute a measure that is called visualizability in a 3 dimensional space for a high dimensional data. This measure of visualizability is computed based on the comparison of the clustering structures of the data before and after dimension reduction. The computation of visualizability requires finding an optimal clustering structure for the given data sets. Therefore, we further implement a scalable approach based on K-Means algorithm for finding an optimal clustering structure for the given big data. Then we can reduce the volume of a given big data for dimension reduction and visualization by sampling the big data based on the discovered clustering structure of the data.