Optimization using Artificial Bee Colony based clustering approach for big data

Abstract

As one of the major problems is that the time taken for executing the traditional algorithm is larger and that it is very difficult for processing large amount of data. Clusters possess high degree of similarity among each cluster and have low degree of similarity among other clusters. Optimization algorithm for clustering is the art of allocating scarce resources to the best possible effect. The traditional optimization algorithm is not suitable for processing high dimensional data. The main objective of proposed Artificial Bee Colony (ABC) approach is to minimize the execution time and to optimize the best cluster for the various sizes of the dataset. To deal with this, we are normalizing to distributed environment for time efficiency and accuracy. The proposed ABC algorithm simulates the behavior of real bees for solving numerical optimization problems particularly in clustering. The dataset size is varied for the algorithm and is mapped with its appropriate timings. The result is observed for various fitness and probability value which is obtained from the employed and the onlooker phase of ABC algorithm from which the further calibrations of classification error percentage is done. The proposed ABC Algorithm is implemented in Hadoop environment using mapper and reducer programming. An experimental result reveals that the proposed ABC scheme reduces the execution time and classification error for selecting optimal clusters. The results show that the proposed ABC scheme gives a better performance than PSO and DE in terms of time efficiency.