X-RIME: Hadoop-based large-scale Social Network Analysis

Abstract

With the fast development of Social Networking Sites (SNS) such as Renren, Facebook, etc., Social Network Analysis (SNA) is becoming a hot research area. However, considering a typical SNS consists of millions to tens of millions of ultra-large-scale data sets, how to deal with such large-scale Social Network (SN) data sets becomes a great challenge for existing SNA tools. Towards this problem, this paper proposes X-RIME: a Hadoop-based analysis tool for large-scale social network. We show that X-RIME can efficiently deal with large-scale data sets, with great expandability and universality. We also briefly analyze the necessary features for an algorithm to be implemented with MapReduce programming model, in a distributed and concurrent way. Finally, we demonstrate the SNA abilities of X-RIME with extensive experiment results.