Big Data Gets Cloudy: Challenges and Opportunities

Abstract

Cloud computing and big data are complementary, forming a dialectical relationship. Cloud computing and the widespread use of internet application is the ultimate need of the hour. Though seen as full of promising opportunities, both the fields have their own challenges. Cloud computing is a trend in technology development, while big data is an inevitable phenomenon of the rapid development of a modern information society. Modern means like Cloud computing technologies are needed to solve big data problems. With the advent of new technologies in the field of data and computing, innumerable services are emerging on the net, generating huge volume of data. The data so generated is becoming too large and complex to be effectively processed by conventional means. How to store, manage, and create values from this huge ocean of big data has become an important research problem in today’s time. Presently, users are accessing multiple data storage platforms to accomplish their operational and analytical requirements. Efficient integration of different data sources, in the merger of the two technologies, i.e., Big Data and Cloud, poses considerable challenges. Data integration here plays a very important role for both commercial and scientific domains in order to combine data from different sources and provides users with a unified view of these data. Keeping in mind the 4 V’s of Big Data (volume, velocity, variety, and veracity), studying the challenges and opportunities coming in the way of efficient data integration is a key research direction for scientists. This paper will describe \(\bullet \) How cloud and big data technologies are converging to offer a cost-effective delivery model for cloud-based big data analytics. \(\bullet \) Big Data Challenges. \(\bullet \) Challenges in cloud computing. \(\bullet \) Challenges when big data moves to cloud.