Analytics, challenges and applications in big data environment: a survey

Abstract

Big data refer to the massive amounts and varieties of information in the structured and unstructured form, generated by social networking sites, biomedical equipment, financial companies, internet and websites, scientific sensors, agriculture engineering sources, and so on. This huge amount of data cannot be processed using traditional data processing systems and technologies. Big data analytics is a process of examining information and patterns from huge data. Hence, the process needs a system architecture for data collection, transmission, storage, processing and analysis, and visualization mechanisms. In this paper, we review the background and futuristic aspects of big data. We first introduce the history, background and related technologies of big data. We focus on big data system architecture, phases and classes of big data analytics. Then we present an open source big data framework to address some of the big data challenges. Finally, we discuss different applications of big data with some examples.