A Novel Security Architecture Based on Haystack System for HDFS Storage System: Extended Work

Abstract

Over the past few years, the digitization of our different daily transactions and our activities have helped to create the new Big Data era. This phenomenon has become more widely used in different fields for many reasons, such as information retrieval, decision making, etc. But keeping this data safe from any attack attempts constitutes a real challenge. Indeed, Big Data security has become very important recently, since all technologies and large organizations have become dependent on these Data. For this reason, we deal with the Big Data security problems, especially those encountered during their management and treatment, and more precisely, those appeared during the processing with Hadoop system. The paper aims to highlight the Big Data system processing situation in terms of security, also it shed light on some existing security solutions used for overcoming these security issues, we will reveal its strengths and its weaknesses according to the security pillars. Subsequently, we will present our new security architecture, based on Haystack intrusion detection system, which serves to improve the inactive data security contained in HDFS, while analyzing its feasibility and its parameters