Abstract

This paper presents the architecture of a secure big data lake framework, the foundation of which is the Data Lake Architecture Framework (SDLAF). Security is entrusted to 2 components: Global Monitoring Tool (GMT), Check Sum Controller (CSC). The first one monitors data lake logs, automatically detecting anomalous data, the second one tracks the history of loading, processing, and unloading of file objects in the data lake. The conducted instrumental audit demonstrates both the effectiveness of the architecture and its prospects.

Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call