Abstract
Each software always has log data. Log data is essential for developers and end-users. With log data, we can indicate the information of system error, warning events or whether our system processes are loading successfully. This paper aims to provide a virtualization platform for our campus NetFlow log data in order user can use for further analysis. Our system used Ceph storage system and ELK Stack technology. Ceph provides a vast amount of scalable storage and ELK consists of three components, namely: Elasticsearch, Logstash, and Kibana. Elasticsearch is a search engine in which can be used for searching all kinds of documents. Logstash is used for managing centralize, transform and stash our data to Elasticsearch and Kibana is used for visualizing Elasticsearch data and an excellent tool for a real-time data analytics and decision making. Our data is continuous data. Approximately our data growth up 38 GB per day and our data have grown more than 8TB until now.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
