Deep learning for collective anomaly detection

Abstract

Deep learning has been performing well in a number of application domains. Inspired by its popularity in domains such as image processing, speech recognition, etc., in this paper we explore the effectiveness of deep learning and other supervised learning algorithms for collective anomaly detection. Recently, collective anomaly has become popular for denial of service (DoS) attack detection, however, all these approaches are unsupervised in nature and often have high false alarm rate due to being unsupervised. Therefore, to reduce the false alarm rates, we have experimented using the deep learning method which is supervised in nature. Our experimental results on UNSW-NB15 and KDD Cup 1999 datasets show that the deep learning implemented using H2O achieves ≈97% recall for collective anomaly detection. Deep learning outperforms a wide range of unsupervised techniques for collective anomaly detection. The key insight of this paper is to report the efficiency of deep learning for collective anomaly detection. To the best of our knowledge, this paper is the first one to address the collective anomaly detection problem using deep learning.