Anomaly detection for high-dimensional data using a novel autoencoder-support vector machine

Abstract

Aiming at anomaly detection upon a high-dimensional space, this paper proposed a novel autoencoder-support vector machine. The key thought is that using the autoencoder extracts the features from high-dimensional data, and then the support vector machine achieves the separation of abnormal features and normal features. To increase the precision of identifying anomalies, Chebyshev’s theorem was used to estimate the upper of the number of abnormal features. Meanwhile, the dot product operation was implemented in order to strengthen the learning of the model for class labels. Experiment results show that the detected accuracy of the proposed method is 0.766 when the data dimensionality is 5408, and also wins over competitors in detected performance for the considered cases. We also demonstrate that the strengthened learning of class labels can improve the ability of the model to detect anomalies. In terms of noise resistance and overcoming the curse of dimensionality, the former can carry out more efforts than the latter.