TSMAE: A Novel Anomaly Detection Approach for Internet of Things Time Series Data Using Memory-Augmented Autoencoder

Abstract

With the development of the Internet of Things, it has been widely studied and deployed in industrial manufacturing, intelligent transportation, and healthcare systems. The time-series feature of the IoT makes the data density and the data dimension higher, where anomaly detection is important to ensure hardware and software security. However, the traditional anomaly detection algorithm has difficulty meeting this demand, not only in complexity but also accuracy. Sometimes the anomaly can be well reconstructed, resulting in a low reconstruction error. In this paper, we propose a memory-augmented autoencoder approach for detecting anomalies in IoT data, which aims to use reconstruction errors to determine data anomalies. First, a memory mechanism is introduced to suppress the generalization ability of the model, and a memory-augmented autoencoder TSMAE is designed for time-series data anomaly detection. Second, by adding penalties and derivable rectifier functions to loss to make the addressing vector sparse, memory modules are encouraged to extract typical normal patterns, thus inhibiting model generalization ability. Finally, through experiments on ECG and Wafer datasets, the validity of TSMAE is verified, and the rationality of hyperparameter setting is discussed through visualizing the memory module addressing vector.