Anomaly Detection for Water Supply Data using Machine Learning Technique

Abstract

The advent of the era of big data brings new challenges and opportunities to water data processing. Abnormal detection or authenticity verification of water supply data becomes an urgent problem in natural resource data processing. This article addresses the issue of anomaly detection for a set of measured water supply data that provided by the Ministry of Water Resources of China. The machine learning technique, namely, One-Class support vector machine, is used for anomaly detection, and a detailed analysis of the features of anomalies is also provided. Experiments on three situations, namely, one dimensional situation, three dimensional situation and seven dimensional situation are carried out to analyse the features of anomalies. The experiment results revealed that the cases with entries of large values more than 10 times of median, zero entries together with some large values and ascending or descending sequences tend to have high abnormality scores.