Divide and conquer anomaly detection: A case study predicting defective engines

Abstract

The goal of this paper is to test if data partitioning based on domain knowledge improves the performance of unsupervised anomaly detection algorithms for the detection of faulty internal combustion engines. We test three common anomaly detection algorithms to predict defective engines at the end of an assembly line, both with and without data partitioning. The algorithms are trained on high-dimensional vibration data. To evaluate and compare the detection performance of partitioned and unpartitioned approaches, we use a labeled collection of known anomalies. Using domain knowledge to partition the data improves the anomaly detection performance of all tested algorithms. A divide and conquer strategy based on data partitioning, thus, appears to be a viable anomaly detection approach in cases where abundant unlabeled data is available.