Comparative analysis of machine learning models for anomaly detection in manufacturing

Abstract

The introduction of various technologies in the context of Industry 4.0 allowed collecting monitoring data for various fields in manufacturing. Shop-floor and production data can be used for further analysis to extract knowledge. In this paper, an extensive evaluation of ten Machine Learning (ML) models for anomaly detection in manufacturing is conducted. The evaluation is conducted on multiple distinct ML algorithms, including conventional ML and a representative of Deep Neural Network (DNN) based algorithms. The ML models are trained on real production schedules to detect anomalous behavior in the overall system efficiency as well as violations in the delivery date of jobs. Multiple combinations of relevant features are tested during the training of the models. In essence, the objective of the ML models is to detect anomalous unknown breakdowns in the machines that lead to disruption in the overall performance of the system. The evaluation of the ML models is conducted on independent datasets with artificially injected machine breakdowns to establish the ground truth. These schedules with machine breakdowns are obtained through a simulation model. The results point to the high performance of a conventional ML algorithm, KNN. The performance demonstrated by a DNN-based AutoEncoder, conventional Local Outlier Factor-based Feature Bagging, and a recent Copula-Based Outlier Detection (COPOD) algorithms suggest limited applicability, which strongly depends on the shape of the data.