Self-Supervised Learning and Multisource Heterogeneous Information Fusion Based Quality Anomaly Detection for Heavy-Plate Shape

Abstract

Plate shape quality anomaly detection suffers from the problems of less labeled and multisource heterogeneous (MSH) data due to the complex production process with multi-process and multi-equipment. To address these problems, this paper proposes a self-supervised learning framework based on MSH contrastive learning (MSH-CL). In the proposed framework, an encoder is designed to extract the MSH information, which contains an MSH feature extract network (MSH-FEN) and an MSH feature fusion network (MSH-FFN). In MSH-FEN, a two-pathway CNN network is employed to extract the MSH feature. Then, a cross-MSH (CMSH) data fusion strategy based on the attention mechanism is designed to characterize the relationship between the MSH data in the MSH-FFN. The learning process consists of two phases, namely the self-supervised feature learning phase based on the contrastive learning (CL) and the supervised fine-tuning phase. The former phase is responsible for training the encoder with massive unlabeled data. Then, a classifier followed by the encoder is built with less labeled data in the supervised fine-tuning phase, which is applied to plate shape quality anomaly detection. Finally, the experiments are carried out on the real-world data set collected from a heavy-plate production process. The experimental results demonstrate the effectiveness and superiority of the proposed approach. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Note to Practitioners</i> —This paper focuses on the problem of shape quality anomaly detection for the heavy-plate production process, which is crucial to steel-making. However, the most quality-relevant data-driven modeling approaches suffer from the problem of requiring massive labeled data. In addition, the data generated in the practice heavy-plate production process have the characteristics of multisource heterogeneous (MSH). Motivated by the challenge of the less labeled and MSH data modeling, this paper proposed a self-supervised feature learning approach to learn a feature encoder to model the MSH data. Then, fine-tuning is used to obtain the model to detect the plate shape quality. In the feature encoder, a cross-MSH (CMSH) data fusion strategy is proposed. Finally, the effectiveness of the proposed approach is demonstrated by comparing it with other advanced algorithms. The proposed approach can be extended to other heavy-plate quality anomaly detection problems with less labeled and MSH data.