Transformer-enabled generative adversarial imputation network with selective generation (SGT-GAIN) for missing region imputation

Abstract

Although data have been extensively leveraged for process monitoring and control in advanced manufacturing, it still suffers from the connection issues among sensors, machines, and computers, which may lead to significant data loss, i.e., missing region in the collected data, in the application of data-driven monitoring. To address the missing region issues, one popular way is to perform missing data imputation. With the advances of machine learning, many approaches have been developed for the missing data imputation, such as the popular Generative Adversarial Imputation Network (GAIN), which is based on the Generative Adversarial Network (GAN). However, the inherent shortcomings of generative adversarial architecture may still lead to unstable training. More importantly, the collected online sensor data in manufacturing are in sequential order whereas GAIN considered the input data independently. Hence, to address these two limitations, this work proposes a novel approach termed transformer-enabled GAIN with selective generation (SGT-GAIN). The contributions of the proposed SGT-GAIN consist of three aspects: (i) the architecture for transformer-enabled generation is developed to capture the sequential information among the data; (ii) a selective multi-generation framework is proposed to further reduce the imputation bias; and (iii) an ensemble learning framework is applied to enhance the imputation robustness. Both the numerical simulation study and a real-world case study in additive manufacturing demonstrated the effectiveness of the proposed SGT-GAIN.