Attention‐based vector quantisation variational autoencoder for colour‐patterned fabrics defect detection

Abstract

AbstractDefect detection is an essential link in the fabric production process. Due to the diversity of patterns and scarcity of defect samples for colour‐patterned fabrics, reconstruction‐based unsupervised deep learning algorithms have received extensive attention in the field of fabric defect detection. Among them, unsupervised reconstruction models based on variational autoencoders (VAEs) have been shown to be effective. However, there is a problem of posterior collapse in the process of modelling parametric distributions of continuous variables by VAEs. Therefore, VAE‐based defect detection methods for colour‐patterned fabrics usually produce ambiguous reconstruction results, thereby affecting the defect detection performance. In this article, an attention‐based vector quantisation variational autoencoder (AVQ‐VAE) is proposed for colour‐patterned fabric defect detection. The method adopts autoregressive modelling of discrete variables to avoid the posterior collapse problem of traditional VAEs, and utilises attention mechanism to enhance the feature representation ability of the model. AVQ‐VAE consists of encoder, embedding space, decoder and attention mechanism. The encoder is used to map the input image into multiple feature vectors. Vector quantisation in embedding space is used for discretisation and autoregressive modelling of feature vectors. A decoder is used to decode discrete variables into images of the same size as the original input. Furthermore, an attention mechanism is used to capture channel and spatial correlations, which help the model focus on important information by adaptively recalibrating feature maps. Experimental results on public datasets demonstrate that the proposed method is robust and effective for colour‐patterned fabric defect detection.