Defect identification method for ultrasonic inspection of pipeline welds based on cross-modal zero-shot learning

Abstract

Ultrasonic inspection of pipeline welds still uses the traditional visual inspection signal method to identify pipeline defects. The identification of defects relies entirely on the subjective judgment of practitioners and is highly dependent on their level of experience. Deep learning models have achieved very good results in classification tasks, but they rely on a large number of annotated data samples for each category. However, it is difficult to collect a large number of samples with different defects and annotate them for the classification of pipe welding defects. Based on the idea of zero-shot learning (ZSL), which makes full use of experts’ semantic descriptions of defect categories, artificial semantic features are integrated cross-modally with ultrasonic inspection signal features. In this way, a common semantic space containing seen and unseen classes is constructed to achieve the detection of various defects. Meanwhile, to alleviate the problem of extreme imbalance of training data between the seen and unseen classes in ZSL model training, a ZSL model Feature-GAN-ZSL (FGZ) fused with a generative adversarial network (GAN) is proposed. The model utilizes a Feature-GAN network to generate unseen class features during training and adds a classifier to enhance the generation of features with stronger discriminative power. In the experiments, sample data for porosity, incomplete penetration, and cracks were used as visible classes, and samples for incomplete fusion and slag entrapment were used as unseen classes. Five state-of-the-art models in the ZSL domain were compared. The results show that the FGZ model has a good ability to recognize various defects, not only the types of defects that participated in the training but also the defects that did not participate in the training. This plays a perfect role in dealing with various pipeline welding defects.