Weakly-supervised learning based automatic augmentation of aerial insulator images

Abstract

The automatic detection of insulator defects with UAV and CNN-based detectors has become a popular paradigm in recent years. However, insufficient insulator data has always been the bottleneck of detector performance. The existing augmentation method either performs a whole image transformation that lacks new semantic features or generates samples with massive manual annotation. Therefore, this paper proposes an automatic augmentation method called Weakly-Supervised Segmentation Mix (WSSM), where a Foreground Segmentation Network (FSN) is trained under the supervision of the bounding box label to extract the insulators for new sample synthesis. In the FSN training process, UnionMix is designed to generate hard samples based on the pseudo-label, thus facilitating the FSN segmentation ability for insignificant insulator boundaries. Oriented Muti-Instance Loss (OMIL) is proposed to extract supervision from the oriented bounding box so that FSN can be fully trained to handle the diverse angle distribution of insulators. The experiments conducted on the Aerial Insulator Dataset (AID) indicate that the synthesized images of WSSM can achieve stable improvement on multiple mainstream detectors. Both in-domain and cross-domain backgrounds can be used in WSSM to promote the network. For example, the AP of YOLOv5-m can be improved from 68.14 to 69.73 with 2600 COCO images, which exceeds the AP of bassline YOLOv5-l (69.69). To further verify the foreground extraction capability, this paper takes the FSN result as the pseudo-label and trains the instance segmentation network on iSAID. The comparison with existing SOTA methods proves the superior quality of the proposed method.