Poisson-based image editing for semi-supervised vitiligo lesion segmentation with limited annotations

Abstract

Vitiligo lesion segmentation is crucial for the assessment and treatment of vitiligo. There are two significant challenges in this problem, namely, the availability of dense segmentation annotations and the collection of large amounts of vitiligo images, which are also major challenges in medical image analysis (MIA). However, most existing methods often heavily rely on the availability of large-scale labeled datasets and high-quality annotations. Consequently, the performance of these models may not be easily reproducible or transferable to those domains with limited data availability. As a result, there is a need to develop alternative approaches that can leverage unlabeled datasets for segmentation with a small-scale training set. In this paper, we propose a data augmentation strategy based on image editing, which can synthesize a large number of samples using a small number of annotated data. The synthesized examples are of high visual quality and enforce the segmentation performance without any cost. Besides, we also adapt the Mean-Teacher framework for reliable predictions mining from unlabeled samples to alleviate the demands of densely annotated segmentations. We obtain pseudo-labels for unlabeled samples by utilizing highly confident pixels. On the other hand, we proposed a new Bimodal Vitiligo Lesions Segmentation (BVLS) dataset containing fine-grain segmentation masks and bimodal images usually used for vitiligo diagnosis to mitigate the lack of a vitiligo segmentation dataset. Extensive experiments conducted on the BLVS dataset demonstrate that our approach can achieve significant improvements (+17.27%) compared with previous data augmentation methods on the UNet backbone. Furthermore, the semi-supervised framework can reach an IoU of 49.71% with only 10% annotated images. Our code and dataset are availabel at https://github.com/JcWang20/BLVS.