Hair Segmentation and Removal in Dermoscopic Images Using Deep Learning

Abstract

Melanoma and non-melanoma skin cancers have shown a rapidly increasing incidence rate, pointing to skin cancer as a major problem for public health. When analyzing these lesions in dermoscopic images, the hairs and their shadows on the skin may occlude relevant information about the lesion at the time of diagnosis, reducing the ability of automated classification and diagnosis systems. In this work, we present a new approach for the task of hair removal on dermoscopic images based on deep learning techniques. Our proposed model relies on an encoder-decoder architecture, with convolutional neural networks, for the detection and posterior restoration of hair’s pixels from the images. Moreover, we introduce a new combined loss function in the network’s training phase that combines the $L_{1}$ distance, the total variation loss, and a loss function based on the structural similarity index metric. Currently, there are no datasets that contain the same images with and without hair, which is necessary to quantitatively evaluate our model. Thus, we simulate the presence of hair in hairless images extracted from publicly known datasets. We compare our results with six state-of-the-art algorithms based on traditional computer vision techniques by means of similarity measures that compare the reference hairless image and the one with simulated hair. Finally, the Wilcoxon signed-rank test is used to compare the methods. The results, both qualitatively and quantitatively, demonstrate the effectiveness of our model and how our loss function improves the restoration ability of the proposed model.