Automatic Skin Lesion Segmentation Research Articles

Automatic skin lesion segmentation using attention residual U-Net with improved encoder-decoder architecture

Automatic skin lesion segmentation using attention residual U-Net with improved encoder-decoder architecture

Identification of Skin Lesions by Snapshot Hyperspectral Imaging.

This study pioneers the application of artificial intelligence (AI) and hyperspectral imaging (HSI) in the diagnosis of skin cancer lesions, particularly focusing on Mycosis fungoides (MF) and its differentiation from psoriasis (PsO) and atopic dermatitis (AD). By utilizing a comprehensive dataset of 1659 skin images, including cases of MF, PsO, AD, and normal skin, a novel multi-frame AI algorithm was used for computer-aided diagnosis. The automatic segmentation and classification of skin lesions were further explored using advanced techniques, such as U-Net Attention models and XGBoost algorithms, transforming images from the color space to the spectral domain. The potential of AI and HSI in dermatological diagnostics was underscored, offering a noninvasive, efficient, and accurate alternative to traditional methods. The findings are particularly crucial for early-stage invasive lesion detection in MF, showcasing the model's robust performance in segmenting and classifying lesions and its superior predictive accuracy validated through k-fold cross-validation. The model attained its optimal performance with a k-fold cross-validation value of 7, achieving a sensitivity of 90.72%, a specificity of 96.76%, an F1-score of 90.08%, and an ROC-AUC of 0.9351. This study marks a substantial advancement in dermatological diagnostics, thereby contributing significantly to the early and precise identification of skin malignancies and inflammatory conditions.

ETU-Net: edge enhancement-guided U-Net with transformer for skin lesion segmentation

Objective. Convolutional neural network (CNN)-based deep learning algorithms have been widely used in recent years for automatic skin lesion segmentation. However, the limited receptive fields of convolutional architectures hinder their ability to effectively model dependencies between different image ranges. The transformer is often employed in conjunction with CNN to extract both global and local information from images, as it excels at capturing long-range dependencies. However, this method cannot accurately segment skin lesions with blurred boundaries. To overcome this difficulty, we proposed ETU-Net. Approach. ETU-Net, a novel multi-scale architecture, combines edge enhancement, CNN, and transformer. We introduce the concept of edge detection operators into difference convolution, resulting in the design of the edge enhanced convolution block (EC block) and the local transformer block (LT block), which emphasize edge features. To capture the semantic information contained in local features, we propose the multi-scale local attention block (MLA block), which utilizes convolutions with different kernel sizes. Furthermore, to address the boundary uncertainty caused by patch division in the transformer, we introduce a novel global transformer block (GT block), which allows each patch to gather full-size feature information. Main results. Extensive experimental results on three publicly available skin datasets (PH2, ISIC-2017, and ISIC-2018) demonstrate that ETU-Net outperforms state-of-the-art hybrid methods based on CNN and Transformer in terms of segmentation performance. Moreover, ETU-Net exhibits excellent generalization ability in practical segmentation applications on dermatoscopy images contributed by the Wuxi No.2 People’s Hospital. Significance. We propose ETU-Net, a novel multi-scale U-Net model guided by edge enhancement, which can address the challenges posed by complex lesion shapes and ambiguous boundaries in skin lesion segmentation tasks.

HSH-UNet: Hybrid selective high order interactive U-shaped model for automated skin lesion segmentation

The use of computer-assisted clinical dermatologists to diagnose skin diseases is an important aid. And computer-assisted techniques mainly use deep neural networks. Recently, the proposal of higher-order spatial interaction operations in deep neural networks has attracted a lot of attention. It has the advantages of both convolution and transformers, and additionally has the advantages of efficient, extensible and translation-equivariant. However, the selection of the interaction order in higher-order interaction operations requires tedious manual selection of a suitable interaction order. In this paper, a hybrid selective higher-order interaction U-shaped model HSH-UNet is proposed to solve the problem that requires manual selection of the order. Specifically, we design a hybrid selective high-order interaction module HSHB embedded in the U-shaped model. The HSHB adaptively selects the appropriate order for the interaction operation channel-by-channel under the computationally obtained guiding features. The hybrid order interaction also solves the problem of fixed order of interaction at each level. We performed extensive experiments on three public skin lesion datasets and our own dataset to validate the effectiveness of our proposed method. The ablation experiments demonstrate the effectiveness of our hybrid selective higher order interaction module. The comparison with state-of-the-art methods also demonstrates the superiority of our proposed HSH-UNet performance. The code is available at https://github.com/wurenkai/HSH-UNet.

Attention-based dual-path feature fusion network for automatic skin lesion segmentation

Automatic segmentation of skin lesions is a critical step in Computer Aided Diagnosis (CAD) of melanoma. However, due to the blurring of the lesion boundary, uneven color distribution, and low image contrast, resulting in poor segmentation result. Aiming at the problem of difficult segmentation of skin lesions, this paper proposes an Attention-based Dual-path Feature Fusion Network (ADFFNet) for automatic skin lesion segmentation. Firstly, in the spatial path, a Boundary Refinement (BR) module is designed for the output of low-level features to filter out irrelevant background information and retain more boundary details of the lesion area. Secondly, in the context path, a Multi-scale Feature Selection (MFS) module is constructed for high-level feature output to capture multi-scale context information and use the attention mechanism to filter out redundant semantic information. Finally, we design a Dual-path Feature Fusion (DFF) module, which uses high-level global attention information to guide the step-by-step fusion of high-level semantic features and low-level detail features, which is beneficial to restore image detail information and further improve the pixel-level segmentation accuracy of skin lesion. In the experiment, the ISIC 2018 and PH2 datasets are employed to evaluate the effectiveness of the proposed method. It achieves a performance of 0.890/ 0.925 and 0.933 /0.954 on the F1-score and SE index, respectively. Comparative analysis with state-of-the-art segmentation methods reveals that the ADFFNet algorithm exhibits superior segmentation performance.

Performance and Analysis of a U-Net Model for Automated Skin Lesion Segmentation

A greater proportion of people are affected by skin cancer, particularly melanoma, which has a higher tendency to metastasize. For Dermatologist, Visual inspections are most challenging & complex task for melanoma detection. To solve this problem, dermoscopic images are analyzed and segmented. Due to the sensitivity involved in surgical operations, existing techniques are unable to achieve higher accuracy. As a result, computer-aided systems are essential to detect & segment dermoscopic images.
 In this paper, for segmentation 5000 skin images were taken from the HAM10000 dataset. Prior to segmentation, preprocessing is done by resizing images. A novel U Net structure is a fully convolutional network is presented & implemented using up-sampling and down-sampling technique with Rectified Linear Units (ReLU) for activation functions. The outcomes of proposed methodology shows performance improvement for skin-lesion segmentation with 94.7 % pixel accuracy & 89.2 % dice coefficient compared with existing KNN & SVM techniques.

An efficient multi-level pre-processing algorithm for the enhancement of dermoscopy images in melanoma detection.

In this paper, a multi-level algorithm for pre-processing of dermoscopy images is proposed, which helps in improving the quality of the raw images, making it suitable for skin lesion detection. This multi-level pre-processing method has a positive impact on automated skin lesion segmentation using Regularized Extreme Learning Machine. Raw images are subjected to de-noising, illumination correction, contrast enhancement, sharpening, reflection removal, and virtual shaving before the skin lesion segmentation. The Non-Local Means (NLM) filter with lowest Blind Reference less Image Spatial Quality Evaluator (BRISQUE) score exhibits better de-noising of dermoscopy images. To suppress uneven illumination, gamma correction is subjected to the denoised image. The Robust Image Contrast Enhancement (RICE) algorithm is used for contrast enhancement, and produces enhanced images with better structural preservation and negligible loss of information. Unsharp masking for sharpening exhibits low BRISQUE scores for better sharpening of fine details in an image. Output images produced by the phase congruency-based method in virtual shaving show high similarity with ground truth images as the hair is removed completely from the input images. Obtained scores at each stage of pre-processing framework show that the performance is superior compared to all the existing methods, both qualitatively and quantitatively, in terms of uniform contrast, preservation of information content, removal of undesired information, and elimination of artifacts in melanoma images. The output of the proposed system is assessed qualitatively and quantitatively with and without pre-processing of dermoscopy images. From the overall evaluation results, it is found that the segmentation of skin lesion is more efficient using Regularized Extreme Learning Machine if the multi-level pre-processing steps are used in proper sequence.

GA-Net: Ghost convolution adaptive fusion skin lesion segmentation network

Automatic segmentation of skin lesions is a pivotal task in computer-aided diagnosis, playing a crucial role in the early detection and treatment of skin cancer. Despite the existence of numerous deep learning-based segmentation methods, the extraction of lesion features remains inadequate as a result of the segmentation process. Consequently, skin lesion image segmentation continues to face challenges regarding missing detailed information and inaccurate segmentation of the lesion region. In this paper, we propose a ghost convolution adaptive fusion network for skin lesion segmentation. First, the neural network incorporates a ghost module instead of the ordinary convolution layer, generating a rich skin lesion feature map for comprehensive target feature extraction. Subsequently, the network employs an adaptive fusion module and bilateral attention module to connect the encoding and decoding layers, facilitating the integration of shallow and deep network information. Moreover, multi-level output patterns are used for pixel prediction. Layer feature fusion effectively combines output features of different scales, thus improving image segmentation accuracy. The proposed network was extensively evaluated on three publicly available datasets: ISIC2016, ISIC2017, and ISIC2018. The experimental results demonstrated accuracies of 96.42%, 94.07%, and 95.03%, and kappa coefficients of 90.41%, 81.08%, and 86.96%, respectively. The overall performance of our network surpassed that of existing networks. Simulation experiments further revealed that the ghost convolution adaptive fusion network exhibited superior segmentation results for skin lesion images, offering new possibilities for the diagnosis of skin diseases.

ABT-GAMNet: A novel adaptive Boundary-aware transformer with Gated attention mechanism for automated skin lesion segmentation

Segmentation of skin lesions is the hotspot development process in the medical field. As skin cancer becomes most disastrous for humans, it requires framing an effective model for identifying the lesion region over the skin. As represented in the image format, implementing the decision-based system is quite challenging. Owing to the noise and artifacts in images, it becomes cumbersome to segment the exact lesion regions over the skin images. In recent years, the deep learning model is used to attain the expected results. Yet, it still subsists with overfitting issues and large-scale dimensional datasets, it mitigates the segmentation results. To meet up the pre-requisite, a novel adaptive-based segmentation technique is proposed for skin lesion segmentation. In the first stage, the source images are fetched from the reputed skin image data sources. It is followed by pre-processing stage. In the second phase, the pre-processing is done in two ways: (i) filtering methods and (ii) adaptive Contrast Limited Adaptive Histogram Equalization (CLAHE). In the adaptive CLAHE model, the threshold value is optimized by proposing the new hybrid algorithm as Hybrid Rat Electric Fish Swarm Optimization (HREFSO) for enhancing the contrast level in pre-processed images. Subsequently, the pre-processed images are fed into the novel Adaptive Boundary-aware Transformer with Gated Attention Mechanism (ABT-GAM) for segmenting the lesion regions in images. To improve the segmentation accuracy, the parameters are determined optimally using HREFSO. The evaluation is performed and validated across various metrics. Hence, the outcome elucidates that it acquires a higher segmentation accuracy for diagnosing skin cancer.

A Collaborative Learning Model for Skin Lesion Segmentation and Classification.

The automatic segmentation and classification of skin lesions are two essential tasks in computer-aided skin cancer diagnosis. Segmentation aims to detect the location and boundary of the skin lesion area, while classification is used to evaluate the type of skin lesion. The location and contour information of lesions provided by segmentation is essential for the classification of skin lesions, while the skin disease classification helps generate target localization maps to assist the segmentation task. Although the segmentation and classification are studied independently in most cases, we find meaningful information can be explored using the correlation of dermatological segmentation and classification tasks, especially when the sample data are insufficient. In this paper, we propose a collaborative learning deep convolutional neural networks (CL-DCNN) model based on the teacher-student learning method for dermatological segmentation and classification. To generate high-quality pseudo-labels, we provide a self-training method. The segmentation network is selectively retrained through classification network screening pseudo-labels. Specially, we obtain high-quality pseudo-labels for the segmentation network by providing a reliability measure method. We also employ class activation maps to improve the location ability of the segmentation network. Furthermore, we provide the lesion contour information by using the lesion segmentation masks to improve the recognition ability of the classification network. Experiments are carried on the ISIC 2017 and ISIC Archive datasets. The CL-DCNN model achieved a Jaccard of 79.1% on the skin lesion segmentation task and an average AUC of 93.7% on the skin disease classification task, which is superior to the advanced skin lesion segmentation methods and classification methods.

GFANet: Gated Fusion Attention Network for skin lesion segmentation

Automatic segmentation of skin lesions is crucial for diagnosing and treating skin diseases. Although current medical image segmentation methods have significantly improved the results of skin lesion segmentation, the following major challenges still affect the segmentation performance: (i) segmentation targets have irregular shapes and diverse sizes and (ii) low contrast or blurred boundaries between lesions and background. To address these issues, this study proposes a Gated Fusion Attention Network (GFANet) which designs two progressive relation decoders to accurately segment skin lesions images. First, we use a Context Features Gated Fusion Decoder (CGFD) to fuse multiple levels of contextual features, and then a prediction result is generated as the initial guide map. Then, it is optimized by a prediction decoder consisting of a shape flow and a final Gated Convolution Fusion (GCF) module, where we iteratively use a set of Channel Reverse Attention (CRA) modules and GCF modules in the shape flow to combine the features of the current layer and the prediction results of the adjacent next layer to gradually extract boundary information. Finally, to speed up network convergence and improve segmentation accuracy, we use GCF to fuse low-level features from the encoder and the final output of the shape flow. To verify the effectiveness and advantages of the proposed GFANet, we conduct extensive experiments on four publicly available skin lesion datasets (International Skin Imaging Collaboration [ISIC] 2016, ISIC 2017, ISIC 2018, and PH2) and compare them with state-of-the-art methods. The experimental results show that the proposed GFANet achieves excellent segmentation performance in commonly used evaluation metrics, and the segmentation results are stable. The source code is available at https://github.com/ShiHanQ/GFANet.

SL-HarDNet: Skin lesion segmentation with HarDNet.

Automatic segmentation of skin lesions from dermoscopy is of great significance for the early diagnosis of skin cancer. However, due to the complexity and fuzzy boundary of skin lesions, automatic segmentation of skin lesions is a challenging task. In this paper, we present a novel skin lesion segmentation network based on HarDNet (SL-HarDNet). We adopt HarDNet as the backbone, which can learn more robust feature representation. Furthermore, we introduce three powerful modules, including: cascaded fusion module (CFM), spatial channel attention module (SCAM) and feature aggregation module (FAM). Among them, CFM combines the features of different levels and effectively aggregates the semantic and location information of skin lesions. SCAM realizes the capture of key spatial information. The cross-level features are effectively fused through FAM, and the obtained high-level semantic position information features are reintegrated with the features from CFM to improve the segmentation performance of the model. We apply the challenge dataset ISIC-2016&PH2 and ISIC-2018, and extensively evaluate and compare the state-of-the-art skin lesion segmentation methods. Experiments show that our SL-HarDNet performance is always superior to other segmentation methods and achieves the latest performance.

Attention Res-UNet

During a dermoscopy examination, accurate and automatic skin lesion detection and segmentation can assist medical experts in resecting problematic areas and decrease the risk of deaths due to skin cancer. In order to develop fully automated deep learning model for skin lesion segmentation, the authors design a model Attention Res-UNet by incorporating residual connections, squeeze and excite units, atrous spatial pyramid pooling, and attention gates in basic UNet architecture. This model uses focal tversky loss function to achieve better trade off among recall and precision when training on smaller size lesions while improving the overall outcome of the proposed model. The results of experiments have demonstrated that this design, when evaluated on publicly available ISIC 2018 skin lesion segmentation dataset, outperforms the existing standard methods with a Dice score of 89.14% and IoU of 81.16%; and achieves better trade off among precision and recall. The authors have also performed statistical test of this model with other standard methods and evaluated that this model is statistically significant.

A Novel Sep-Unet Architecture of Convolutional Neural Networks to Improve Dermoscopic Image Segmentation by Training Parameters Reduction

Nowadays, we use dermoscopic images as one of the imaging methods in diagnosis of skin lesions such as skin cancer. But due to the noise and other problems, including hair artifacts around the lesion, this issue requires automatic and reliable segmentation methods. The diversity in the color and structure of the skin lesions is a challenging reason for automatic skin lesion segmentation. In this study, we used convolutional neural networks (CNN) as an efficient method for dermoscopic image segmentation. The main goal of this research is to recommend a novel architecture of deep neural networks for the injured lesion in dermoscopic images which has been improved by the convolutional layers based on the separable layers. By convolutional layers and the specific operations on the kernel of them, the velocity of the algorithm increases and the training parameters decrease. Additionally, we used a suitable preprocessing method to enter the images into the neural network. Suitable structure of the convolutional layers, separable convolutional layers and transposed convolution in the down sampling and up sampling parts, have made the structure of the mentioned neural network. This algorithm is named Sep-unet and could segment the images with 98% dice coefficient.

BLA-Net:Boundary learning assisted network for skin lesion segmentation

Background and Objective: Automatic skin lesion segmentation plays an important role in computer-aided diagnosis of skin diseases. However, current segmentation networks cannot accurately detect the boundaries of the skin lesion areas. Methods: In this paper, a boundary learning assisted network for skin lesion segmentation is proposed, namely BLA-Net, which adopts ResNet34 as backbone network under an encoder-decoder framework. The overall architecture is divided into two key components: Primary Segmentation Network (PSNet) and Auxiliary Boundary Learning Network (ABLNet). PSNet is to locate the skin lesion areas. Dynamic Deformable Convolution is introduced into the lower layer of the encoder, so that the network can effectively deal with complex skin lesion objects. And a Global Context Information Extraction Module is proposed and embedded into the high layer of the encoder to capture multi-receptive field and multi-scale global context features. ABLNet is to finely detect the boundaries of skin lesion area based on the low-level features of the encoder, in which an object regional attention mechanism is proposed to enhance the features of lesion object area and suppress those of irrelevant regions. ABLNet can assist the PSNet to realize accurate skin lesion segmentation. Results: We verified the segmentation performance of the proposed method on the two public dermoscopy datasets, namely ISBI 2016 and ISIC 2018. The experimental results show that our proposed method can achieve the Jaccard Index of 86.6%, 84.8% and the Dice Coefficient of 92.4%, 91.2% on ISBI 2016 and ISIC 2018 datasets, respectively. Conclusions: Compared with existing methods, the proposed method can achieve the state-of-the-arts segmentation accuracy with less model parameters, which can assist dermatologists in clinical diagnosis and treatment.

Weakly supervised skin lesion segmentation based on spot‐seeds guided optimal regions

Automatic skin lesion segmentation is the most critical and relevant task in computer-aided skin cancer diagnosis. Methods based on convolutional neural networks (CNNs) are mainly used in current skin lesion segmentation. The requirement of huge pixel-level labels is a significant obstacle to achieve semantic segmentation of skin lesion by CNNs. In this paper, a novel weakly supervised framework for skin lesion segmentation is presented, which generates high-quality pixel-level annotations and optimizes the segmentation network. A hierarchical image segmentation algorithm can predict a boundary map for training images. Then, the optimal regions of candidate hierarchical levels are selected. Afterward, Superpixels-CRF built on the optimal regions is guided by spot seeds to propagate information from spot seeds to unlabeled regions, resulting in high-quality pixel-level annotations. Using these high-quality pixel-level annotations, a segmentation network can be trained and segmentation masks can be predicted. To iteratively optimize the segmentation network, the predicted segmentation masks are refined and the segmentation network are retrained. Comparative experiments demonstrate that the proposed segmentation framework reduces the gap between weakly and fully supervised skin lesion segmentation methods, and achieves state-of-the-art performance while reducing human labeling efforts.

SLT-Net: A codec network for skin lesion segmentation

Automatic segmentation of skin lesions is beneficial for improving the accuracy and efficiency of melanoma diagnosis. However, due to variation in the size and shape of the lesion areas and the low contrast between the edges of the lesion and the normal skin tissue, this task is very challenging. The traditional convolutional neural network based on codec structure lacks the capability of multi-scale context information modeling and cannot realize information interaction of skip connections at the various levels, which limits the segmentation performance. Therefore, a new codec structure of skin lesion Transformer network (SLT-Net) was proposed and applied to skin lesion segmentation in this study. Specifically, SLT-Net used CSwinUnet as the codec to model the long-distance dependence between features and used the multi-scale context Transformer (MCT) as the skip connection to realize information interaction between skip connections across levels in the channel dimension. We have performed extensive experiments to verify the effectiveness and superiority of our proposed method on three public skin lesion datasets, including the ISIC-2016, ISIC-2017, and ISIC-2018. The DSC values on the three data sets reached 90.45%, 79.87% and 82.85% respectively, higher than most of the state-of-the-art methods. The excellent performance of SLT-Net on these three datasets proved that it could improve the accuracy of skin lesion segmentation, providing a new benchmark reference for skin lesion segmentation tasks. The code is available at https://github.com/FengKaili-fkl/SLT-Net.git.

Dynamic prototypical feature representation learning framework for semi-supervised skin lesion segmentation

Automated skin lesion segmentation is an essential yet challenging task for computer-aided skin disease diagnosis. One major challenge for learning-based segmentation method is the limited manually annotated dermoscopy images. Many semi-supervised methods are proposed to exploit unlabeled data by self-training with pseudo labels. However, the plain pseudo labels are less accurate and the pixel-wise features of unlabeled data are always not well formulated due to the large variations among different lesions. Aiming at producing a good segmentation embedding space in a semi-supervised manner, in this paper, we propose a novel dynamic prototypical feature representation learning framework to address these problems. Specifically, we propose a novel denoised pseudo label generation method, which effectively filters out the unreliable components in plaint pseudo labels and provides the guidance for the subsequent feature representation learning. Then, we propose a memory relation learning method to enhance the intermediate feature representation globally. Additionally, we propose a prototype-based confidence-aware contrastive learning method to learn a better local feature structure in semi-supervised training, strengthening intra-class compactness and inter-class separability. Extensive experiments on two skin lesion segmentation datasets demonstrate that our method outperforms other popular semi-supervised segmentation methods.

A Novel Approach to Skin Lesion Segmentation: Multipath Fusion Model with Fusion Loss.

Segmentation of skin lesions plays a very important role in the early detection of skin cancer. However, indistinguishability due to various artifacts such as hair and contrast between normal skin and lesioned skin is an important challenge for specialist dermatologists. Computer-aided diagnostic systems using deep convolutional neural networks are gaining importance in order to cope with difficulties. This study focuses on deep learning-based fusion networks and fusion loss functions. For the automatic segmentation of skin lesions, U-Net (U-Net + ResNet 2D) with 2D residual blocks and 2D volumetric convolutional neural networks were fused for the first time in this study. Also, a new fusion loss function is proposed by combining Dice Loss (DL) and Focal Tversky Loss (FTL) to make the proposed fused model more robust. Of the 2594 image dataset, 20% is reserved for test data and 80% for training data. In test data training, a Jaccard score of 0.837 and a dice score of 0.918 were obtained. The proposed model was also scored on the ISIC 2018 Task 1 test images, whose ground truths were not shared. The proposed model performed well and achieved a Jaccard index of 0.800 and a dice score of 0.880 in the ISIC 2018 Task 1 test set. In addition, it has been observed that the new fused loss function obtained by fusing Focal Tversky Loss and Dice Loss functions in the proposed model increases the robustness of the model in the tests. The proposed new loss function fusion model has outstripped the cutting-edge approaches in the literature.

Skin lesion segmentation using a semi-supervised U-NetSC model with an adaptive loss function.

Skin lesion segmentation is a crucial step in cancer detection. Deep learning has shown promising results for lesion segmentation. However, the performance of these models depends on accessing lots of training samples with pixel-level annotations. Employing a semi-supervised approach reduces the need for a large number of annotated samples. Accordingly, a semi-supervised strategy is proposed based on the high correlation of segmentation and classification tasks. The U - N et Segmentation and Classification model (U-NetSC) is a unified architecture containing segmentation and classification modules. The classification module uses feature maps from the last layer of the segmentation model to increase the collaboration of two tasks. U-NetSC can be trained with only class-level or both class-level and pixel-level ground truth using an adaptive loss function. U-NetSC achieves ~2%, ~ 2%, ~ 3%, and ~ 1 % improvement in Jaccard Index, Dice coefficient, precision, and accuracy, respectively, in comparison with a supervised attention-gated U-Net model. Clinical relevance - The paper proposes an automatic skin lesion segmentation model in a semi-supervised manner. Training the segmentation model is based on a combination of class-level and pixel-level information without requiring a large number of labeled samples.