Identification of gastric signet ring cell carcinoma based on endoscopic images using few-shot learning

Abstract

BackgroundDeep learning (DL) models perform poorly when there are limited gastric signet ring cell carcinoma (SRCC) samples. Few-shot learning (FSL) can address the small sample problem. MethodsEfficientNetV2-S was first pretrained on ImageNet and then pretrained on esophageal endoscopic images (i.e., base classes: normal vs. early cancer vs. advanced cancer) using transfer learning. Second, images of gastric benign ulcers, adenocarcinoma and SRCC, i.e., novel classes (n = 50 per class), were included. Image features were extracted as vectors using the dual pretrained EfficientNetV2-S. Finally, a k-nearest neighbor classifier was used to identify SRCC. The above proposed 3-way 3-shot FSL framework was conducted in three rounds. ResultsDual pretrained FSL performed better than single pretrained FSL, endoscopists and traditional EfficientNetV2-S models. Dual pretrained FSL obtained the highest accuracy (79.4%), sensitivity (68.8%), recall (68.8%), precision (69.3%) and F1-score (0.691), and the senior endoscopist achieved the highest specificity of 93.6% when identifying SRCC. The macro-AUC and F1-score for dual pretraining (0.763 and 0.703, respectively) were higher than those for single pretraining (0.656 and 0.537, respectively), along with endoscopists and traditional EfficientNetV2-S models. The 2-way 3-shot FSL also performed better. ConclusionThe proposed FSL framework showed practical performance in the differentiation of SRCC on endoscopic images, suggesting the potential of FSL in the computer-aided diagnosis for rare diseases.