Wireless Capsule Endoscopy Images Research Articles

Vision transformer distillation for enhanced gastrointestinal abnormality recognition in wireless capsule endoscopy images.

Wireless capsule endoscopy (WCE) is a non-invasive technology used for diagnosing gastrointestinal abnormalities. A single examination generates images, making manual review both time-consuming and costly for doctors. Therefore, the development of computer vision-assisted systems is highly desirable to aid in the diagnostic process. We presents a deep learning approach leveraging knowledge distillation (KD) from a convolutional neural network (CNN) teacher model to a vision transformer (ViT) student model for gastrointestinal abnormality recognition. The CNN teacher model utilizes attention mechanisms and depth-wise separable convolutions to extract features from WCE images, supervising the ViT in learning these representations. The proposed method achieves accuracy of 97% and 96% on the Kvasir and KID datasets, respectively, demonstrating its effectiveness in distinguishing normal from abnormal regions and bleeding from non-bleeding cases. The proposed approach offers computational efficiency and generalization to unseen datasets, outperforming several state-of-the-art methods. We proposed a deep learning approach utilizing CNNs and a ViT with KD to effectively classify gastrointestinal diseases in WCE images. It demonstrates promising performance on public datasets, distinguishing normal from abnormal regions and bleeding from non-bleeding cases while offering optimal computational efficiency compared with existing methods, making it suitable for GI disease applications.

A novel automatic locating method for pylorus and ileocecal valve in wireless capsule endoscopy

A novel automatic locating method for pylorus and ileocecal valve in wireless capsule endoscopy

Lossless compression of wireless capsule image using the Tetrolet transform coupled with modified capsule SPIHT

ABSTRACT The diagnostic technique known as wireless capsule endoscopy (WCE) is helpful in determining gastrointestinal issues. The capsule’s passive motion produces redundant data, and sending large amounts of data uncompressed costs more money and energy. Due to the intrinsic properties of the capsule, it is particularly desirable to have a low-complexity, low-power design that can compress the lossless compression module while still complying with capsule endoscopy regulations. This work’s primary goal is to propose a lossless compression with minimal complexity and power technique for WCE image compression. WCE images are first transformed to YUV colour space in order to remove unnecessary information from chroma components. The Tetrolet transform is then used to break down the YUV image. A Tetrolet transform is a shape made up of four tetrominoes, or squares of equal size. In order to reduce latency and raise threshold, the decomposed picture is then compressed using a Modified Capsule SPIHT (MCSPIHT) encoder. The resulting coefficients are encoded using the low complexity MCSPIHT encoder. Our proposed method results in an average compression ratio of 90.447.

MLFE‐UNet: Multi‐Level Feature Extraction Transformer‐Based UNet for Gastrointestinal Disease Segmentation

ABSTRACTAccurately segmenting gastrointestinal (GI) disease regions from Wireless Capsule Endoscopy images is essential for clinical diagnosis and survival prediction. However, challenges arise due to similar intensity distributions, variable lesion shapes, and fuzzy boundaries. In this paper, we propose MLFE‐UNet, an advanced fusion of CNN‐based transformers with UNet. Both the encoder and decoder utilize a multi‐level feature extraction (MLFA) CNN‐Transformer‐based module. This module extracts features from the input data, considering both global dependencies and local information. Furthermore, we introduce a multi‐level spatial attention (MLSA) block that functions as the bottleneck. It enhances the network's ability to handle complex structures and overlapping regions in feature maps. The MLSA block captures multiscale dependencies of tokens from the channel perspective and transmits them to the decoding path. A contextual feature stabilization block follows each transition to emulate lesion zones and facilitate segmentation guidelines at each phase. To address high‐level semantic information, we incorporate a computationally efficient spatial channel attention block. This is followed by a stabilization block in the skip connections, ensuring global interaction and highlighting important semantic features from the encoder to the decoder. To evaluate the performance of our proposed MLFE‐UNet, we selected common GI diseases, specifically bleeding and polyps. The dice coefficient scores obtained by MLFE‐UNet on the MICCAI 2017 (Red lesion) and CVC‐ClinicalDB data sets are 92.34% and 88.37%, respectively.

Image detection method for multi-category lesions in wireless capsule endoscopy based on deep learning models.

Wireless capsule endoscopy (WCE) has become an important noninvasive and portable tool for diagnosing digestive tract diseases and has been propelled by advancements in medical imaging technology. However, the complexity of the digestive tract structure, and the diversity of lesion types, results in different sites and types of lesions distinctly appearing in the images, posing a challenge for the accurate identification of digestive tract diseases. To propose a deep learning-based lesion detection model to automatically identify and accurately label digestive tract lesions, thereby improving the diagnostic efficiency of doctors, and creating significant clinical application value. In this paper, we propose a neural network model, WCE_Detection, for the accurate detection and classification of 23 classes of digestive tract lesion images. First, since multicategory lesion images exhibit various shapes and scales, a multidetection head strategy is adopted in the object detection network to increase the model's robustness for multiscale lesion detection. Moreover, a bidirectional feature pyramid network (BiFPN) is introduced, which effectively fuses shallow semantic features by adding skip connections, significantly reducing the detection error rate. On the basis of the above, we utilize the Swin Transformer with its unique self-attention mechanism and hierarchical structure in conjunction with the BiFPN feature fusion technique to enhance the feature representation of multicategory lesion images. The model constructed in this study achieved an mAP50 of 91.5% for detecting 23 lesions. More than eleven single-category lesions achieved an mAP50 of over 99.4%, and more than twenty lesions had an mAP50 value of over 80%. These results indicate that the model outperforms other state-of-the-art models in the end-to-end integrated detection of human digestive tract lesion images. The deep learning-based object detection network detects multiple digestive tract lesions in WCE images with high accuracy, improving the diagnostic efficiency of doctors, and demonstrating significant clinical application value.

Automatic Detection of Gastrointestinal Diseases Using Wireless Capsule Endoscopy Images

Gastrointestinal (GI) diseases are various disorders related to the digestive system. This system includes the esophagus, stomach, small and large intestines, liver, gallbladder and pancreas, starting from the mouth. Early diagnosis is very important in the treatment of the disease. The earlier the disease is diagnosed, the higher the chance of the patient being treated. In recent years, it is known that artificial intelligence techniques have been widely used in disease diagnosis and classification. Among the artificial intelligence techniques, deep learning methods that produce very successful results in image classification are frequently used. This success of deep learning methods has been tried to be used in the classification of GI diseases. Within the scope of this study, it was tried to detect bleeding GI or lesions from publicly available wireless capsule endoscopy (WCE) images. As a result of the experiments, 5 different deep learning architectures were used. Features were extracted from the two architectures that showed the highest accuracy and were combined. Neighborhood Component Analysis (NCA) dimension reduction method was applied to the obtained feature map and a hybrid model was obtained. It was seen that the proposed hybrid model achieved an accuracy value of 86.3%.

Gastrointestinal tract disease detection via deep learning based structural and statistical features optimized hexa-classification model.

Gastrointestinal tract (GIT) diseases impact the entire digestive system, spanning from the mouth to the anus. Wireless Capsule Endoscopy (WCE) stands out as an effective analytic instrument for Gastrointestinal tract diseases. Nevertheless, accurately identifying various lesion features, such as irregular sizes, shapes, colors, and textures, remains challenging in this field. Several computer vision algorithms have been introduced to tackle these challenges, but many relied on handcrafted features, resulting in inaccuracies in various instances. In this work, a novel Deep SS-Hexa model is proposed which is a combination two different deep learning structures for extracting two different features from the WCE images to detect various GIT ailment. The gathered images are denoised by weighted median filter to remove the noisy distortions and augment the images for enhancing the training data. The structural and statistical (SS) feature extraction process is sectioned into two phases for the analysis of distinct regions of gastrointestinal. In the first stage, statistical features of the image are retrieved using MobileNet with the support of SiLU activation function to retrieve the relevant features. In the second phase, the segmented intestine images are transformed into structural features to learn the local information. These SS features are parallelly fused for selecting the best relevant features with walrus optimization algorithm. Finally, Deep belief network (DBN) is used classified the GIT diseases into hexa classes namely normal, ulcer, pylorus, cecum, esophagitis and polyps on the basis of the selected features. The proposed Deep SS-Hexa model attains an overall average accuracy of 99.16% in GIT disease detection based on KVASIR and KID datasets. The proposed Deep SS-Hexa model achieves high level of accuracy with minimal computational cost in the recognition of GIT illness. The proposed Deep SS-Hexa Model progresses the overall accuracy range of 0.04%, 0.80% better than GastroVision, Genetic algorithm based on KVASIR dataset and 0.60%, 1.21% better than Modified U-Net, WCENet based on KID dataset respectively.

MLFA-UNet: A multi-level feature assembly UNet for medical image segmentation

Medical image segmentation is crucial for accurate diagnosis and treatment in medical image analysis. Among the various methods employed, fully convolutional networks (FCNs) have emerged as a prominent approach for segmenting medical images. Notably, the U-Net architecture and its variants have gained widespread adoption in this domain. This paper introduces MLFA-UNet, an innovative architectural framework aimed at advancing medical image segmentation. MLFA-UNet adopts a U-shaped architecture and integrates two pivotal modules: multi-level feature assembly (MLFA) and multi-scale information attention (MSIA), complemented by a pixel-vanishing (PV) attention mechanism. These modules synergistically contribute to the segmentation process enhancement, fostering both robustness and segmentation precision. MLFA operates within both the network encoder and decoder, facilitating the extraction of local information crucial for accurately segmenting lesions. Furthermore, the bottleneck MSIA module serves to replace stacking modules, thereby expanding the receptive field and augmenting feature diversity, fortified by the PV attention mechanism. These integrated mechanisms work together to boost segmentation performance by effectively capturing both detailed local features and a broader range of contextual information, enhancing both accuracy and resilience in identifying lesions. To assess the versatility of the network, we conducted evaluations of MFLA-UNet across a range of medical image segmentation datasets, encompassing diverse imaging modalities such as wireless capsule endoscopy (WCE), colonoscopy, and dermoscopic images. Our results consistently demonstrate that MFLA-UNet outperforms state-of-the-art algorithms, achieving dice coefficients of 91.42%, 82.43%, 90.8%, and 88.68% for the MICCAI 2017 (Red Lesion), ISIC 2017, PH2, and CVC-ClinicalDB datasets, respectively.

Capsule Endoscopy Image Enhancement for Small Intestinal Villi Clarity

Wireless capsule endoscopy (WCE) has become an important tool for gastrointestinal examination due to its non-invasive nature and minimal patient discomfort. However, the quality of WCE images is often limited by built-in lighting and the complex gastrointestinal environment, particularly in the region filled with small intestinal villi. Additionally, the morphology of these villi usually serves as a crucial indicator for related diseases. To address this, we propose a novel method to enhance the clarity of small intestinal villi in WCE images. Our method uses a guided filter to separate the low- and high-frequency components of WCE images. Illumination gain factors are calculated from the low-frequency components, while gradient gain factors are derived from Laplacian convolutions on different regions. These factors enhance the high-frequency components, combined with the original image. This approach improves edge detail while suppressing noise and avoiding edge overshoot, providing clearer images for diagnosis. Experimental results show that our proposed method achieved a 45.47% increase in PSNR compared to classical enhancement algorithms, a 12.63% improvement in IRMLE relative to the original images, and a 31.84% reduction in NIQE with respect to the original images.

Feature Pyramid Network Based Spatial Attention and Cross‐Level Semantic Similarity for Diseases Segmentation From Capsule Endoscopy Images

ABSTRACTAs an emerging technology that uses a pill‐sized camera to visualize images of the digestive tract. Wireless capsule endoscopy (WCE) presents several advantages, since it is far less invasive, does not need sedation and has less possible complications compared to standard endoscopy. Hence, it might be exploited as alternative to the standard procedure. WCE is used to diagnosis a variety of gastro‐intestinal diseases such as polyps, ulcers, crohns disease, and hemorrhages. Nevertheless, WCE videos produced after a test may consist of thousands of frames per patient that must be viewed by medical specialists, besides, the capsule free mobility and technological limits cause production of a low quality images. Hence, development of an automatic tool based on artificial intelligence might be very helpful. Moreover, most state‐of‐the‐art works aim at images classification (normal/abnormal) while ignoring diseases segmentation. Therefore, in this work a novel method based on Feature Pyramid Network model is presented. This approach aims at diseases segmentation from WCE images. In this model, modules to optimize and combine features were employed. Specifically, semantic and spatial features were mutually compensated by spatial attention and cross‐level global feature fusion modules. The proposed method testing F1‐score and mean intersection over union are 94.149% and 89.414%, respectively, in the MICCAI 2017 dataset. In the KID Atlas dataset, the method achieved a testing F1‐score and mean intersection over union of 94.557% and 90.416%, respectively. Through the performance analysis, the mean intersection over union in the MICCAI 2017 dataset is 20.414%, 18.484%, 11.444%, 8.794% more than existing approaches. Moreover, the proposed scheme surpassed the methods used for comparison by 29.986% and 9.416% in terms of mean intersection over union in KID Atlas dataset. These results indicate that the proposed approach is promising in diseases segmentation from WCE images.

Review of Deep Learning Performance in Wireless Capsule Endoscopy Images for GI Disease Classification

Wireless capsule endoscopy is a non-invasive medical imaging modality used for diagnosing and monitoring digestive tract diseases. However, the analysis of images obtained from wireless capsule endoscopy is a challenging task, as the images are of low resolution and often contain a large number of artifacts. In recent years, deep learning has shown great promise in the analysis of medical images, including wireless capsule endoscopy images. This paper provides a review of the current trends and future directions in deep learning for wireless capsule endoscopy. We focus on the recent advances in transfer learning, attention mechanisms, multi-modal learning, automated lesion detection, interpretability and explainability, data augmentation, and edge computing. We also highlight the challenges and limitations of current deep learning methods and discuss the potential future directions for the field. Our review provides insights into the ongoing research and development efforts in the field of deep learning for wireless capsule endoscopy, and can serve as a reference for researchers, clinicians, and engineers working in this area inspection process.

GastroNet: A CNN based system for detection of abnormalities in gastrointestinal tract from wireless capsule endoscopy images

Gastrointestinal disorders are a class of prevalent disorders in the world. Capsule endoscopy is considered an effective diagnostic modality for diagnosing such gastrointestinal disorders, especially in small intestinal regions. The aim of this work is to leverage the potential of deep convolutional neural networks for automated classification of gastrointestinal abnormalities from capsule endoscopy images. This method developed a deep learning architecture, GastroNetV1, an automated classifier, to detect abnormalities in capsule endoscopy images. The gastrointestinal abnormalities considered are ulcerative colitis, polyps, and esophagitis. The curated dataset consists of 6000 images with “ground truth” labeling. The input image is automatically classified as ulcerative colitis, a polyp, esophagitis, or a normal condition by a web-based application designed with the trained algorithm. The classifier produced 99.2% validation accuracy, 99.3% specificity, 99.3% sensitivity, and 0.991 AUC. These results exceed that of the state-of-the-art systems. Hence, the GastroNetV1 could be used to identify the different gastrointestinal abnormalities in the capsule endoscopy images, which will, in turn, improve healthcare quality.

Outlier detection in temporal and spatial sequences via correlation analysis based on graph neural networks

Outlier detection in temporal and spatial sequences via correlation analysis based on graph neural networks

A Robust Approach for Ulcer Classification/Detection in WCE Images

Wireless Capsule Endoscopy (WCE) is a medical diagnostic technique recognized for its minimally invasive and painless nature for the patients. It uses remote imaging techniques to explore various segments of the gastrointestinal (GI) tract, particularly the hard-to-reach small intestine, making it an effective alternative to traditional endoscopic techniques. However, physicians face a significant challenge when it comes to analyzing a large number of endoscopic images due to the effort and time required. It is therefore imperative to implement aided-diagnostic systems capable of automatically detecting suspicious areas for subsequent medical assessment. In this paper, we present a novel approach to identify gastrointestinal tract abnormalities from WCE images, with a particular focus on ulcerated areas. Our approach involves the use of the Median Robust Extended Local Binary Pattern (MRELBP) descriptor, which effectively overcomes the challenges faced when WCE image acquisition, such as variations in illumination and contrast, rotation, and noise. Using machine learning algorithms, we conducted experiments on the extensive Kvasir-Capsule dataset, and subsequently compared our results with recent relevant studies. Noteworthy is the fact that our approach achieved an accuracy of 97.04% with the SVM (RBF) classifier and 96.77% with the RF classifier.

Review of Deep Learning Performance in Wireless Capsule Endoscopy Images for GI Disease Classification.

Wireless capsule endoscopy is a non-invasive medical imaging modality used for diagnosing and monitoring digestive tract diseases. However, the analysis of images obtained from wireless capsule endoscopy is a challenging task, as the images are of low resolution and often contain a large number of artifacts. In recent years, deep learning has shown great promise in the analysis of medical images, including wireless capsule endoscopy images. This paper provides a review of the current trends and future directions in deep learning for wireless capsule endoscopy. We focus on the recent advances in transfer learning, attention mechanisms, multi-modal learning, automated lesion detection, interpretability and explainability, data augmentation, and edge computing. We also highlight the challenges and limitations of current deep learning methods and discuss the potential future directions for the field. Our review provides insights into the ongoing research and development efforts in the field of deep learning for wireless capsule endoscopy, and can serve as a reference for researchers, clinicians, and engineers working in this area inspection process.

Efficient-gastro: optimized EfficientNet model for the detection of gastrointestinal disorders using transfer learning and wireless capsule endoscopy images.

Gastrointestinal diseases cause around two million deaths globally. Wireless capsule endoscopy is a recent advancement in medical imaging, but manual diagnosis is challenging due to the large number of images generated. This has led to research into computer-assisted methodologies for diagnosing these images. Endoscopy produces thousands of frames for each patient, making manual examination difficult, laborious, and error-prone. An automated approach is essential to speed up the diagnosis process, reduce costs, and potentially save lives. This study proposes transfer learning-based efficient deep learning methods for detecting gastrointestinal disorders from multiple modalities, aiming to detect gastrointestinal diseases with superior accuracy and reduce the efforts and costs of medical experts. The Kvasir eight-class dataset was used for the experiment, where endoscopic images were preprocessed and enriched with augmentation techniques. An EfficientNet model was optimized via transfer learning and fine tuning, and the model was compared to the most widely used pre-trained deep learning models. The model's efficacy was tested on another independent endoscopic dataset to prove its robustness and reliability.

Color-Transfer-Enhanced Data Construction and Validation for Deep Learning-Based Upper Gastrointestinal Landmark Classification in Wireless Capsule Endoscopy.

While the adoption of wireless capsule endoscopy (WCE) has been steadily increasing, its primary application remains limited to observing the small intestine, with relatively less application in the upper gastrointestinal tract. However, there is a growing anticipation that advancements in capsule endoscopy technology will lead to a significant increase in its application in upper gastrointestinal examinations. This study addresses the underexplored domain of landmark identification within the upper gastrointestinal tract using WCE, acknowledging the limited research and public datasets available in this emerging field. To contribute to the future development of WCE for gastroscopy, a novel approach is proposed. Utilizing color transfer techniques, a simulated WCE dataset tailored for the upper gastrointestinal tract is created. Using Euclidean distance measurements, the similarity between this color-transferred dataset and authentic WCE images is verified. Pioneering the exploration of anatomical landmark classification with WCE data, this study integrates similarity evaluation with image preprocessing and deep learning techniques, specifically employing the DenseNet169 model. As a result, utilizing the color-transferred dataset achieves an anatomical landmark classification accuracy exceeding 90% in the upper gastrointestinal tract. Furthermore, the application of sharpen and detail filters demonstrates an increase in classification accuracy from 91.32% to 94.06%.

Abnormalities detection from wireless capsule endoscopy images based on embedding learning with triplet loss

Abnormalities detection from wireless capsule endoscopy images based on embedding learning with triplet loss

Design and development of artificial intelligence‐based application programming interface for early detection and diagnosis of colorectal cancer from wireless capsule endoscopy images

AbstractThe colorectal cancer (CRC) is gaining attention in the context of gastrointestinal tract diseases as it ranks third among the most prevalent type of cancer. The early diagnosis of the CRC can be done by periodic examination of the colon and rectum for innocuous tissue abnormality called polyp as it has the potential to evolve as malignant in future. The CRC diagnosis using wireless capsule endoscopy requires the dedicated commitment of the medical expert demanding significant time, focus and effort. The accuracy of manual analysis in identifying polyps is extensively reliant on the cognitive condition of the physician, thus emphasizing the requirement for automatic polyp identification. The artificial intelligence integrated computer‐aided diagnosis system could assist the clinician in better diagnosis, thereby reducing the miss‐rates of polyps. In our proposed study, we developed an application program interface to aid the clinician in automatic segmentation of the polyp and evaluation of its dimension by manual placement of four landmarks on the predicted polyp. The segmentation is performed by the proposed light weight Padded U‐Net for the effective polyp segmentation in the colorectal images. We trained and validated the Padded U‐Net with augmented images of Kvasir dataset and calculated the performance parameters. In order to facilitate image augmentation, a graphical user interface called Augment Tree was developed, which incorporates 92 augmentation techniques. The accuracy, recall, precision, IoU, F1‐score, loss achieved during validation of Padded U‐Net were 95.6%, 0.946%, 0.985%, 0.933%, 0.965% and 0.080% respectively. We demonstrated that accuracy was improved and loss was reduced when the model was trained with augmented images rather than only the limited original dataset images. On comparison of our Padded U‐net architecture with recently developed architectures, our model attained optimal performance in all the metrics except accuracy in which it attained marginal performance to the highest value.

Multi-classification deep learning models for detection of ulcerative colitis, polyps, and dyed-lifted polyps using wireless capsule endoscopy images

Wireless capsule endoscopy (WCE) enables imaging and diagnostics of the gastrointestinal (GI) tract to be performed without any discomfort. Despite this, several characteristics, including efficacy, tolerance, safety, and performance, make it difficult to apply and modify widely. The use of automated WCE to collect data and perform the analysis is essential for finding anomalies. Medical specialists need a significant amount of time and expertise to examine the data generated by WCE imaging of the patient’s digestive tract. To address these challenges, several computer vision-based solutions have been designed; nevertheless, they do not achieve an acceptable level of accuracy, and more advancements are required. Thus, in this study, we proposed four multi-classification deep learning (DL) models i.e., Vgg-19 + CNN, ResNet152V2, Gated Recurrent Unit (GRU) + ResNet152V2, and ResNet152V2 + Bidirectional GRU (Bi-GRU) and applied it on different publicly available databases for diagnosing ulcerative colitis, polyps, and dyed-lifted polyps using WCE images. To our knowledge, this is the only study that uses a single DL model for the classification of three different GI diseases. We compared the classification performance of the proposed DL classifiers in terms of many parameters such as accuracy, loss, Matthew's correlation coefficient (MCC), recall, precision, negative predictive value (NPV), positive predictive value (PPV), and F1-score. The results revealed that the Vgg-19 + CNN outperforms the three other proposed DL models in classifying GI diseases using WCE images. The Vgg-19 + CNN model achieved an accuracy of 99.45%. The results of four proposed DL classifiers are also compared with recent state-of-the-art classifiers and the proposed Vgg-19 + CNN model has performed better in terms of improved accuracy.