Region Segmentation Research Articles

Preliminary study on the ability of the machine learning models based on 18F-FDG PET/CT to differentiate between mass-forming pancreatic lymphoma and pancreatic carcinoma

PurposeThe objective of this study was to preliminarily assess the ability of metabolic parameters and radiomics derived from 18F-fluorodeoxyglucose positron emission tomography/computed tomography (18F-FDG PET/CT) to distinguish mass-forming pancreatic lymphoma from pancreatic carcinoma using machine learning. MethodsA total of 88 lesions from 86 patients diagnosed as mass-forming pancreatic lymphoma or pancreatic carcinoma were included and randomly divided into a training set and a validation set at a 4-to-1 ratio. The segmentation of regions of interest was performed using ITK-SNAP software, PET metabolic parameters and radiomics features were extracted using 3Dslicer and PYTHON. Following the selection of optimal metabolic parameters and radiomics features, Logistic regression (LR), support vector machine (SVM), and random forest (RF) models were constructed for PET metabolic parameters, CT radiomics, PET radiomics, and PET/CT radiomics. Model performance was assessed in terms of area under the curve (AUC), accuracy, sensitivity, and specificity in both the training and validation sets. ResultsStrong discriminative ability observed in all models, with AUC values ranging from 0.727 to 0.978. The highest performance exhibited by the combined PET and CT radiomics features. AUC values for PET/CT radiomics models in the training set were LR 0.994, SVM 0.994, RF 0.989. In the validation set, AUC values were LR 0.909, SVM 0.883, RF 0.844. ConclusionMachine learning models utilizing the metabolic parameters and radiomics of 18F-FDG PET/CT show promise in distinguishing between pancreatic carcinoma and mass-forming pancreatic lymphoma. Further validation on a larger cohort is necessary before practical implementation in clinical settings.

High-resolution hybrid micro-CT imaging pipeline for mouse brain region segmentation and volumetric morphometry.

Brain region segmentation and morphometry in humanized apolipoprotein E (APOE) mouse models with a human NOS2 background (HN) contribute to Alzheimer's disease (AD) research by demonstrating how various risk factors affect the brain. Photon-counting detector (PCD) micro-CT provides faster scan times than MRI, with superior contrast and spatial resolution to energy-integrating detector (EID) micro-CT. This paper presents a pipeline for mouse brain imaging, segmentation, and morphometry from PCD micro-CT. We used brains of 26 mice from 3 genotypes (APOE22HN, APOE33HN, APOE44HN). The pipeline included PCD and EID micro-CT scanning, hybrid (PCD and EID) iterative reconstruction, and brain region segmentation using the Small Animal Multivariate Brain Analysis (SAMBA) tool. We applied SAMBA to transfer brain region labels from our new PCD CT atlas to individual PCD brains via diffeomorphic registration. Region-based and voxel-based analyses were used for comparisons by genotype and sex. Together, PCD and EID scanning take ~5 hours to produce images with a voxel size of 22 μm, which is faster than MRI protocols for mouse brain morphometry with voxel size above 40 μm. Hybrid iterative reconstruction generates PCD images with minimal artifacts and higher spatial resolution and contrast than EID images. Our PCD atlas is qualitatively and quantitatively similar to the prior MRI atlas and successfully transfers labels to PCD brains in SAMBA. Male and female mice had significant volume differences in 26 regions, including parts of the entorhinal cortex and cingulate cortex. APOE22HN brains were larger than APOE44HN brains in clusters from the hippocampus, a region where atrophy is associated with AD. This work establishes a pipeline for mouse brain analysis using PCD CT, from staining to imaging and labeling brain images. Our results validate the effectiveness of the approach, setting a foundation for research on AD mouse models while reducing scanning durations.

The influence of tax incentives on market segmentation in the context of a unified national market

The new development pattern prioritises the construction of a unified national market, eliminating market segmentation and promoting resource flows. This paper investigates the impact of tax incentives on market segmentation using China's provincial panel data from 2003 to 2019 through a two-way fixed effects model. The results indicate that tax incentives reduce market segmentation. The analysis of heterogeneity reveals a non-linear relationship between the effects of tax incentives on market segmentation. Tax incentives reduce market segmentation in regions with low tax incentives, but have a limited effect or even exacerbate segmentation in regions with high incentives.

ISLS: An Illumination-Aware Sauce-Packet Leakage Segmentation Method.

The segmentation of abnormal regions is vital in smart manufacturing. The blurring sauce-packet leakage segmentation task (BSLST) is designed to distinguish the sauce packet and the leakage's foreground and background at the pixel level. However, the existing segmentation system for detecting sauce-packet leakage on intelligent sensors encounters an issue of imaging blurring caused by uneven illumination. This issue adversely affects segmentation performance, thereby hindering the measurements of leakage area and impeding the automated sauce-packet production. To alleviate this issue, we propose the two-stage illumination-aware sauce-packet leakage segmentation (ISLS) method for intelligent sensors. The ISLS comprises two main stages: illumination-aware region enhancement and leakage region segmentation. In the first stage, YOLO-Fastestv2 is employed to capture the Region of Interest (ROI), which reduces redundancy computations. Additionally, we propose image enhancement to relieve the impact of uneven illumination, enhancing the texture details of the ROI. In the second stage, we propose a novel feature extraction network. Specifically, we propose the multi-scale feature fusion module (MFFM) and the Sequential Self-Attention Mechanism (SSAM) to capture discriminative representations of leakage. The multi-level features are fused by the MFFM with a small number of parameters, which capture leakage semantics at different scales. The SSAM realizes the enhancement of valid features and the suppression of invalid features by the adaptive weighting of spatial and channel dimensions. Furthermore, we generate a self-built dataset of sauce packets, including 606 images with various leakage areas. Comprehensive experiments demonstrate that our ISLS method shows better results than several state-of-the-art methods, with additional performance analyses deployed on intelligent sensors to affirm the effectiveness of our proposed method.

Computer-aided colorectal cancer diagnosis: AI-driven image segmentation and classification

Colorectal cancer is an enormous health concern since it is among the most lethal types of malignancy. The manual examination has its limitations, including subjectivity and data overload. To overcome these challenges, computer-aided diagnostic systems focusing on image segmentation and abnormality classification have been developed. This study presents a two-stage approach for the automatic detection of five types of colorectal abnormalities in addition to a control group: polyp, low-grade intraepithelial neoplasia, high-grade intraepithelial neoplasia, serrated adenoma, adenocarcinoma. In the first stage, UNet3+ was used for image segmentation to locate the anomalies, while in the second stage, the Cross-Attention Multi-Scale Vision Transformer deep learning model was used to predict the type of anomaly after highlighting the anomaly on the raw images. In anomaly segmentation, UNet3+ achieved values of 0.9872, 0.9422, 0.9832, and 0.9560 for Dice Coefficient, Jaccard Index, Sensitivity, Specificity respectively. In anomaly detection, the Cross-Attention Multi-Scale Vision Transformer model attained a classification performance of 0.9340, 0.9037, 0.9446, 0.8723, 0.9102, 0.9849 for accuracy, F1 score, precision, recall, Matthews correlation coefficient, and specificity, respectively. The proposed approach proves its capacity to alleviate the overwhelm of pathologists and enhance the accuracy of colorectal cancer diagnosis by achieving high performance in both the identification of anomalies and the segmentation of regions.

ABANet: Attention boundary‐aware network for image segmentation

AbstractDeep learning techniques have attained substantial progress in various face‐related tasks, such as face recognition, face inpainting, and facial expression recognition. To prevent infection or the spread of the virus, wearing of masks in public places has been mandated following the COVID‐19 epidemic, which has led to face occlusion and posed significant challenges for face recognition systems. Most prominent masked face recognition solutions rely on mask segmentation tasks. Therefore, segmentation can be used to mitigate the negative impacts of wearing a mask and improve recognition accuracy. Mask region segmentation suffers from two main problems: there is no standard type of masks that people wear, they come in different colours and designs, and there is no publicly available masked face dataset with appropriate ground truth for the mask region. In order to address these issues, we propose an encoder–decoder framework that utilizes a boundary‐aware attention network combined with a new hybrid loss to provide a map, patch, and pixel‐level supervision. We also introduce a dataset called MFSD, with 11,601 images and 12,758 masked faces for masked face segmentation. Furthermore, we compare the performance of different cutting‐edge deep learning semantic segmentation models on the presented dataset. Experimental results on the MSFD dataset reveal that the suggested approach outperforms state‐of‐the‐art, algorithms with 97.623% accuracy, 93.814% IoU, and 96.817% F1‐score rate. Our dataset of masked faces with mask region labels and source code will be available online.

Classification of Benign-Malignant Thyroid Nodules Based on Hyperspectral Technology.

In recent years, the incidence of thyroid cancer has rapidly increased. To address the issue of the inefficient diagnosis of thyroid cancer during surgery, we propose a rapid method for the diagnosis of benign and malignant thyroid nodules based on hyperspectral technology. Firstly, using our self-developed thyroid nodule hyperspectral acquisition system, data for a large number of diverse thyroid nodule samples were obtained, providing a foundation for subsequent diagnosis. Secondly, to better meet clinical practical needs, we address the current situation of medical hyperspectral image classification research being mainly focused on pixel-based region segmentation, by proposing a method for nodule classification as benign or malignant based on thyroid nodule hyperspectral data blocks. Using 3D CNN and VGG16 networks as a basis, we designed a neural network algorithm (V3Dnet) for classification based on three-dimensional hyperspectral data blocks. In the case of a dataset with a block size of 50 × 50 × 196, the classification accuracy for benign and malignant samples reaches 84.63%. We also investigated the impact of data block size on the classification performance and constructed a classification model that includes thyroid nodule sample acquisition, hyperspectral data preprocessing, and an algorithm for thyroid nodule classification as benign and malignant based on hyperspectral data blocks. The proposed model for thyroid nodule classification is expected to be applied in thyroid surgery, thereby improving surgical accuracy and providing strong support for scientific research in related fields.

Algal Bed Region Segmentation Based on a ViT Adapter Using Aerial Images for Estimating CO2 Absorption Capacity

In this study, we propose a novel method for algal bed region segmentation using aerial images. Accurately determining the carbon dioxide absorption capacity of coastal algae requires measurements of algal bed regions. However, conventional manual measurement methods are resource-intensive and time-consuming, which hinders the advancement of the field. To solve these problems, we propose a novel method for automatic algal bed region segmentation using aerial images. In our method, we use an advanced semantic segmentation model, a ViT adapter, and adapt it to aerial images for algal bed region segmentation. Our method demonstrates high accuracy in identifying algal bed regions in an aerial image dataset collected from Hokkaido, Japan. The experimental results for five different ecological regions show that the mean intersection over union (mIoU) and mean F-score of our method in the validation set reach 0.787 and 0.870, the IoU and F-score for the background region are 0.957 and 0.978, and the IoU and F-score for the algal bed region are 0.616 and 0.762, respectively. In particular, the mean recognition area compared with the ground truth area annotated manually is 0.861. Our study contributes to the advancement of blue carbon assessment by introducing a novel semantic segmentation-based method for identifying algal bed regions using aerial images.

SAROS: A dataset for whole-body region and organ segmentation in CT imaging

The Sparsely Annotated Region and Organ Segmentation (SAROS) dataset was created using data from The Cancer Imaging Archive (TCIA) to provide a large open-access CT dataset with high-quality annotations of body landmarks. In-house segmentation models were employed to generate annotation proposals on randomly selected cases from TCIA. The dataset includes 13 semantic body region labels (abdominal/thoracic cavity, bones, brain, breast implant, mediastinum, muscle, parotid/submandibular/thyroid glands, pericardium, spinal cord, subcutaneous tissue) and six body part labels (left/right arm/leg, head, torso). Case selection was based on the DICOM series description, gender, and imaging protocol, resulting in 882 patients (438 female) for a total of 900 CTs. Manual review and correction of proposals were conducted in a continuous quality control cycle. Only every fifth axial slice was annotated, yielding 20150 annotated slices from 28 data collections. For the reproducibility on downstream tasks, five cross-validation folds and a test set were pre-defined. The SAROS dataset serves as an open-access resource for training and evaluating novel segmentation models, covering various scanner vendors and diseases.

The effect of the re-segmentation method on improving the performance of rectal cancer image segmentation models.

Rapid and accurate segmentation of tumor regions from rectal cancer images can better understand the patientâs lesions and surrounding tissues, providing more effective auxiliary diagnostic information. However, cutting rectal tumors with deep learning still cannot be compared with manual segmentation, and a major obstacle to cutting rectal tumors with deep learning is the lack of high-quality data sets. We propose to use our Re-segmentation Method to manually correct the model segmentation area and put it into training and training ideas. The data set has been made publicly available. Methods: A total of 354 rectal cancer CT images and 308 rectal region images labeled by experts from Jiangxi Cancer Hospital were included in the data set. Six network architectures are used to train the data set, and the region predicted by the model is manually revised and then put into training to improve the ability of model segmentation and then perform performance measurement. In this study, we use the Resegmentation Method for various popular network architectures. By comparing the evaluation indicators before and after using the Re-segmentation Method, we prove that our proposed Re-segmentation Method can further improve the performance of the rectal cancer image segmentation model.

Remote sensing image semantic segmentation via class-guided structural interaction and boundary perception

Existing remote sensing semantic segmentation methods generally ignore the structural information of objects that is vital in the human visual recognition system. The absence of overall structural information often results in weak perceptions of subtle textures and fragmented predictions, especially for complex and variable ground object scenarios. Besides, they still suffer from the semantic ambiguity caused by the unclear object boundary features in remote sensing images. In this paper, we propose a novel remote sensing semantic segmentation framework, called CSBNet, which aims to enhance the capacity of class-guided structural interaction and boundary perception simultaneously. It consists of a class-guided structure interaction module (CSIM), a Transformer-based context aggregation module (TCAM) and a class-guided boundary supervision module (CBSM). The CSIM has the ability to progressively extract the class-specific structural features, i.e., refining the structural information of each class by iteratively exchanging information between initial coarse class tokens and contexts. Meanwhile, the TCAM is constructed to provide CSIM with more discriminative multi-scale contexts without losing spatial features. In particular, the CBSM plays an auxiliary role, which applies the boundary information obtained from the class tokens to supervise the segmentation of boundary regions. When tested on the ISPRS dataset, LoveDA dataset, UAVid dataset, our method significantly outperforms the state-of-the-art remote sensing semantic segmentation approaches.

Deep learning-based semantic segmentation for morphological fractography

Fractographic analysis poses a significant challenge for field researchers without specialized training in fractography. To address this issue, this study introduces a comprehensive integrated workflow that encapsulates the entire process from dataset preparation and data enhancement to leveraging the SegFormer model for deep learning-driven semantic segmentation. An extensive collection of fractography images is formulated and augmented to train the SegFormer model, enabling precise semantic segmentation of morphological fracture regions including cleavage, ductile, dimple, fatigue striations, and others. To accommodate the demanding SEM imaging conditions which frequently include distortions, noise, and aberrations, we developed a two-stage method with diverse data augmentation strategies. This method resulted in a robust model demonstrating exceptional performance, as evidenced by a high mean Intersection over Union (mIOU) score of 59.7 and other metrics. The findings validate the potential of deep learning techniques, particularly the SegFormer model's efficacy in morphological fractography image segmentation for the first time. Our work offers a cost-effective, and efficient alternative deep learning approach to traditional experimental fracture analysis, thereby expanding opportunities for a broader range of professionals in the engineering domain.

SRMA: a dual-branch parallel multi-scale attention network for remote sensing images sea-land segmentation

ABSTRACT The use of deep learning-based high resolution remote sensing image sea and land segmentation method has become prevalent in various fields such as environmental monitoring, resource assessment, and urban planning. However, the segmentation process faces challenges due to the complex coastline and the similarity in spectral colour difference between the sea and land in certain areas. The remote sensing images obtained from satellites often exhibit unclear boundaries between the sea and land, as well as intricate coastlines. Consequently, the segmentation of sea and land becomes a difficult task. The existing sea-land segmentation methods have limitations in accurately segmenting long and narrow waters, as well as areas with low differentiation between sea and land. In this paper, we propose a new sea-land segmentation method called SRMA (Swin-Res-Multi-Attention). SRMA performs parallel feature extraction using a dual-branch parallel: Swin-Transformer branch and ResNet branch. The combination of Swin-Transformer’s self-attention and ResNet’s residual design helps reduce the loss of feature information, thereby avoiding incorrect segmentation in regions with low distinctness. To improve overall stability, we introduce the MCA (Multiscale channel attention module) module, which combines feature information from different scales. The multi-scale pyramid design of MCA module ensures stability and improves segmentation accuracy in narrow waters. Experimental results on a public dataset demonstrate that our model outperforms existing methods. Additionally, we evaluate the model’s performance in complex scenarios by creating a new dataset that includes a complex urban water body and cloud interference. The results showcase the robustness and superiority of our model.

Automated Segmentation of Brain Tumors in MRI: A Comprehensive Review of Deep Learning Approaches

The segmentation of tumor region from brain MRI images is challenging task. Automated approaches are necessary because manual segmentation takes a lot of effort and susceptible to inter-observer variability. This research provides an extensive analysis of deep learning methods for brain tumor segmentation from MRI data. The study begins with a summary of brain tumors and conventional segmentation techniques before doing a thorough evaluation of current developments in automated segmentation methods. We cover many deep learning architectures and their derivatives, specifically designed for brain tumor segmentation. The review also includes methods for differentiating between healthy brain tissue and aberrant tumor tissue. This paper critically examines the benefits, drawbacks, and potential applications of deep learning-based algorithms. It offers insights into current techniques and suggests future prospects for this important field of study.

Automated pneumothorax segmentation and quantification algorithm based on deep learning

A collapsed lung, also known as a pneumothorax, is a medical condition characterized by the presence of air in the chest cavity between the lung and chest wall. A chest radiograph is commonly used to diagnose pneumothorax; however, manual segmentation of the pneumothorax region can be difficult to achieve due to its complicated appearance and the variable quality of the image. To address this, we introduce a two-phase deep learning framework designed to enhance the accuracy of lung and pneumothorax segmentation from chest radiographs. Initially, a U-Net model with a ResNet34 backbone, trained on the Shenzhen and Montgomery datasets, is utilized to achieve precise lung region segmentation. Subsequently, for pneumothorax segmentation, we propose the PTXSeg-Net—a convolutional neural network model trained on the SIIM-ACR pneumothorax dataset. The PTXSeg-Net is an enhancement of the U-Net architecture, modified to incorporate attention gates and residual blocks to refine learning capabilities, further strengthened by deep supervision, allowing for more nuanced gradient utilization across all network layers. We employ transfer learning by pre-training an autoencoder to extract robust chest X-ray representations. Data refinement techniques are applied to the SIIM-ACR dataset to further improve training outcomes. Our results indicate that PTXSeg-Net outperforms other models in pneumothorax segmentation, achieving the highest Dice score of 0.9124 and Jaccard index of 0.8894 on the refined dataset with autoencoder pre-training. Moreover, leveraging the predicted lung and pneumothorax segmentation masks from the two-phase framework, we propose a quantification algorithm for estimating the pneumothorax size ratio. Its validity has been confirmed through expert assessments by a radiologist and a surgeon on a test set comprising 495 images. The high acceptance rates, averaging 96.97 %, demonstrate substantial agreement between the proposed method and expert clinical assessments. The implications of these results are significant for clinical practice, offering a deep learning technology for more accurate and efficient pneumothorax identification and quantification. This improvement facilitates the timely determination of required management and treatment strategies, potentially leading to enhancements in patient outcomes.

Fabric pilling image segmentation by embedding dual-attention mechanism U-Net network

The initial step in fabric pilling rating is to segment and localize the pilling region, which is a crucial and challenging task. This paper presents a fabric puckering image segmentation method that is integrated into a U-Net network with a dual-attention mechanism. We have enhanced the fully convolutional neural network (U-Net) model by incorporating the dual-attention mechanism. This modification has resulted in a powerful feature extraction capability, enabling the objective and accurate segmentation of the fabric puckering region. We refer to this improved model as the dual-attention U-Net. The network model for fabric pilling feature extraction adopts the improved VGG16 model architecture as its encoding part. The model parameters are initialized with VGG16 pre-training weights to accelerate convergence speed. Second, the feature fusion between the corresponding layers of the encoding part and the decoding part was fed into the dual-attention mechanism module to strengthen the weight values of the fabric pilling region adaptively, which made the model more focused on the fabric pilling target region; Third, the dual-attention U-Net model was trained by data augmentation and migration learning strategies to prevent overfitting; Finally, the performance of the model was evaluated with the collected fabric pilling data set. The results of the experiments indicate that the claimed dual-attention U-Net model is superior to the typical U-Net model in terms of accuracy and precision. The dual-attention U-Net model achieved 99.03% accuracy for fabric pilling segmentation.

Abstract PO5-07-02: AI-assisted interpretation of PD-L1 CPS improves the precision medicine in Triple-negative breast cancer

Abstract Objective: The IMpassion 031 and KEYNOTE-355 clinical trial demonstrated the advantages of atezolizumab and pembrolizumab in the treatment of Triple-negative breast cancer (TNBC). However, the application of CPS in assessing PD-L1 expression is challenging. Pathologists have great variability in interpretation of PD-L1 CPS, the daily diagnostic workload is too heavy and their diagnostic efficiency is low, and they still have deficiencies in terms of accurate enumeration. It is of necessity to establish an objective and effective method which is highly repeatable. Methods: In this study, we established a deep learning-based artificial intelligence-assisted (AI-assisted) model which using cell detection and region segmentation algorithm. Three rounds of ring studies (RSs) were conducted. 12 pathologists of different level evaluate the CPS of PD-L1 (DAKO 22C3) in TNBC patients by visual assessment and AI-assisted model. Compare the difference, consistency and accuracy of the interpretation. Our research evaluated PD-L1 CPS expression with continuous score. Shapiro-Wilk (S-W) method performs normality test, difference analysis using Friedman M and Bonferroni calibration tests, consistency analysis is studied by intraclass correlation coefficient (ICC) and heat maps and box plots. Results: In the visual assessment, the interpretation results of PD-L1 (DAKO 22C3) CPS in different level pathologists have significant differences (P < 0.05), and the consistency of all the pathologists interpretation results was weak. Due to this strong inconsistency, it may result in a number of patients losing the opportunity to use ICIs for treatment. Moreover, the internal consistency of all pathologists in the visual assessment is moderate, in which the repeatability of junior pathologists is the worst, the ICC value is 0.664 (95%CI: 0.564-0.762). Through AI-assisted interpretation, there is no significant difference between all pathologists (P = 0.425), and the ICC value increased to 0.883 (95%CI:0.836-0.922) which improved the consistency of the interpretation results. In addition, through AI-assisted interpretation, the repeatability and accuracy of the interpretation results has been further upgraded. At the same time, the acceptance of AI results by junior pathologists are high, and 80% of the AI results are accepted. Conclusions: With the help of the AI-assisted diagnostic model, different levels of all the pathologists have achieved excellent consistency and repeatability in the interpretation of PD-L1 (DAKO 22C3) CPS. Moreover, the level of interpretation has been sought the rapid enhancement. It can be seen that AI-assisted diagnostic model provides a good approach to strengthen the consistency and repeatability in clinical practice. Our research also shows that PD-L1 CPS can receive precise interpretation from pathologists, so more patients have the opportunity to use ICIs. Therefore, these patients can benefit from treatment and achieve better survival. The interpretation results and system diagram of PD-L1 CPS by AI-assisted model. The consistency and repeatability of the interpretation results. (A)-(C) The consistency of the PD-L1 CPS interpretation among the different level of pathologists in three ring studies. (D)The repeatability of the interpretation results between 12 pathologists in RS1 and RS2. Accuracies and acceptance rates of different experienced pathologists. (A) Boxplots of scoring accuracies for pathologists in different levels. (B) Acceptance rates of all pathologists in total 50 slides. (C) Percent stacked column chart of different levels of pathologists with AI score acceptance. Citation Format: Jinze Li, Xinran Wang, Yueping Liu. AI-assisted interpretation of PD-L1 CPS improves the precision medicine in Triple-negative breast cancer [abstract]. In: Proceedings of the 2023 San Antonio Breast Cancer Symposium; 2023 Dec 5-9; San Antonio, TX. Philadelphia (PA): AACR; Cancer Res 2024;84(9 Suppl):Abstract nr PO5-07-02.

AGSAM: Agent-Guided Segment Anything Model for Automatic Segmentation in Few-Shot Scenarios.

Precise medical image segmentation of regions of interest (ROIs) is crucial for accurate disease diagnosis and progression assessment. However, acquiring high-quality annotated data at the pixel level poses a significant challenge due to the resource-intensive nature of this process. This scarcity of high-quality annotated data results in few-shot scenarios, which are highly prevalent in clinical applications. To address this obstacle, this paper introduces Agent-Guided SAM (AGSAM), an innovative approach that transforms the Segment Anything Model (SAM) into a fully automated segmentation method by automating prompt generation. Capitalizing on the pre-trained feature extraction and decoding capabilities of SAM-Med2D, AGSAM circumvents the need for manual prompt engineering, ensuring adaptability across diverse segmentation methods. Furthermore, the proposed feature augmentation convolution module (FACM) enhances model accuracy by promoting stable feature representations. Experimental evaluations demonstrate AGSAM's consistent superiority over other methods across various metrics. These findings highlight AGSAM's efficacy in tackling the challenges associated with limited annotated data while achieving high-quality medical image segmentation.

U-Net with Coordinate Attention and VGGNet: A Grape Image Segmentation Algorithm Based on Fusion Pyramid Pooling and the Dual-Attention Mechanism

Currently, the classification of grapevine black rot disease relies on assessing the percentage of affected spots in the total area, with a primary focus on accurately segmenting these spots in images. Particularly challenging are cases in which lesion areas are small and boundaries are ill-defined, hampering precise segmentation. In our study, we introduce an enhanced U-Net network tailored for segmenting black rot spots on grape leaves. Leveraging VGG as the U-Net’s backbone, we strategically position the atrous spatial pyramid pooling (ASPP) module at the base of the U-Net to serve as a link between the encoder and decoder. Additionally, channel and spatial dual-attention modules are integrated into the decoder, alongside a feature pyramid network aimed at fusing diverse levels of feature maps to enhance the segmentation of diseased regions. Our model outperforms traditional plant disease semantic segmentation approaches like DeeplabV3+, U-Net, and PSPNet, achieving impressive pixel accuracy (PA) and mean intersection over union (MIoU) scores of 94.33% and 91.09%, respectively. Demonstrating strong performance across various levels of spot segmentation, our method showcases its efficacy in enhancing the segmentation accuracy of black rot spots on grapevines.

A Pipeline for Evaluation of Machine Learning/Artificial Intelligence Models to Quantify Programmed Death Ligand 1 Immunohistochemistry

Immunohistochemistry (IHC) is used to guide treatment decisions in multiple cancer types. For treatment with checkpoint inhibitors, programmed death ligand 1 (PD-L1) IHC is used as a companion diagnostic. However, the scoring of PD-L1 is complicated by its expression in cancer and immune cells. Separation of cancer and noncancer regions is needed to calculate tumor proportion scores (TPS) of PD-L1, which is based on the percentage of PD-L1-positive cancer cells. Evaluation of PD-L1 expression requires highly experienced pathologists and is often challenging and time-consuming. Here, we used a multi-institutional cohort of 77 lung cancer cases stained centrally with the PD-L1 22C3 clone. We developed a 4-step pipeline for measuring TPS that includes the coregistration of hematoxylin and eosin, PD-L1, and negative control (NC) digital slides for exclusion of necrosis, segmentation of cancer regions, and quantification of PD-L1+ cells. As cancer segmentation is a challenging step for TPS generation, we trained DeepLab V3 in the Visiopharm software package to outline cancer regions in PD-L1 and NC images and evaluated the model performance by mean intersection over union (mIoU) against manual outlines. Only 14 cases were required to accomplish a mIoU of 0.82 for cancer segmentation in hematoxylin-stained NC cases. For PD-L1-stained slides, a model trained on PD-L1 tiles augmented by registered NC tiles achieved a mIoU of 0.79. In segmented cancer regions from whole slide images, the digital TPS achieved an accuracy of 75% against the manual TPS scores from the pathology report. Major reasons for algorithmic inaccuracies include the inclusion of immune cells in cancer outlines and poor nuclear segmentation of cancer cells. Our transparent and stepwise approach and performance metrics can be applied to any IHC assay to provide pathologists with important insights on when to apply and how to evaluate commercial automated IHC scoring systems.