Evaluate Interobserver Agreement Research Articles

Simple electrocardiography algorithm for localizing accessory pathway in patients with Wolff–Parkinson–White syndrome

Background Existing algorithms to predict the location of an accessory pathway (AP) in Wolff–Parkinson–White Syndrome (WPW) have good sensitivity and specificity but complex with various accuracy and inter-observer agreement rates. A simple algorithm with high accuracy and inter-observer agreement rates is needed. Methods This was a cross-sectional and retrospective diagnostic study. The data were collected by total population sampling from January 2015 to January 2017. Forty-seven patients were included in the study. Data collected were pre-ablation 12-lead ECGs and ablation reports. These ECGs were evaluated by two independent observers using the simplified algorithm and compared with ablation results. Results The algorithm had a sensitivity of 45% on the left free wall, 80% on septal, 92% on the right free wall, and the specificity of 96% on the left free wall, 69% on the septal, 85% on the right free wall for AP prediction. The positive predictive value was 90% on the left free wall, 55% on the septal, and 67% on the right free wall APs. The negative predictive value was 70% on the left free wall, 88% on the septal, and 97% on right free wall AP. The positive likelihood ratio was 11.23 on the left free wall, 2.23 on septal and 6.57 on right free wall APs, and the negative likelihood ratio was 0.57 on left free wall APs, 0.28 on septal, and 0.09 on the right free wall APs. Algorithm accuracy varied from 73–87%. Inter-observer agreement calculation was kappa 0.93 for left free wall AP, 0.78 for septal AP, and 0.74 for right free wall AP. Conclusion This simple algorithm has a remarkable accuracy and inter-observer agreement; therefore, it may prove to be helpful even to non-electrophysiologists and has the potential to be integrated into clinical practice

LI-RADS Version 2018 Targetoid Appearances on Gadoxetic Acid-Enhanced MRI: Interobserver Agreement and Diagnostic Performance for the Differentiation of HCC and Non-HCC Malignancy.

BACKGROUND. In LI-RADS version 2018, observations showing at least one of five targetoid appearances in different sequences or postcontrast phases are categorized LR-M, indicating likely non-hepatocellular carcinoma (HCC) malignancy. OBJECTIVE. The purpose of this study was to evaluate interobserver agreement for LI-RADS targetoid appearances among a large number of radiologists of varying experience and the diagnostic performance of targetoid appearances for differentiating HCC from non-HCC malignancy. METHODS. This retrospective study included 100 patients (76 men, 24 women; mean age, 58 ± 9 [SD] years) at high risk of HCC who underwent gadoxetic acid-enhanced MRI within 30 days before hepatic tumor resection (25 randomly included patients with non-HCC malignancy [13, intrahepatic cholangiocarcinoma; 12, combined HCC-cholangiocarcinoma]; 75 matched patients with HCC). Eight radiologists (four more experienced [8-15 years]; four less experienced [1-5 years]) from seven institutions independently assessed observations for the five targetoid appearances and LI-RADS categorization. Interobserver agreement and diagnostic performance for non-HCC malignancy were evaluated. RESULTS. Interobserver agreement was poor for peripheral washout (κ = 0.20); moderate for targetoid transitional phase or hepatobiliary phase appearance (κ = 0.33), delayed central enhancement (κ = 0.37), and targetoid restriction (κ = 0.43); and substantial for rim arterial phase hyperenhancement (κ = 0.61). Agreement was fair for at least one targetoid appearance (κ = 0.36) and moderate for at least two, three, or four targetoid appearances (κ = 0.43-0.51). Agreement for individual targetoid appearances was not significantly different between more experienced and less experienced readers other than for targetoid restriction (κ = 0.63 vs 0.43; p = .001). Agreement for at least one targetoid appearance was fair among more experienced (κ = 0.29) and less experienced (κ = 0.37) reviewers. Agreement for at least two, three, or four targetoid appearances was moderate to substantial among more experienced reviewers (κ = 0.45-0.63) and moderate among less experienced reviewers (κ = 0.42-0.56). Existing LR-M criteria of at least one targetoid appearance had median accuracy for non-HCC malignancy of 62%, sensitivity of 84%, and specificity of 54%. For all reviewers, accuracy was highest when at least three (median accuracy, 79%; sensitivity, 68%; specificity, 82%) or four (median accuracy, 80%; sensitivity, 54%; specificity, 88%) targetoid appearances were required. CONCLUSION. Targetoid appearances and LR-M categorization exhibited considerable interobserver variation among both more and less experienced reviewers. CLINICAL IMPACT. Requiring multiple targetoid appearances for LR-M categorization improved interobserver agreement and diagnostic accuracy for non-HCC malignancy.

Interobserver Reliability on Intravoxel Incoherent Motion Imaging in Patients with Acute Ischemic Stroke.

Noninvasive perfusion-weighted imaging with short scanning time could be advantageous in order to determine presumed penumbral regions and subsequent treatment strategy for acute ischemic stroke (AIS). Our aim was to evaluate interobserver agreement and the clinical utility of intravoxel incoherent motion MR imaging in patients with acute ischemic stroke. We retrospectively studied 29 patients with AIS (17 men, 12 women; mean age, 75.2 [SD, 12.0 ] years; median, 77 years). Each patient underwent intravoxel incoherent motion MR imaging using a 1.5T MR imaging scanner. Diffusion-sensitizing gradients were applied sequentially in the x, y, and z directions with 6 different b-values (0, 50, 100, 150, 200, and 1000 seconds/mm2). From the intravoxel incoherent motion MR imaging data, diffusion coefficient, perfusion fraction, and pseudodiffusion coefficient maps were obtained using a 2-step fitting algorithm based on the Levenberg-Marquardt method. The presence of decreases in the intravoxel incoherent motion perfusion fraction and pseudodiffusion coefficient values compared with the contralateral normal-appearing brain was graded on a 2-point scale by 2 independent neuroradiologists. Interobserver agreement on the rating scale was evaluated using the κ statistic. Clinical characteristics of patients with a nondecreased intravoxel incoherent motion perfusion fraction and/or pseudodiffusion coefficient rated by the 2 observers were also assessed. Interobserver agreement was shown for the intravoxel incoherent motion perfusion fraction (κ = 0.854) and pseudodiffusion coefficient (κ = 0.789) maps, which indicated almost perfect and substantial agreement, respectively. Patients with a nondecreased intravoxel incoherent motion perfusion fraction tended to show recanalization of the occluded intracranial arteries more frequently than patients with a decreased intravoxel incoherent motion perfusion fraction. Intravoxel incoherent motion MR imaging could be performed in < 1 minute in addition to routine DWI. Intravoxel incoherent motion parameters noninvasively provide feasible, qualitative perfusion-related information for assessing patients with acute ischemic stroke.

Interobserver Agreement Rates on Fibroblast Activation Protein Inhibitor-Directed Molecular Imaging and Therapy.

ObjectivesFibroblast activation protein (FAP) has emerged as a novel target for FAP inhibitor (FAPI)–directed molecular imaging and endoradiotherapy (ERT). We aimed to assess the interobserver agreement rates for interpretation of 68Ga-FAPI-4 PET/CT and decision for ERT.Patients and MethodsA random order of 68Ga-FAPI-4 PET/CTs from 49 oncology patients were independently interpreted by 4 blinded readers. Per scan, visual assessment was performed, including overall scan impression, number of organ/lymph node (LN) metastases, and number of affected organs/LN regions. Moreover, a maximum of 3 target lesions, defined as largest in size and/or most intense, per organ compartment were identified, which allowed for an additional quantitative interobserver assessment of LN and organ lesions. To investigate potential reference tissues, quantification also included unaffected liver parenchyma and blood pool. Readers also had to indicate whether FAPI-directed ERT should be considered (based on intensity of uptake and widespread disease). Interobserver agreement rates were evaluated using intraclass correlation coefficients (ICCs) and interpreted according to Cicchetti (with 0.4–0.59 indicating fair, and 0.6–0.74 good, agreement).ResultsOn a visual basis, the agreement rate for an overall scan impression was fair (ICC, 0.42; 95% confidence interval [CI], 0.27–0.57). The concordance rate for number of affected LN areas was also fair (ICC, 0.59; 95% CI, 0.45–0.72), whereas the number of LN metastases, number of affected organs, and number of organ metastases achieved good agreement rates (ICC, ≥0.63). In a quantitative analysis, concordance rates for LN were good (ICC, 0.70; 0.48–0.88), but only fair for organ lesions (ICC, 0.43; 0.26–0.60). In regards to background tissues, ICCs were good for unaffected liver parenchyma (0.68; 0.54–0.79) and fair for blood pool (0.43; 0.29–0.58). When readers should decide on ERT, concordance rates were also fair (ICC, 0.59; 95% CI, 0.46–0.73).ConclusionsFor FAPI-directed molecular imaging and therapy, a fair to good interobserver agreement rate was achieved, supporting the adoption of this radiotracer for clinical routine and multicenter trials.

Positive predictive value of Birads IV Lesions on mammogram in detection of breast carcinoma.

To determine the positive predictive value of Breast Imaging Reporting and Data System category IV lesions, and to evaluate interobserver agreement among radiologists in interpreting the subcategories. The cross-sectional study was conducted at the Dow Institute of Radiology, Dow University of Health Sciences, Karachi, from September 2018 to February 2019, and comprised adult females aged 30-60 years diagnosed with Breast Imaging Reporting and Data System IV. Already diagnosed breast carcinoma patients were excluded. The positive predictive value of Breast Imaging Reporting and Data System category IV was calculated using histopathology findings as the gold standard. Data was analysed using SPSS 22. There were 191 patients with a mean age of 49.01±11.79 years. Positive family history of breast cancer was found in 33(17.3%) subjects. Category IV-A was noted in 53(28.0%) subjects, IV-B in 45(23.6%) and IV-C in 93(48.7%). The overall positive predictive value of category IV was 151(79.1%), IV-A 27(50.9%), IV-B 35(77.7%) and IV-C 89(95.6%). Malignant disease was significantly associated with architectural distortion and suspicious microcalcifications (p<0.001). A good agreement was observed in the categorisation of Breast Imaging Reporting and Data System category IV between observers 1 and 2 (kappa 0.85, 95% confidence interval: 0.70-0.99), between observers 1 and 3 (kappa 0.77, 95% confidence interval: 0.61-0.94), and between observers 2 and 3 (kappa 0.63, 95% confidence interval: 0.43-0.83). Breast Imaging Reporting and Data System BI-RADS IV was found to have a high positive predictive value in the diagnosis of breast cancer. Besides the interobserver agreement in terms of identifying BI-RADS IV subcategories was good.

Evaluation of deep learning reconstructed high-resolution 3D lumbar spine MRI.

To compare interobserver agreement and image quality of 3D T2-weighted fast spin echo (T2w-FSE) L-spine MRI images processed with a deep learning reconstruction (DLRecon) against standard-of-care (SOC) reconstruction, as well as against 2D T2w-FSE images. The hypothesis was that DLRecon 3D T2w-FSE would afford improved image quality and similar interobserver agreement compared to both SOC 3D and 2D T2w-FSE. Under IRB approval, patients who underwent routine 3-T lumbar spine (L-spine) MRI from August 17 to September 17, 2020, with both isotropic 3D and 2D T2w-FSE sequences, were retrospectively included. A DLRecon algorithm, with denoising and sharpening properties was applied to SOC 3D k-space to generate 3D DLRecon images. Four musculoskeletal radiologists blinded to reconstruction status evaluated randomized images for motion artifact, image quality, central/foraminal stenosis, disc degeneration, annular fissure, disc herniation, and presence of facet joint cysts. Inter-rater agreement for each graded variable was evaluated using Conger's kappa (κ). Thirty-five patients (mean age 58 ± 19, 26 female) were evaluated. 3D DLRecon demonstrated statistically significant higher median image quality score (2.0/2) when compared to SOC 3D (1.0/2, p < 0.001), 2D axial (1.0/2, p < 0.001), and 2D sagittal sequences (1.0/2, p value < 0.001). κ ranges (and 95% CI) for foraminal stenosis were 0.55-0.76 (0.32-0.86) for 3D DLRecon, 0.56-0.73 (0.35-0.84) for SOC 3D, and 0.58-0.71 (0.33-0.84) for 2D. Mean κ (and 95% CI) for central stenosis at L4-5 were 0.98 (0.96-0.99), 0.97 (0.95-0.99), and 0.98 (0.96-0.99)for 3D DLRecon, 3D SOC and 2D, respectively. DLRecon 3D T2w-FSE L-spine MRI demonstrated higher image quality and similar interobserver agreement for graded variables of interest when compared to 3D SOC and 2D imaging. • 3D DLRecon T2w-FSE isotropic lumbar spine MRI provides improved image quality when compared to 2D MRI, with similar interobserver agreement for clinical evaluation of pathology. • 3D DLRecon images demonstrated better image quality score (2.0/2) when compared to standard-of-care (SOC) 3D (1.0/2), p value < 0.001; 2D axial (1.0/2), p value < 0.001; and 2D sagittal sequences (1.0/2), p value < 0.001. • Interobserver agreement for major variables of interest was similar among all sequences and reconstruction types. For foraminal stenosis, κ ranged from 0.55 to 0.76 (95% CI 0.32-0.86) for 3D DLRecon, 0.56-0.73 (95% CI 0.35-0.84) for standard-of-care (SOC) 3D, and 0.58-0.71 (95% CI 0.33-0.84) for 2D.

Agreement and error rates associated with standardized data collection protocols for skeletal and dental data on 3D virtual subadult crania

Observer error and agreement rates for craniometrics, odontometrics, and cranial and dental morphological traits have been inconsistently evaluated on three-dimensional cranial reconstructions and almost never assessed on subadult individuals. This study uses a computed tomography (CT) scan sample of 12 subadults aged between birth and 20 years from the Subadult Virtual Anthropology Database (SVAD) to evaluate intra- and inter-observer error and agreement rates associated to these four types of data on virtual crania. Forty-eight cranial landmarks, 33 standard inter-landmark distances (ILDs), 13 cranial macromorphoscopic traits, four permanent and four deciduous dental landmarks and measurements per tooth, and 21 permanent and 12 deciduous dental morphological traits were collected on each individual. Results matched or improved on published standards for dry bones, teeth, or dental casts. Technical Error of Measurement (TEM) associated with metric data ranged from 0.00 mm to 0.99 mm and relative TEM ranged from 0% to 5.76%. Cohen’s kappa coefficient values for agreement on morphological traits scores were above K = 0.5 for 90% of the traits. Type III cranial landmarks showed higher error rates than Type I and II cranial landmarks. Agreement on dental morphology scores seemed influenced by observer experience and rater agreement improved when using di- or tri-chotomized grades. Skeletal maturity did not significantly affect error rates, meaning most craniofacial and dental metrics and morphological traits can be reliably obtained from virtual subadult crania.

Diagnostic performance of anterior segment optical coherence tomography in detecting plateau iris

ObjectiveTo evaluate the diagnostic performance of manual grading of anterior segment optical coherence tomography (AS-OCT) in detection of plateau iris configuration (PIC) based on the presence of standardised ultrasound biomicroscopy...

Validation of a deep learning algorithm identifying diagnostic quality cardiac ultrasound reference views during search phase

Abstract Funding Acknowledgements Type of funding sources: Private company. Main funding source(s): DESKi Background Transthoracic echocardiography requires long and demanding training. The use of deep learning algorithms for the identification of diagnostic quality reference views opens the way for assisting low-experienced operators. However, such algorithms have only been trained and validated on retrospective data extracted from daily hospital practice. Those retrospective data are the best clips selected by experts during each exam. Thus, the performance of those algorithms has not been evaluated on complete acquisitions, including the search phase, i.e. when the operator is moving the probe to reach the optimal position. Those search phases are not recorded in clinical practice. Purpose The objective of this study was to evaluate the performance of a deep learning algorithm that identifies diagnostic quality images for 7 echocardiographic reference views on a prospective dataset including search phases. Methods A retrospective dataset containing acquisitions extracted from daily hospital practice was created. The retrospective dataset was manually annotated by experts following quality criteria that were defined for 7 main reference views: parasternal long and short axis, apical 4, 2, and 3-chamber, subcostal 4-chamber and inferior vena cava. Each frame of the acquisitions was annotated by an expert and reviewed by a second expert. A deep learning model was trained on the retrospective dataset and evaluated with 5-fold cross-validation. In a prospective dataset, for each included patient and each reference view, operators recorded the entire acquisition, including the search phase. Acquisitions were manually annotated by 2 experts following the same quality criteria. The model trained on retrospective data was evaluated on this prospective dataset against manual experts’ annotations. Additionally, 3 experts annotated a subset of the prospective dataset to evaluate the inter-observer variability. Results 481,111 frames from 1,325 patients were annotated for the retrospective dataset. On the 5-fold cross-validation, the algorithm reached an average accuracy of 89.2 ± 0.7% per frame and an average F1-score of 87.9 ± 0.9% per frame. For the prospective dataset, 70 patients were included and 143,804 frames annotated. The average accuracy was 84.8 ± 5.0% per patient, and the average F1-score was 83.1 ± 8.7% per patient. The average inter-observer agreement rates, performed on 10 patients (23,390 frames), were between 82.8 ± 4.9% and 86.3 ± 6.2%. Conclusions We propose a deep learning algorithm that automatically identifies 7 of the most common reference views with diagnostic quality while achieving performance within the range of the inter-observer variability in acquisitions including search phases.

Mitotic counts in one high power field in breast core biopsies is equivalent to counts in 10 high power fields.

Mitotic rate is an important prognostic predictor in invasive breast carcinoma. Current guidelines recommend counting mitoses from 10 contiguous high power fields (HPFs) in the core biopsy. We propose a method to score mitotic activity in 1 HPF at the most mitotically active area of the tumour edge, or the interface between invasive tumour and benign breast tissue. We propose a score of 1, 2, or 3, corresponding to ≤1, 2, or ≥3 mitoses in 1 HPF, respectively. A total of 141 breast core biopsies with corresponding surgical excisions were blindly examined. We counted the number of mitotic figures in 1 HPF and in 10 contiguous HPFs in the core biopsy and compared with the mitotic count from 10 contiguous HPFs in the excision which is considered the gold standard. Concordance rates and interobserver agreement rates were calculated. The concordance rate was 82.3%, 78.7% and 82.3% between 1 HPF versus 10 HPFs in the core biopsy, 1 HPF in the core biopsy versus 10 HPFs in the excision and 10 HPFs in the core biopsy vs 10 HPFs in the excision, respectively. In the core biopsy, all three investigators agreed in 73.8% and 83.7% of the cases using the 1 HPF method and the 10 HPFs method, respectively; in the excision specimen, agreement was reached in 82.3% of the cases. The 1 HPF method showed similar concordance rate and interobserver agreement compared to the conventional method in the prediction of the mitotic score in the excision in all score groups. When stratified by mitotic score, the 1 HPF method predicted superior correlation with excision in the score 1 group than the 10 HPFs method, but not in the score 2 or 3 groups. From these findings we conclude that the proposed 1 HPF method can be used in clinical practice to grade invasive breast carcinomas in core biopsies, with the possibility of being utilised in small biopsies with less than 10 HPFs of invasive carcinoma.

Exploring the Interobserver Agreement in Computer-Aided Radiologic Tumor Measurement and Evaluation of Tumor Response.

The accurate, objective, and reproducible evaluation of tumor response to therapy is indispensable in clinical trials. This study aimed at investigating the reliability and reproducibility of a computer-aided contouring (CAC) tool in tumor measurements and its impact on evaluation of tumor response in terms of RECIST 1.1 criteria. A total of 200 cancer patients were retrospectively collected in this study, which were randomly divided into two sets of 100 patients for experiential learning and testing. A total of 744 target lesions were identified by a senior radiologist in distinctive body parts, of which 278 lesions were in data set 1 (learning set) and 466 lesions were in data set 2 (testing set). Five image analysts were respectively instructed to measure lesion diameter using manual and CAC tools in data set 1 and subsequently tested in data set 2. The interobserver variability of tumor measurements was validated by using the coefficient of variance (CV), the Pearson correlation coefficient (PCC), and the interobserver correlation coefficient (ICC). We verified that the mean CV of manual measurement remained constant between the learning and testing data sets (0.33 vs. 0.32, p = 0.490), whereas it decreased for the CAC measurements after learning (0.24 vs. 0.19, p < 0.001). The interobserver measurements with good agreement (CV < 0.20) were 29.9% (manual) vs. 49.0% (CAC) in the learning set (p < 0.001) and 30.9% (manual) vs. 64.4% (CAC) in the testing set (p < 0.001). The mean PCCs were 0.56 ± 0.11 mm (manual) vs. 0.69 ± 0.10 mm (CAC) in the learning set (p = 0.013) and 0.73 ± 0.07 mm (manual) vs. 0.84 ± 0.03 mm (CAC) in the testing set (p < 0.001). ICCs were 0.633 (manual) vs. 0.698 (CAC) in the learning set (p < 0.001) and 0.716 (manual) vs. 0.824 (CAC) in the testing set (p < 0.001). The Fleiss’ kappa analysis revealed that the overall agreement was 58.7% (manual) vs. 58.9% (CAC) in the learning set and 62.9% (manual) vs. 74.5% (CAC) in the testing set. The 80% agreement of tumor response evaluation was 55.0% (manual) vs. 66.0% in the learning set and 60.6% (manual) vs. 79.7% (CAC) in the testing set. In conclusion, CAC can reduce the interobserver variability of radiological tumor measurements and thus improve the agreement of imaging evaluation of tumor response.

Incremental benefit of dye-based chromoendoscopy to predict the risk of submucosal invasive cancer in large nonpedunculated colorectal polyps

Detailed lesion assessment of large nonpedunculated colorectal polyps (LNPCPs;≥20mm) can help predict the risk of submucosal invasive cancer (SMIC). Traditionally this has required the use of dye-based chromoendoscopy (DBC). We sought to assess the accuracy and incremental benefit of DBC in addition to high-definition white-light imaging (HDWLI) and virtual chromoendoscopy (VCE) for the prediction of SMIC within LNPCPs. A prospective observational study of consecutive LNPCPs at a single tertiary referral center was performed. Before resection all lesions were assessed for the presence of a demarcated area (DA), defined as an area of disordered pit or microvascular pattern, by 2 trained endoscopists before and after DBC. Diagnostic performance characteristics were calculated with histology as the reference criterion standard, and overall agreement was calculated using the κ statistic. Over 39 months to March 2021, 400 consecutive LNPCPs (median lesion size, 35mm; interquartile range, 25-45) were analyzed. The overall rate of SMIC was 6.5%. Presence of a DA had an accuracy of 91% (95% confidence interval, 87.7-93.5) for SMIC, independent of the use of DBC. The rate of interobserver agreement for presence of a DA using HDWLI+ VCE was very high (κ= .96) with no benefit gained by the addition of DBC. The use of HDWLI and VCE is likely to be adequate for lesion assessment for the prediction of SMIC among LNPCPs. Further, the absence of a DA is strongly predictive for the absence of SMIC, independent to the use of DBC. (Clinical trial registration number: NCT03506321.).

Correlation and agreement between physical and ultrasound examination after a training session dedicated to the standardization of synovitis assessment in rheumatoid arthritis patients

ObjectivesAssessing disease activity in rheumatoid arthritis (RA) patients requires comprehensive quantification of tender and swollen joints. We aimed to evaluate the correlation and agreement between rheumatologists after a training session dedicated to the standardization of synovitis assessment and compare its performance with a reference imaging modality such as musculoskeletal ultrasonography (MSUS).MethodsIn this cross-sectional study, a total of 28 and 10 joints in RA patients were evaluated by physical examination and ultrasound (US), respectively. After participating in a training session, individual joint assessment for tenderness and swelling was performed by three rheumatologists. MSUS examination was performed separately by an experimented radiologist in a standardized manner, evaluating findings according to the Outcome Measures in Rheumatology Clinical Trial (OMERACT) guidelines.ResultsA total of 80 RA patients were included, with a mean Disease Activity Score based on 28 joints (DAS28)-ESR of 4.02. The interobserver overall agreement and concordance rate in a total of 2240 joints assessed was 81.7% (k = 0.449, p < 0.0001) for tender joints and 66% (k = 0.227, p < 0.0001) for swollen joints. The overall concordance rate was fair (Fleiss' kappa = 0.21, p = 0.027) with an overall agreement of 67.18% yet, more joints were found to be swollen by the US assessment, compared to the physical examination (43% vs 39%).ConclusionIn our study population, joint tenderness showed better interobserver agreement, correlation, and concordance rate than joint swelling. When comparing the US assessment to the physical examination, a fair overall concordance rate supports the need for the implementation of training sessions dedicated to standardization in rheumatology clinics.

Agreement and Intraobserver Variability in Detection of Helicobacter pylori Infection Using Routine Histology, H. pylori Immunohistochemical Stain, and Warthin-Starry Special Stain on Gastric Tissue Biopsy Samples

Abstract Introduction/Objective Helicobacter pylori (HP) is a prevalent cause of gastritis in the US and worldwide. Accurate detection of the organism is important for appropriate treatment. Diagnosis is made using immunohistochemistry and special stains including Warthin-Starry stain (WS) which is low cost, technically easy to perform on tissue sections, and can be automated. We aimed to assess interobserver variability, reproducibility and validity of hematoxylin and eosin stain (H&amp;E), WS and anti-Helicobacter pylori immunohistochemical staining (HP-IHC) for the histopathological identification and evaluation of HP organisms on gastric mucosa biopsies. Methods/Case Report We prospectively evaluated gastric biopsies from ten adult patients. These patients underwent upper gastrointestinal endoscopy with subsequent biopsy for various abdominal complaints. Seven of the ten biopsies (7/10) were HP infection positive, and three cases (3/10) were HP negative by H&amp;E stain and HP-IHC (determined by GI Pathologist). The presence or absence and density of HP, were assessed on H&amp;E, HP-IHC and WS in blinded fashion by five general surgical (GS) pathologists. The GS pathologists assessed the cases for presence and density of HP using the semi-quantitative modified Sydney classification (none, mild, moderate, and severe). Percentage agreement and interobserver variablilty using Cohen-Kappas statistics (KS) were calculated. Results (if a Case Study enter NA) The percentage agreement for presence or absence of HP in the biopsies with H&amp;E, HP-IHC and WS stains were 91%, 98% and 99%, respectively. The interobserver agreement for evaluation of presence of HP was excellent with WS staining method (Overall KS = 0.737 95%, Confidence Interval (CI) = 0.501- 0.973) and HP-IHC (Overall KS = 0.783, 95% CI = 0.585-0.980). Agreement for H&amp;E was moderate (Overall KS = 0.532, 95% CI= 0.392-0.672). HP density agreement was excellent using WS and HP-IHC and H&amp;E was in the moderate range. Conclusion This study found excellent interobserver agreement using IHC and WS. While IHC is the most specific stain, WS is more sensitive in identifying the shape and morphology of HP organisms and is an efficient and low-cost alternative with excellent morphology in general surgical practice.

Tomografía computarizada coronaria en urgencias: importancia de la experiencia del radiólogo

IntroductionIncorporating coronary computed tomography angiography (CTA) in the hospital workup for suspected acute coronary syndrome requires appropriate skills for interpreting this imaging test. Radiologists’ skills can affect the interobserver agreement in evaluating these studies. ObjectiveTo determine the interobserver agreement according to radiologists’ experience in the interpretation of coronary CTA studies done in patients who present at the emergency department with acute chest pain and low-to-intermediate probability of acute coronary syndrome. Materials and methodsWe studied the interobserver agreement in the urgent evaluation of coronary CTA studies in which CAD-RADS was used to register the findings. We created pairs of observers among a total of 8 assessors (4 attending radiologists and 4 radiology residents). We used the kappa coefficient to estimate the overall concordance and the concordance between subgroups according to their experience. ResultsThe agreement was substantial between experienced radiologists and residents (k = 0.627; 95%CI: 0.436 – 0.826) as well as between all the pairs of observers (k=0.661; 95%CI: 0.506 – 0.823) for all the CAD-RADS together. The degree of agreement within the group of experienced radiologists was greater than that within the group of residents in all the analyses. The agreement was excellent for the overall CAD-RADS (k=0.950; 95% CI: 0.896 – 1) and for CAD-RADS ≥ 4 (k=1); the agreement was lower for CAD-RADS ≥ 3 (k = 0.754; 95% CI: 0.246 – 1.255). The agreement for the residents for these categories was k= 0.623, k=0.596, and k=0.473, respectively. ConclusionThe agreement among attending radiologists regarding the assessment of urgent coronary CTA studies is excellent. The agreement is lower when residents are paired with attending radiologists. These findings should be taken into consideration when implementing coronary CTA in emergency departments and in the organization of radiological staff for interpreting and reporting this imaging test.

A multicenter study of interobserver variability in pathologic diagnosis of papillary breast lesions on core needle biopsy with WHO classification

BackgroundPapillary breast lesions (PBLs) comprise diverse entities from benign and atypical lesions to malignant tumors. Although PBLs are characterized by a papillary growth pattern, it is challenging to achieve high diagnostic accuracy and reproducibility. Thus, we investigated the diagnostic reproducibility of PBLs in core needle biopsy (CNB) specimens with World Health Organization (WHO) classification.MethodsDiagnostic reproducibility was assessed using interobserver variability (kappa value, κ) and agreement rate in the pathologic diagnosis of 60 PBL cases on CNB among 20 breast pathologists affiliated with 20 medical institutions in Korea. This analysis was performed using hematoxylin and eosin (H&E) staining and immunohistochemical (IHC) staining for cytokeratin 5 (CK5) and p63. The pathologic diagnosis of PBLs was based on WHO classification, which was used to establish simple classifications (4-tier, 3-tier, and 2-tier).ResultsOn WHO classification, H&E staining exhibited ‘fair agreement’ (κ = 0.21) with a 47.0% agreement rate. Simple classifications presented improvement in interobserver variability and agreement rate. IHC staining increased the kappa value and agreement rate in all the classifications. Despite IHC staining, the encapsulated/solid papillary carcinoma (EPC/SPC) subgroup (κ = 0.16) exhibited lower agreement compared to the non-EPC/SPC subgroup (κ = 0.35) with WHO classification, which was similar to the results of any other classification systems.ConclusionsAlthough the use of IHC staining for CK5 and p63 increased the diagnostic agreement of PBLs in CNB specimens, WHO classification exhibited a higher discordance rate compared to any other classifications. Therefore, this result warrants further intensive consensus studies to improve the diagnostic reproducibility of PBLs with WHO classification.

Conventional-Dose CT Versus 2-mSv CT for Right Colonic Diverticulitis as an Alternate Diagnosis of Appendicitis: Secondary Analysis of Large Pragmatic Randomized Trial Data.

BACKGROUND. Adoption of low-dose CT for the diagnosis of appendicitis has been slow in children and in adults, partly because of concern about missing alternative diagnoses including right colonic diverticulitis. OBJECTIVE. The purpose of our study was to retrospectively compare the diagnostic performance of IV contrast-enhanced 2-mSv and conventional-dose CT (CDCT) for the diagnosis of right colonic diverticulitis in adolescents and young adults with suspected appendicitis. METHODS. This post hoc analysis of a prospective randomized controlled trial included 3074 patients (1672 female patients and 1402 male patients) ranging in age from 15 to 44 years old (mean ± SD, 28 ± 9 years) from 20 hospitals. From December 2013 to August 2016, patients were randomized to either the 2-mSv CT group (n = 1535 patients) or the CDCT (median, 7 mSv) group (n = 1539 patients). A total of 161 radiologists prospectively issued CT reports in which they suggested alternative diagnoses for 976 (2-mSv CT) and 924 (CDCT) patients. Seven independent assessors adjudicated final diagnoses on the basis of clinical and CT findings. Endpoints of test-positives, test-negatives, sensitivity, and specificity for right colonic diverticulitis were compared using chi-square and Mann-Whitney U tests. Characteristics and disposition of patients with test-positive results were assessed. Four readers retrospectively reviewed CT images of 400 patients selected from the trial (113 and 108 patients with diverticulitis from 2-mSv CT and CDCT groups, respectively) to evaluate interobserver agreement for right colonic diverticulitis in terms of Gwet coefficients. RESULTS. Between-group differences were minute for most endpoints related to right colonic diverticulitis: test-positives (difference, 0.2% [95% CI, -1.8% to 2.1%]; 7.8% [119/1535 patients] vs 7.6% [117/1539 patients]; p = .93), test-negatives (0.5% [95% CI, -1.5% to 2.5%]; 91.7% [1407/1535] vs 91.2% [1403/1539]; p = .67), sensitivity (0% [95% CI, -6% to 6%]; 95% [110/116] vs 95% [105/111]; p > .99), and specificity (0.3% [95% CI, -0.5% to 0.9%]; 99.4% [1401/1410] vs 99.1% [1397/1409]; p = .66). The characteristics and disposition of test-positive patients were similar between the two groups. Gwet coefficients were high and comparable between the two groups (2-mSv CT vs CDCT, 0.849 vs 0.889; p = .20). CONCLUSION. Two-millisievert CT is comparable to conventional-dose CT for the diagnosis of right colonic diverticulitis. CLINICAL IMPACT. By mitigating concern about a missed diagnosis of right colonic diverticulitis, the results further support the use of low-dose CT in patients with suspected appendicitis. TRIAL REGISTRATION. ClinicalTrials.gov NCT01925014.

Reproducibility of MRI Features of Uterine Leiomyomas: A Study on Interobserver Agreement and Inter-Method Agreement With Surgery.

To evaluate interobserver agreement in the interpretation of different MRI features of uterine leiomyomas (UL) according to observers' experience, and to assess the inter-method reproducibility (MRI versus surgery) regarding the International Federation of Gynecology and Obstetrics (FIGO) classification. Retrospective study including UL patients who underwent MRI and surgical treatment. Four blinded observers (2 vs >10 years of experience) assessed UL regarding dimensions and volume; inner and outer mantles; FIGO classification; vascularization; degeneration; and diffusion-weighted imaging features. Uterine dimensions and volume were calculated. FIGO classification as ascertained by observers was compared to surgical findings. Intraclass correlation coefficient (ICC) estimates were used for interobserver comparison of numerical variables, and kappa statistic for categorical variables. Thirty-five patients (26y-73y) with 61 UL were included in the interobserver analyses, and 31 patients (54 UL) had available data allowing retrospective surgical FIGO classification for assessment of inter-method reproducibility. Both groups of observers had good to excellent agreement in assessing UL (ICC = 0.980-0.994) and uterine volumes (ICC = 0.857-0.914), mantles measurement (ICC = 0.797-0.920), and apparent diffusion coefficient calculation (ICC = 0.787-0.883). There was substantial agreement for both groups regarding FIGO classification (κ = 0.645-0.767). Vascularization, degeneration and restricted diffusion had lower agreement, varying from reasonable to moderate. Inter-method agreement was reasonable (κ = 0.341-0.395). Interobserver agreement of MRI for UL was higher for quantitative than qualitative features, with a little impact of observers' experience for most features. MRI agreement with surgery was reasonable. Further efforts should be taken to improve interobserver and inter-method reproducibility for MRI in this scenario.

Compressed-sensing accelerated magnetic resonance imaging of inner ear.

ObjectiveTo compare conventional method and compressed‐sensing (CS) accelerated 3D balanced fast field echo imaging (bFFE) of inner ear.MethodsTwenty patients with suspected inner ear disease underwent CS accelerated 3D‐bFFE (CS‐bFFE) and conventional 3D‐bFFE (Con‐bFFE) by a 3T MRI. The overall image quality, motion artifacts, and image quality of specific structures of inner ear were assessed on ordinal scales by three radiologists who were blinded to the scan protocols. Kendall W test was used to evaluate interobserver agreement and Wilcoxon test was performed to compare the image quality and motion artifacts between CS‐bFFE and Con‐bFFE.ResultsThe acquisition duration of CS‐bFFE (1 min 53 s) was 49% faster than Con‐bFFE. Three radiologists had good inter‐observer agreement of image quality (Kendall W value of 0.829 for CS‐bFFE and 0.815 for Con‐bFFE) and motion artifacts evaluation (Kendall W value of 0861 for CS‐bFFE and 0.707 for Con‐bFFE). The better overall image quality of CS‐bFFE was assessed (4.93 ± 0.23 for CS‐bFFE, 4.53 ± 0.70 for Con‐bFFE, Z = −2.254, p = 0.024). The image quality score of facial and cochlear nerve gained higher in CS‐bFFE (4.93 ± 0.23 for CS‐bFFE, 4.58 ± 0.64 for Con‐bFFE, Z = −2.094, p = 0.036). No significant difference of motion artifacts (p = 0.050) between CS‐bFFE and Con‐bFFE.ConclusionsThe CS‐bFFE improves image quality and reduces acquisition time significantly, and it is a feasible MRI protocol for inner ear imaging.

Observer Variability: A New Approach in Evaluating Interobserver Agreement

Existing indices of observer agreement for continuous data, such as the intraclass correlation coefficient or the concordance correlation coefficient, measure the total observer-related variability, which includes the variabilities between and within observers. This work introduces a new index that measures the interobserver variability, which is defined in terms of the distances among the ‘true values’ assigned by different observers on the same subject. The new coefficient of interobserver variability (CIV ) is defined as the ratio of the interobserver and the total observer variability. We show how to estimate the CIV and how to use bootstrap and ANOVAbased methods for inference. We also develop a coefficient of excess observer variability, which compares the total observer variability to the expected total observer variability when there are no differences among the observers. This coefficient is a simple function of the CIV . In addition, we show how the value of the CIV , estimated from an agreement study, can be used in the design of measurements studies. We illustrate the new concepts and methods by two examples, where (1) two radiologists used calcium scores to evaluate the severity of coronary artery arteriosclerosis, and (2) two methods were used to measure knee joint angle.