Level Of Interobserver Agreement Research Articles

Interobserver Variability in Ultrasound Reporting - Tertiary Hospital Radiologists Do Better

Introduction: Thyroid Imaging Reporting and Data System (TI-RADS) was developed to provide a standardized risk-stratification system for patients with thyroid nodules. Single-center studies have demonstrated an acceptable level of interobserver agreement in applying TI-RADS in clinical practice, however data regarding consistency among different centers is limited. In Israel, thyroid nodules are initially evaluated by ultrasound performed by radiologists at the health maintenance organization (HMO) and then patients are referred to tertiary hospitals for ultrasound-guided fine needle aspiration (FNA) biopsy when indicated. Objective: To evaluate the interobserver concordance in TI-RADS classification system reporting between the HMO and a tertiary hospital. Methods: We performed a retrospective analysis of the sonographic features of 370 thyroid nodules TI-RADS category 2 or higher, from 350 patients evaluated by ultrasound at the HMO and at Hadassah Medical Center from January 1, 2018 to December 31, 2019. The primary outcome was concordance between the TI-RADS classification at the HMO compared to the hospital. Additional endpoints included correlation of TI-RADS to the Bethesda category following FNA, and correlation of TI-RADS with malignancy on final pathology. Results: Of 370 nodules, only 73 (19.8%) demonstrated concordance between the HMO and the hospital. The level of agreement was poor, with 277 (74.8%) nodules demonstrating higher TI-RADS at the HMO compared to the hospital, and 20 (5.4%) with lower TI-RADS at the HMO compared to the hospital (p<0.001, weighted Kappa = 0.120). Of the nodules referred to the hospital, 241 (65.1%) were selected for FNA. A strong correlation between the hospital TI-RADS and Bethesda category was demonstrated (p<0.001). Furthermore, 60 (16.2%) nodules were surgically removed. A strong correlation was identified between the hospital TI-RADS and malignancy on final pathology (p<0.001), yet there was no correlation with the TI-RADS of the HMO (p=0.346). Conclusions: There is poor concordance between TI-RADS classification on ultrasound performed in the HMO compared to a tertiary hospital. In patients who underwent FNA and eventually surgery, the hospital TI-RADS strongly correlated with Bethesda category and final risk of malignancy. Standardization of thyroid ultrasound terminology and dedicated training in thyroid imaging are needed to improve the interobserver concordance in clinical practice.

Observer agreement in the diagnosis of oral lichen planus using the proposed criteria of the American Academy of Oral and Maxillofacial Pathology.

Oral lichen planus (OLP) is a common chronic inflammatory condition with an undefined malignant transformation potential. There have been many attempts at providing a specific definition of OLP without conclusive outcomes. A new set of diagnostic criteria was proposed in 2016 by the American Academy of Oral and Maxillofacial Pathology (AAOMP) in an endeavour to resolve this issue, and this has not yet been evaluated. This study aimed to assess the utility of AAOMP proposed criteria for the diagnosis of OLP. Five pathologists blindly assessed a cohort of 215 digital whole slide images (WSI) obtained from haematoxylin and eosin-stained microscopic slides. Forty-six WSI were included twice to assess the intra-observer agreement. Included cases were diagnosed clinically as either OLP or oral lichenoid reaction. Each pathologist was asked to utilize the AAOMP histopathological criteria while assessing slides. The variations in diagnoses were assessed by unweighted kappa statistics. The level of intra-observer agreement was very good (0.801 to 0.899). The level of inter-observer agreement among the observers varied from good (0.658) to very good (0.842) when the responses were categorized as evident/compatible OLP versus no OLP and was good (0.62 to 0.725) when the responses were categorized as evident OLP, versus compatible OLP, versus no OLP. The clinico-pathological correlation was 87.6%. A reliable level of agreement can be achieved by pathologists for the diagnosis of OLP using the AAOMP criteria for differentiation between lichenoid and other conditions. There are still limitations in discriminating OLP from oral lichenoid lesions microscopically.

Nuclear grade and comedo necrosis of ductal carcinoma in situ as histopathological eligible criteria for the Japan Clinical Oncology Group 1505 trial: an interobserver agreement study.

The Japan Clinical Oncology Group 1505 trial is a single-arm multicentre prospective study that examined the possibility of non-surgical follow-up with endocrine therapy for patients with low-grade ductal carcinoma in situ. In that study, the eligible criteria included histopathological findings comprising low to intermediate nuclear grade and absence of comedo necrosis, and cases were entered according to the local histopathological diagnosis. Nuclear grade is largely based on the Consensus Conference criteria (1997), whereas comedo necrosis is judged according to the Rosen's criteria (2017). The purpose of this study was to standardize and examine the interobserver agreement levels of these histopathological criteria amongst the participating pathologists. We held slide conferences, where photomicrographs of haematoxylin-eosin-stained slides from 68 patients with ductal carcinoma in situ were presented using PowerPoint. The nuclear grade and comedo necrosis statuses individually judged by the pathologists were analysed using κ statistics. In the first and second sessions, where 22 cases each were presented, the interobserver agreement levels of nuclear grade whether low/intermediate grade or high grade were moderate amongst 29 and 24 participating pathologists, respectively (κ=0.595 and 0.519, respectively). In the third session where 24 cases were presented, interobserver agreement levels of comedo necrosis or non-comedo necrosis were substantial amongst 25 participating pathologists (κ=0.753). Although the concordance rates in nuclear grade or comedo necrosis were not high in a few of the cases, we believe that these results could provide a rationale for employing the present criteria of nuclear grade and comedo necrosis in the clinical study of ductal carcinoma in situ.

Magnetic resonance imaging evaluation of common peroneal nerve injury in acute and subacute posterolateral corner lesion: a retrospective study.

ObjectiveTo evaluate qualitative and quantitative magnetic resonance imaging (MRI) criteria for injury of the common peroneal nerve (CPN) in patients with acute or subacute injuries in the posterolateral corner (PLC) of the knee, as well as to evaluate the reproducibility of MRI evaluation of CPN alterations.Materials and MethodsThis was a retrospective study of 38 consecutive patients submitted to MRI and diagnosed with acute or subacute injury to the PLC of the knee (patient group) and 38 patients with normal MRI results (control group). Two musculoskeletal radiologists (designated radiologist A and radiologist B, respectively) evaluated the images. Nerve injury was classified as neurapraxia, axonotmesis, or neurotmesis. Signal strength was measured at the CPN, the tibial nerve (TN), and a superficial vein (SV). The CPN/TN and CPN/SV signal ratios were calculated. The status of each PLC structure, including the popliteal tendon, arcuate ligament, lateral collateral ligament, and biceps tendon, was classified as normal, partially torn, or completely torn, as was that of the cruciate ligaments. For the semiquantitative analysis of interobserver agreement, the kappa statistic was calculated, whereas a receiver operating characteristic (ROC) curve was used for the quantitative analysis.ResultsIn the patient group, radiologist A found CPN abnormalities in 15 cases (39.4%)-neurapraxia in eight and axonotmesis in seven-whereas radiologist B found CPN abnormalities in 14 (36.8%)-neurapraxia in nine and axonotmesis in five. The kappa statistic showed excellent interobserver agreement. In the control group, the CPN/TN signal ratio ranged from 0.63 to 1.1 and the CPN/SV signal ratio ranged from 0.16 to 0.41, compared with 1.30-4.02 and 0.27-1.08, respectively, in the patient group. The ROC curve analysis demonstrated that the CPN/TN signal ratio at a cutoff value of 1.39 had high (93.3%) specificity for the identification of nerve damage, compared with 81.3% for the CPN/SV signal ratio at a cutoff value of 0.41.ConclusionCPN alterations are common in patients with PLC injury detected on MRI, and the level of interobserver agreement for such alterations was excellent. Calculating the CPN/TN and CPN/SV signal ratios may increase diagnostic confidence. We recommend systematic analysis of the CPN in cases of PLC injury.

REPRODUCIBILITY OF MODIFIED WALDENSTRÖM CLASSIFICATION IN PERTHES DISEASE.

ABSTRACTObjective: The purpose of our study is to evaluate intraobserver and interobserver reliability of modified Waldenström classification system for Legg-Calvé-Perthes disease and assess the influence of the professional’s area of expertise in the assessment. Methods: Twelve evaluators assessed 40 pairs of pelvic radiographs of patients with Legg-Calvé-Perthes disease. After two weeks, a new evaluation was performed by the same evaluators. Kappa and Kendall’s W indexes were used to evaluate both intraobserver and interobserver reliability and determine the influence of the evaluators’ experience and area of expertise. Results: The average intraobserver kappa value was 0.394, with a reasonable agreement level. The interobserver Kappa value was 0.243 in the first evaluation (95% CI, 0.227-0.259 and p < 0.0001) and 0.245 in the second evaluation (95% CI, 0.229-0.260 and p < 0.0001). The Kendall’s W values obtained for pediatric orthopedists, radiologists and resident physicians were 0.686, 0.630 and 0.529 (p < 0.0001), respectively. Conclusion: The modified Waldenström classification presented both moderate and reasonable levels of intraobserver agreement, and reasonable level of interobserver agreement. The evaluators’ degree of experience and area of expertise influenced the concordance level found. Level of Evidence II, Diagnostic Studies - Investigating a Diagnostic Test.

Reproducibility of tumor budding assessment in pancreatic cancer based on a multicenter interobserver study

Tumor budding has been reported to be an independent prognostic factor in pancreatic ductal adenocarcinoma (PDAC). Its use in daily diagnostics would improve the prognostic stratification of patients. We performed a multicenter interobserver study to test various budding assessment methods for their reproducibility. Two serial sections of 50 resected, treatment-naïve PDACs were stained for Hematoxylin and Eosin (H&E) and pancytokeratin. Tumor budding was scored by independent observers at five participating centers in Switzerland, Germany, and Canada. Pathologists assessed tumor budding on a digital platform comparing H&E with pancytokeratin staining in 10 high-power fields (10HPF) and one HPF hotspot (1HPF). Additionally, tumor budding was assessed in one H&E hotspot at × 20 magnification, as suggested by the International Tumor Budding Consensus Conference (ITBCC). Correlation coefficients for bud counts between centers ranged from r = 0.58648 to r = 0.78641 for H&E and from r = 0.69288 to r = 0.81764 for pancytokeratin. The highest interobserver agreement across all centers was observed for pancytokeratin 10HPFs (ICC = 0.6). ICC values were 0.49, 0.48, 0.41, and 0.4 for H&E in 1HPF hotspot, H&E in 10HPFs, pancytokeratin in 1HPF, and H&E in one hotspot at ×20, respectively (ITBCC method). This interobserver study reveals a range between moderately poor to moderate agreement levels between pathologists for the different tumor budding assessment methods in PDAC. Acceptable levels of agreement were reached with the pancytokeratin 10HPF method, which can thus be recommended for the assessment of tumor budding in PDAC resection specimens. To improve the levels of interobserver agreement, the implementation of machine learning applications should be considered.

Evaluation of proximal humeral epiphysis ossification in 3.0 T MR images according to the Dedouit staging method: Is it be used for age of majority?

Magnetic resonance imaging (MRI) for forensic age estimation is among the research issues since it does not lead to radiation exposure. In this study, the ossification stage of the proximal humeral epiphysis was determined retrospectively in 178 male and 109 female individuals in the 12 to 30-year age group using 3.0 T MRI. All images were evaluated with the proton density fat saturated turbo spin echo (PD TSE FS) sequence and the T2 TSE FS sequence. A five-stage scoring system was used following the method of Dedouit et al. The relevant statistics were defined as minimum, maximum, mean ± standard deviation, 95% confidence interval of mean and median and the intra- and interobserver agreement levels were very good (κ > 0.80). There were no significant age differences between males and females in any of the stages (all p-values>0.05). According to the present study, stage 5 was initially observed at age 22 years for both genders. According to our results, it is possible to determine the completion of the 18th year of life in either gender on the shoulder joint. Proximal humeral epiphysis ossification may be used as an additional method for forensic age estimation through MRI.

Clinical T category for lung cancer staging: A pragmatic approach for real-world practice.

BackgroundTo determine which components should be measured and which window settings are appropriate for computerized tomography (CT) size measurements of lung adenocarcinoma (ADC) and to explore interobserver agreement and accuracy according to the eighth edition of TNM staging.MethodsA total of 165 patients with surgically resected lung ADC earlier than stage 3A were included in this study. One radiologist and two pulmonologists independently measured the total and solid sizes of components of tumors on different window settings and assessed solidity. CT measurements were compared with pathologic size measurements.ResultsIn categorizing solidity, 25% of the cases showed discordant results among observers. Measuring the total size of a lung adenocarcinoma predicted pathologic invasive components to a degree similar to measuring the solid component. Lung windows were more accurate (intraclass correlation [ICC] = 0.65–0.81) than mediastinal windows (ICC = 0.20–0.72) at predicting pathologic invasive components, especially in a part‐solid nodule. Interobserver agreements for measurement of solid components were good with little significant difference (lung windows, ICC = 0.89; mediastinal windows, ICC = 0.91). A high level of interobserver agreement was seen between the radiologist and pulmonologists and between residents (from the division of pulmonology and critical care) versus a fellow (from the division of pulmonology and critical care) on different windows.ConclusionsA considerable percentage (25%) of discrepancies was encountered in categorizing the solidity of lesions, which may decrease the accuracy of measurements. Lung window settings may be superior to mediastinal windows for measuring lung ADCs, with comparable interobserver agreement and moderate accuracy for predicting pathologic invasive components.Key pointsSignificant findings of the study Lung window settings are better for evaluating part‐solid lung adenocarcinoma (ADC), with comparable interobserver agreement and moderate accuracy for predicting pathologic invasive components. The considerable percentage (25%) of discrepancies in categorizing solidity of the lesions may also have decreased the accuracy of measurements. What this study adds For accurate measurement and categorization of lung ADC, robust quantitative analysis is needed rather than a simple visual assessment.

Teacher-student -task -interactions in a motor skills programme for an adolescent boy with autism spectrum disorder: a systematic observation study (Interacción profesor-alumno-tarea en un programa de desarrollo de capacidades motrices en un adolescente con TEA: un estudio de observación sistemática)

This study illustrates the potential offered by observational methodology for analysing spontaneous behaviours and interactions by students with autism spectrum disorder (ASD). We present a case study in which we observed, analysed and interpreted how an adolescent boy with ASD interacted both verbally and non-verbally with his physical education teacher and with different gym- and pool-based tasks within a motor skills development programme. The data were annotated in the free software LINCE using an ad hoc observation instrument combining a field format and category systems. The quality of the data was confirmed by high levels of interobserver agreement (calculated quantitatively using Cohen’s kappa statistic). Two diachronic techniques at the forefront of observational methodology, lag sequential analysis (GSEQ) and polar coordinate analysis (HOISAN), were used to investigate activating and inhibitory relationships corresponding to desirable and undesirable verbal and non-verbal interactions between the boy and the different zones in the motor skills circuits and the teacher’s responses to these interactions.

Role of placenta accreta index in prediction of morbidly adherent placenta: A reliability study.

To estimate the level of interobserver agreement in the calculation of placenta accreta index (PAI) as well as to evaluate the accuracy of PAI in prediction of morbidly adherent placenta. This was a prospective study where 45 pregnant women (from 28 to 37 weeks of gestational age) with at least one previous Caesarean section and ultrasound-proven placenta previa were included. A known and previously published scoring system, the PAI, was evaluated independently by two radiologists and the cases were followed for the delivery and histopathology outcome. The accuracy of the PAI and the level of interrater agreement was analysed using cross-table analysis, intraclass correlation efficient and Cohen's kappa as statistical variables. Adherent placenta was found in 15 patients accounting for 33% of cases. The PAI showed nearly 90% sensitivity, specificity and the predictive values. Interrater agreement in calculation of PAI by the two radiologists was perfect with an intraclass correlation efficient of 0.959. An easy-to-use morbid adherent placenta score was also predicted to simplify the results of PAI, which showed moderate agreement (κ = 0.746). The PAI can be helpful in stratifying the individual risk of placental invasion above the baseline risk. The PAI-derived, simplified scoring system called morbid adherent placenta score can be used as a simple tool to interpret and convey the results of PAI.

Evaluation of the Inter and Intra-Observer Reliability of the AO Classification of Intertrochanteric Fractures and the Device Choice (DHS, PFNA, and DCS) of Fixations.

ArbeitsgemeinschaftfürOsteosynthesefragen (AO) classification is the most frequently used tool to classify intertrochanteric fractures. However, there is limited evidence regarding its reliability. Therefore, this study was designed to evaluate inter-observer and intra-observer reliability of the AO-2018 intertrochanteric fracture classification. A retrospective study was conducted in Imam Khomeini Hospital Complex, on radiography of patients who came with intertrochanteric fractures from March 21, 2018, to March 19, 2019. Four orthopedic trauma surgeons assessed 96 anteroposterior pelvic radiographs of intertrochanteric fractures and classified using an AO intertrochanteric fracture classification of 2018. The reading and review of radiography were performed in 2 separate occasions in a 1-month interval. The inter-observer and intra-observer reliability was assessed using kappa statistics. The level of both mean inter-observer (K =0.322; 95%CI: 0.321-0.323) and intra-observer agreement (K =0.317; 95%CI: 0.314-0.320) in AO intertrochanteric fracture classification subgrouping were not satisfactory. The inter-observer (K =0.61; 95%CI: 0.608-0.611) and intra-observers' (K=0.560; 95%CI: 0.544-0.566) reliability in AO main groupings showed moderate agreement. The AO classification does not show adequate and acceptable inter-observer and intra-observer reliability and reproducibility. Therefore, it will be hard to base on the AO classification for treatment protocols.

Applicability of 3.0T MRI images in the estimation of full age based on shoulder joint ossification: Single-centre study.

Skeletal maturity is evaluated by many radiological methods for forensic age estimation. Direct radiography and computed tomography lead to a rise in ethical concerns due to radiation exposure. Therefore, magnetic resonance imaging (MRI) has currently been used in recent studies. In this study, the ossification stage of the shoulder joint was determined retrospectively in 178 male and 109 female individuals in the age group 12 to 30years using 3.0T MRI. All the images were evaluated with T1-weighted turbo spin echo (T1 TSE) sequence and T1 fast low angle shot two-dimensional sequence (T1 FL2D). The combined staging method, which was defined by Kellinghaus et al. and Schmeling et al., was used. The intra- and inter-observer agreement levels were very good (κ and κw). There were no significant age differences between males and females in all stages. In most of the stages, the ossification of the proximal humeral epiphyses occurred earlier in females than in males. Stage 4 did not occur in either of the sexes before the 18th birthday as the youngest patients in this stage was at 19 and 18years of age in males and females, respectively. We concluded that evaluating the ossification of the proximal humeral epiphysis with MRI imaging for forensic age estimation may be beneficial. Evaluating the same anatomical structure with different MRI sequences may be useful for accurate staging diagnosis.

Exploring the Inter-observer Agreement Among the Members of the Italian Consensus for the Classification and Reporting of Thyroid Cytology.

Classification schemes for reporting thyroid cytology of fine needle aspiration (FNA) of thyroid nodules are largely used in clinical practice, but the level of inter-observer agreement among cytopathologists is poorly acknowledged. The present study aimed to explore the inter-observer agreement among the experienced authors of the 2014 Italian Consensus for Classification and Reporting of Thyroid Cytology (ICCRTC). A stratified randomization was performed in order to obtain a sample homogeneously distributed and representative of all ICCRTC classes. Four high-experience raters were randomly selected among the extensors of the Italian consensus. They independently reviewed 60 FNA samples blindly of the initial cytological report and clinical features. Their overall agreement was evaluated according to Fleiss' kappa. The overall inter-observer agreement was moderate (κ 0.46). Specifically, a good agreement was found when the samples were consistent for malignancy (TIR5) or were not adequate for diagnosis (TIR1) (κ 0.67 and κ 0.73, respectively). A moderate agreement was present for suspicious-for-malignant category (TIR4), and a fair agreement was recorded in the two intermediate ones (TIR3A and TIR3B) (κ 0.36 and κ 0.35, respectively). For clinical purposes, the agreement was good (κ 0.74) in differentiating cases with surgical indication (TIR4/TIR5) from those in which surgery is not essential or requires limited extension (TIR3B/TIR3A/TIR2). In conclusion, the present study confirms the reliability of ICCRTC. These data represent a reference for cytopathologists using this system and are useful for the practice of clinicians and surgeons.

P0093IMPROVED INTEROBSERVER AGREEMENT IN BANFF SCORING OF RENAL ALLOGRAFT BIOPSIES WHEN ROUTINELY USING CD3/PAS STAIN

Abstract Background and Aims The BANFF Classification of renal allograft rejection consists of scores for cellular and antibody mediated rejection. The scores for tubulitis (t), interstitial inflammation (i), glomerulitis (g), total inflammation (ti), and endotheliatis (v) have direct prognostic and therapeutic significance as they contribute to a diagnosis of renal allograft rejection. The original BANFF scoring was developed using hematoxylin and eosin (H&amp;E) stain only. This study examines the level of interobserver agreement using H&amp;E and a combination CD3/PAS stain that highlights T lymphocytes and basement membranes. Method 50 consecutive renal allograft biopsies were retrieved and on each case H&amp;E and CD3/PAS stains (Ventana/Roche Tissue Diagnostics clone 2GV6 for CD3) were performed. CD3/PAS and H&amp;E slides were matched and blinded for two reviewers [reviewer (R1) and reviewer 2 (R2)]. Each case was graded in an identical manner following criteria designated for (t),(i),(g) and (ti) as previously described in the Banff Classification for Renal Allograft Biopsies. Cases were not graded for (v) as there were too few cases with endothelialitis to allow for statistical evaluation. The matched scores were analyzed using weighted Kappa statistics for interobserver agreement within each group. Agreement levels were characterized using Landis and Koch descriptions for level of agreement. All p values were two-tailed, values of &amp;lt;0.05 were considered statistically significant. Statistical analyses was performed using SAS Version 9.4, Cary NC. Results Mean age was 44 years with a range of 9 -75 years. Standard deviation (SD) for age was 18 years. Gender distribution was 20% female and 80% male. Agreement between R1 and R2 for (t) scores was moderate (Weighted Kappa 0.5276) as opposed to fair for H&amp;E group (Weighted Kappa 0.4189). Similarly, interobserver agreement was moderate for scores of (i) and (ti) in the CD3/PAS group and fair in the H&amp;E group. For both CD3/PAS and H&amp;E interrater evaluations, agreement was fair to poor for (g) with weighted Kappa of 0.3928 and 0.3559 respectively. Conclusion This study showed increased levels of interobserver agreement when using a CD3/PAS combination stain to score allograft biopsies for (t), (i) and (ti). Since (t), (i) and (ti) scores directly affect a diagnosis of rejection, we propose routine use of CD3/PAS in addition to H&amp;E when reviewing renal allograft biopsies. Glomerulitis (g) shows poor interobserver agreement regardless of the stain used and further studies to refine the criteria for (g) in Banff revisions of the classification may be of value.

Ultrasound assessment of diaphragmatic function in type 1 spinal muscular atrophy

To investigate ultrasound features of diaphragm motion and function in type 1 spinal muscular atrophy (SMA-1) patients. Prospective study. The study cohort included SMA-1 children younger than 18-year-old. Control subjects included type 2 and type 3 SMA and other neuromuscular disorders younger than 18-year-old. Diaphragm ultrasound evaluating diaphragmatic excursion, speed of diaphragmatic contraction, duration of the respiratory cycle, inspiratory/expiratory relationship, end-inspiratory and -expiratory thickness, thickening fraction, and pattern of contractility. The interrater reliability for each variable was established by calculation of Cohen's k coefficient. Twenty-three SMA-1 patients and 12 controls were evaluated. Diaphragm ultrasound values were within normal ranges in all study cohort patients and no difference was found with controls. There was a gradient of diaphragm function with SMA 1.9 subgroup having the best and SMA 1.1 having the worst parameters, particularly in end-inspiratory thickness and diaphragmatic excursion (P = .031 and P = .041, respectively). Seventy-four percent of SMA-1 patients had a dysmotility pattern of diaphragm contraction, mostly represented in SMA 1.9 subgroup (P = .001). This pattern was observed in 92.8% of children on noninvasive ventilation (NIV) for less than 16 hours/d of and in 20% patients with invasive ventilation or NIV for more than 16 hours/d (P = .027). The dysmotility pattern was never observed in the control group. The levels of interobserver agreement were high for "diaphragm irregularities," "inspiratory/expiratory relationship," and "diaphragm thickness," and good for the other variables. Ultrasound can be used to evaluate diaphragm function and contractility in SMA-1 children, providing additional information to the clinical examination and functional respiratory tests, describing a characteristic contractility pattern in these patients. Longitudinal studies are needed to understand the impact of diaphragm dysmotility and other parameters on long-term outcome in SMA-1 patients.

The Surgical Management of External Cervical Resorption: A Retrospective Observational Study of Treatment Outcomes and Classifications

IntroductionThe aims of this study were to assess the survival and clinical success of patients with teeth with external cervical resorption (ECR) who underwent surgical repair, to assess the reliability of using 2 different classification systems for ECR (Heithersay 2-dimensional classification and Patel 3-dimensional classification), and to identify if a 3-dimensional classification is a viable alternative. MethodsA retrospective study was performed in a teaching dental hospital in England. The inclusion criteria were limited to patients who underwent surgical management of ECR between 2015 and 2018. Both periapical radiographs and cone-beam computed tomographic scans of 13 patients were assessed by 2 independent dental practitioners using the Heithersay and Patel classifications. The same radiographic assessment of those records was then repeated 3 weeks later by 1 operator. These data were tested using the Cohen kappa analysis to determine inter- and intraobserver agreement. ResultsA total of 14 teeth affected with ECR were identified in 13 patients (6 women and 7 men) with a mean age of 41 years. The mean follow-up was 20 months. At follow-up, survival was noted in all cases; however, clinical success describing endodontic success, comprehensive restorative integrity, and arrest of the resorptive process was only met in 11 cases. Although helpful in describing the lesions, both classification systems displayed considerable limitations in predicting treatment outcome. A measure of Cohen kappa regarding interobserver reliability found the Heithersay classification to provide a moderate level of agreement (0.69), whereas the Patel classification provided a weak level of agreement (0.40). ConclusionsECR is a complex, aggressive, and uncommon form of external resorption. The long-term success of the treatment is predictable but strictly related to careful case selection and operative skill. In reference to ECR classifications, ambiguity still exists between their distinctive categories, leading to moderate and weak levels of interobserver agreement. Further improvement is required to enhance their use in future research.

Inter- and Intraobserver Agreement in the Assessment of Thyroid Nodule Ultrasound Features and Classification Systems: A Blinded Multicenter Study.

Background: Single-center trials demonstrated moderate-substantial level of interobserver agreement in the evaluation of ultrasound (US) features of thyroid nodules. Multicenter studies on US agreement, however, are scanty, and data on intraobserver agreement are poor. Aim of the study was to assess inter- and intraobserver agreement between different thyroid centers and different specialists. Methods: A blinded analysis of 100 electronically recorded thyroid nodule US images was conducted in three large-volume thyroid centers by seven radiologists and endocrinologists. The evaluation was repeated after randomization 4 months later. The following US characteristics were evaluated: composition, echogenicity, margins, intranodular echogenic spots, vascularity, and shape. Thyroid nodules were also classified according to AACE/ACE/AME, EU-TIRADS, ATA, and ACR-TIRADS US classifications. Intra- and interobserver agreement was calculated using cross-tabulation expressed as mean Cohen's Kappa. Results: Interobserver agreement for US features: K-coefficient was 0.53 for composition, 0.47 for echogenicity, 0.46 for intranodular vascularity, and 0.33 for margins of the nodules. For echogenic foci, the K-coefficient was 0.47 for microcalcifications, 0.38 for macrocalcifications, 0.11 for the subcategory comet-tail artifacts, and 0.42 for shape. Operators resulted uncertain on hyperechoic foci definition in 16% of cases and described them as "hyperechoic foci of uncertain significance." Interobserver Cohen-K for US classification systems was 0.44 for AACE, 0.42 for ACR-TIRADS, 0.39 EU-TIRADS, and 0.34 for ATA. Intraobserver agreement: the K-coefficient for nodule US features was 0.62 for intranodular vascularity, 0.58 for composition, 0.60 for echogenicity, 0.54 for macrocalcifications, 0.55 for microcalcifications, 0.47 for comet tails, 0.39 for margins, and 0.35 for shape. Intraobserver Cohen-K for US classification systems was 0.54 for AACE, 0.49 for ACR-TIRADS, 0.38 for ATA, and 0.33 for EU-TIRADS. Conclusions: Intraobserver reproducibility for thyroid nodule US reporting and US classification systems appears fairly adequate, while the interobserver agreement between different centers is lower than that assessed in single-center trials. Reporting and rating ability of thyroid US examiners still appear not consistent. An unified lexicon of thyroid US features, a simplified method of classification, and a dedicated training in the description of thyroid US findings may increase the observers' agreement and the predictive value of US classification systems in real world practice.

Evaluation of Vascular Patterns Using Contact Endoscopy and Narrow-Band Imaging (CE-NBI) for the Diagnosis of Vocal Fold Malignancy.

The endoscopic detection of perpendicular vascular changes (PVC) of the vocal folds has been associated with vocal fold cancer, dysplastic lesions, and papillomatosis, according to a classification proposed by the European Laryngological Society (ELS). The combination of contact endoscopy with narrow-band imaging (NBI-CE) allows intraoperatively a highly contrasted, real-time visualization of vascular changes of the vocal folds. Aim of the present study was to determine the association of PVC to specific histological diagnoses, the level of interobserver agreement in the detection of PVC, and their diagnostic effectiveness in diagnosing laryngeal malignancy. The evaluation of our data confirmed the association of PVC to vocal fold cancer, dysplastic lesions, and papillomatosis. The level of agreement between the observers in the identification of PVC was moderate for the less-experienced observers and almost perfect for the experienced observers. The identification of PVC during NBI-CE proved to be a valuable indicator for diagnosing malignant and premalignant lesions.

P156 Interobserver variation of visual assessment vs. measuring ulcer size in Crohn’s disease using the RAPID9 Software in PillCam COLON2

Abstract Background Ulcer size is important when assessing mucosal healing in Crohn’s disease (CD) and commonly assessed with visual estimation. There is a new built-in measurement tool in the RAPID9 reader software used in colon capsule endoscopy (CCE). We aimed to assess the agreement between visually estimating ulcer size vs. using the estimation tool and the interobserver agreement for both methods independently using PillCam Colon studies in patients with Crohn’s disease. Methods 7 experts of PillCam readers were recruited to assess CCE in this study. 7 CCE recordings were thumbnailed for the presence of ulcers. A total of 43 ulcers were consecutively selected for this study. The readers were provided with an instruction manual which specified that they were to first visually estimate the ulcer and then subsequently measure the ulcer with the size estimation tool in RAPID9 software. Two measurements were taken, A – longest distance of the ulcer end to end, and B – longest distance that is perpendicular to A. Results were analysed using Kendall’s Coefficient of Concordance (Kendall’s W). Results When comparing visual assessment of ulcer size vs. using the estimation tool, both measurements A and B demonstrated statistically significant agreement (p of A = 0.000, p of B = 0.000; W of A=0.90, W of B=0.82). For measurement A, our results demonstrated higher interobserver agreement when assessing ulcer size using the estimation tool (W=0.84) as compared with visually assessing ulcer size (W=0.80). This contrasts with measurement B where there was higher interobserver agreement when visually assessing ulcer size (W=0.75) as compared with using the measurement tool (W=0.73). Nevertheless, there was no statistically significant variability amongst measurement A nor B (p = 0.000) in visual assessment and measurement tool. Conclusion The conventional visual estimation of ulcer size in CD using CCE was just as accurate as the measurement tool. Furthermore, consistency between readers was demonstrated with the high level of interobserver agreement for the measurement tool and visual estimation. This novel finding is reassuring given the decade of capsule studies done with older software, where a measurement tool was not available. Further study should be conducted to assess and consolidate the validity of the estimation tool in assessing ulceration and mucosal healing in CD with a larger number and variety of lesions studied.

Diffusion weighted imaging improves diagnostic ability of MRI for determining complete response to neoadjuvant therapy in locally advanced rectal cancer

PurposeTo assess the diagnostic performance, interobserver agreement and confidence level for determining response to neoadjuvant chemoradiotherapy (NACRT) using morphology based MR-tumour regression grade (MR TRG), diffusion weighted imaging (DWI) patterns and their combination in patients with locally advanced rectal cancer. MethodsThis was a retrospective study including patients with locally advanced rectal cancer treated with NACRT and subsequent surgery. Two independent radiologists blinded to the histopathology reviewed staging and restaging MRI. Diagnostic performance of morphology based MR-TRG, DWI patterns and their combination for determining complete (CR) and incomplete (IR) response was assessed with pathological response as the reference. Likert’s scale was used to assess the radiologist’s level of confidence. Interobserver agreement was determined using Kappa statistics. ResultsThe study included 251 patients (mean age of 47.9+/-14 (range 19–86) years, M:F = 164:87). Rate of pathological CR was 14.7 % (n = 37). Pattern based interpretation of DWI and combined approach (DWI + T2-HR) had superior diagnostic performance than morphology based assessment alone with area under curve (AUC) for T2HR, DWI and their combination being 0.531, 0.887, 0.874 respectively for observer 1 and 0.558, 0.653, 0.678 respectively for observer 2, p < 0.001. Interobserver agreement was substantial (k = 0.688) for combined approach, moderate (k = 0.402) for DWI patterns and fair (k = 0.265) for T2 HR MRI with both observers exhibiting highest level of confidence for determining response with the combined approach. ConclusionComplete response to neoadjuvant chemoradiotherapy can be determined with excellent accuracy, substantial interobserver agreement and high level of confidence by combined interpretation of DWI and T2 high resolution MRI.