First-order Agreement Coefficient Research Articles

Intergrader Agreement in Grading Optical Coherence Tomography Morphologic Features in Eyes With Intermediate Nonexudative Age-Related Macular Degeneration.

To determine the reliability of a nine-point summary scale for grading intermediate age-related macular degeneration (AMD) image morphologic features based on the Early Treatment Diabetic Retinopathy Study (ETDRS) grid. Two trained graders independently divided spectral domain-optical coherence tomography (SD-OCT) scans into nine subfields and then graded each subfield for the presence of intraretinal hyperreflective foci (HRF), reticular pseudodrusen (RPD), and incomplete or complete retinal pigment epithelium and outer retinal atrophy (iRORA or cRORA). Grading results were assessed by summing the subfield grades into a nine-point summary score and also by using an eye-level binary grade for presence of the finding in any subfield. Gwet's first-order agreement coefficient (AC1) was calculated to assess intergrader agreement. Images of 79 eyes from 52 patients were evaluated. Intergrader agreement was higher when the OCT grades were summarized with a nine-point summary score (Gwet's AC1 0.92, 0.89, 0.99, and 0.99 for HRF, RPD, iRORA, and cRORA, respectively) compared with the eye-level binary grade (Gwet's AC1 0.75, 0.76, 0.97, and 0.96 for HRF, RPD, iRORA, and cRORA, respectively), with significant differences detected for HRF and RPD. The use of a nine-point summary score showed higher reliability in grading when compared to the binary subfield- and eye-level data, and thus may offer more precise estimation of AMD disease staging. These findings suggest that a nine-point summary score could be a useful means of disease staging by using findings on OCT in clinical studies of AMD.

Reliability of point-of-care ultrasound to evaluate fluid tolerance performed by critical care residents

BackgroundPatients with hypotension usually receive intravenous fluids, but only 50% will respond to fluid administration. We aimed to assess the intra and interobserver agreement to evaluate fluid tolerance through diverse ultrasonographic methods.MethodsWe prospectively included critically ill patients on mechanical ventilation. One trained intensivist and two intensive care residents obtained the left ventricular outflow tract velocity–time integral (VTI) variability, inferior vena cava (IVC) distensibility index, internal jugular vein (IJV) distensibility index, and each component of the venous excess ultrasound (VExUS) system. We obtained the intraclass correlation coefficient (ICC) and Gwet’s first-order agreement coefficient (AC1), as appropriate.ResultsWe included 32 patients. In-training observers were unable to assess the VTI-variability in two patients. The interobserver agreement was moderate to evaluate the IJV-distensibility index (AC1 0.54, CI 95% 0.29–0.80), fair to evaluate VTI-variability (AC1 0.39, CI 95% 0.12–0.66), and absent to evaluate the IVC-distensibility index (AC1 0.19, CI 95% − 0.07 to 0.44). To classify patients according to their VExUS grade, the intraobserver agreement was good, and the interobserver agreement was moderate (AC1 0.52, CI 95% 0.34–0.69).ConclusionsPoint-of-care ultrasound is frequently used to support decision-making in fluid management. However, we observed that the VTI variability and IVC-distensibility index might require further training of the ultrasound operators to be clinically useful. Our findings suggest that the IJV-distensibility index and the VExUS system have acceptable reproducibility among in-training observers.

Reticular Pseudodrusen: Interreader Agreement of Evaluation on OCT Imaging in Age-Related Macular Degeneration

PurposeTo determine the interreader agreement for reticular pseudodrusen (RPD) assessment on combined infrared reflectance (IR) and OCT imaging in the early stages of age-related macular degeneration across a range of different criteria to define their presence.DesignInterreader agreement study.ParticipantsTwelve readers from 6 reading centers.MethodsAll readers evaluated 100 eyes from individuals with bilateral large drusen for the following: (1) the presence of RPD across a range of different criteria and (2) the number of Stage 2 or 3 RPD lesions (from 0 to ≥ 5 lesions) on an entire OCT volume scan and on a selected OCT B-scan. Supportive information was available from the corresponding IR image.Main Outcome MeasuresInterreader agreement, as assessed by Gwet’s first-order agreement coefficient (AC1).ResultsWhen evaluating an entire OCT volume scan, there was substantial interreader agreement for the presence of any RPD, any or ≥ 5 Stage 2 or 3 lesions, and ≥ 5 definite lesions on en face IR images corresponding to Stage 2 or 3 lesions (AC1 = 0.60–0.72). On selected OCT B-scans, there was also moderate-to-substantial agreement for the presence of any RPD, any or ≥ 5 Stage 2 or 3 lesions (AC1 = 0.58–0.65) and increasing levels of agreement with increasing RPD stage (AC1 = 0.08, 0.56, 0.78, and 0.99 for the presence of any Stage 1, 2, 3, and 4 lesions, respectively). There was substantial agreement regarding the number of Stage 2 or 3 lesions on an entire OCT volume scan (AC1 = 0.68), but only fair agreement for this evaluation on selected B-scans (AC1 = 0.30).ConclusionsThere was generally substantial or near-substantial—but not near-perfect—agreement for assessing the presence of RPD on entire OCT volume scans or selected B-scans across a range of differing RPD criteria. These findings underscore how interreader variability would likely contribute to the variability of findings related to the clinical associations of RPD. The low levels of agreement for assessing RPD number on OCT B-scans underscore the likely challenges of quantifying RPD extent with manual grading.Financial Disclosure(s)Proprietary or commercial disclosure may be found after the references. To determine the interreader agreement for reticular pseudodrusen (RPD) assessment on combined infrared reflectance (IR) and OCT imaging in the early stages of age-related macular degeneration across a range of different criteria to define their presence. Interreader agreement study. Twelve readers from 6 reading centers. All readers evaluated 100 eyes from individuals with bilateral large drusen for the following: (1) the presence of RPD across a range of different criteria and (2) the number of Stage 2 or 3 RPD lesions (from 0 to ≥ 5 lesions) on an entire OCT volume scan and on a selected OCT B-scan. Supportive information was available from the corresponding IR image. Interreader agreement, as assessed by Gwet’s first-order agreement coefficient (AC1). When evaluating an entire OCT volume scan, there was substantial interreader agreement for the presence of any RPD, any or ≥ 5 Stage 2 or 3 lesions, and ≥ 5 definite lesions on en face IR images corresponding to Stage 2 or 3 lesions (AC1 = 0.60–0.72). On selected OCT B-scans, there was also moderate-to-substantial agreement for the presence of any RPD, any or ≥ 5 Stage 2 or 3 lesions (AC1 = 0.58–0.65) and increasing levels of agreement with increasing RPD stage (AC1 = 0.08, 0.56, 0.78, and 0.99 for the presence of any Stage 1, 2, 3, and 4 lesions, respectively). There was substantial agreement regarding the number of Stage 2 or 3 lesions on an entire OCT volume scan (AC1 = 0.68), but only fair agreement for this evaluation on selected B-scans (AC1 = 0.30). There was generally substantial or near-substantial—but not near-perfect—agreement for assessing the presence of RPD on entire OCT volume scans or selected B-scans across a range of differing RPD criteria. These findings underscore how interreader variability would likely contribute to the variability of findings related to the clinical associations of RPD. The low levels of agreement for assessing RPD number on OCT B-scans underscore the likely challenges of quantifying RPD extent with manual grading.

Homogeneity Test of the First-Order Agreement Coefficient in a Stratified Design

Gwet's first-order agreement coefficient (AC1) is widely used to assess the agreement between raters. This paper proposes several asymptotic statistics for a homogeneity test of stratified AC1 in large sample sizes. These statistics may have unsatisfactory performance, especially for small samples and a high value of AC1. Furthermore, we propose three exact methods for small pieces. A likelihood ratio statistic is recommended in large sample sizes based on the numerical results. The exact E approaches under likelihood ratio and score statistics are more robust in the case of small sample scenarios. Moreover, the exact E method is effective to a high value of AC1. We apply two real examples to illustrate the proposed methods.

Computerized Version of the Kiddie Schedule for Affective Disorders and Schizophrenia for School-Age Children (KSADS-COMP): Development and Validation of the Korean Clinician-Administered Version.

The purpose of the present study was to develop and validate the Korean version of the clinician-administered KSADSCOMP, which is the recently updated, web-based computerized version of the Kiddie Schedule for Affective Disorders and Schizophrenia for school-age children (KSADS). A total of 71 participants (mean age=12.04±3.86 years, female=29.57%) participated in the study. A child-adolescent psychiatrist established a diagnosis for the participant after a thorough psychiatric interview with the participant and the parent. Researchers who were blind to the diagnoses administered the clinician-administered KSADS-COMP to the parents and participants. The gold-standard diagnoses made by child-adolescent psychiatrists were compared to the current diagnoses generated by the clinician-administered KSADS-COMP. Percent agreement, Cohen's Kappa, Gwet's first-order agreement coefficient (AC1), sensitivity, specificity, positive predictive value, and negative predictive value were calculated. Gwet's AC1, our preferred measure of agreement, showed excellent range between 0.78 and 1. Sensitivity, specificity, positive predicted value and negative predictive value also showed high scores. The current study demonstrated excellent criterion validity of the Korean version of the clinician-administered KSADSCOMP, though the small sample size could be a limitation. The current study was the first study to examine the criterion validity of the KSADS-COMP. Due to its readily usable format and efficient and accurate diagnostic process, widely-use of KSADS-COMP is expected.

Análise semântica de palavras do Instrumento Virtual de Avaliação da Fala

ABSTRACT Purpose: to carry out the semantic analysis of a list of words that will compose a virtual tool for speech assessment for children and adolescents. Methods: twenty-three participants, aged between 2 years old and 17 years and 11 months old, from the central region of Rio Grande do Sul, Brazil, assigned the concept of 91 words. Data analysis was performed quantitatively, considering the concept of each word as correct or incorrect. Content Validity Ratio (RVC) and Gwet’s first-order agreement coefficient (AC1) statistical calculation were calculated. Results: from the word list analyzed, 42 stimuli presented CVR = 1; 30 words obtained CVR = 0.9; 11 with CVR = 0.8; six with CVR = 0.7; two had CVR = 0.4. Gwet's AC1 statistical calculation resulted in AC1 = 0.92 [CI = 0.90 - 0.94] for semantic analysis. Conclusion: the list consisted of 91 semantically validated words that can be used to assess the speech production of children and adolescents.

Instrument to evaluate the perception of minimal contrasts in Chilean Sign Language - reliability evidence.

Obtain evidence of the test reliability to evaluate the perception of minimum contrasts in Chilean Sign Language (LSCh). Ten deaf children and adolescents aged between 7 and 14 years participated in this study. They were evaluated with the test of perception of minimal contrasts in LSCh. The test was reapplied 11 and 14 days after the first application (test-retest reliability). Spearman's Rho correlation was performed. During the first application, authorization was requested from the parents of the children and adolescents to record the responses of the participants so that another evaluator could re-score the protocols, in order to obtain inter-rater reliability. First-order agreement coefficient (AC1) Gwet's was used for data analysis. Test-retest obtained a strong and significant correlation (Rho= 0.741; p=0.014). The concordance values obtained inter-rater vary between 0.962 and 1 (p<0.001), indicating that the test presents almost perfect concordance. The minimum pairs perception test in LSCh presents satisfactory test-retest and inter-rater reliability.

Instrumento de evaluación de la percepción de los contrastes mínimos en Lengua de Señas Chilena - evidencias de confiabilidad

ABSTRACT Purpose Obtain evidence of the test reliability to evaluate the perception of minimum contrasts in Chilean Sign Language (LSCh). Methods Ten deaf children and adolescents aged between 7 and 14 years participated in this study. They were evaluated with the test of perception of minimal contrasts in LSCh. The test was reapplied 11 and 14 days after the first application (test-retest reliability). Spearman's Rho correlation was performed. During the first application, authorization was requested from the parents of the children and adolescents to record the responses of the participants so that another evaluator could re-score the protocols, in order to obtain inter-rater reliability. First-order agreement coefficient (AC1) Gwet’s was used for data analysis. Results Test-retest obtained a strong and significant correlation (Rho= 0.741; p=0.014). The concordance values obtained inter-rater vary between 0.962 and 1 (p&lt;0.001), indicating that the test presents almost perfect concordance. Conclusion The minimum pairs perception test in LSCh presents satisfactory test-retest and inter-rater reliability.

Assessing the Quality of Vascular Ultrasound Examinations Using the IAC QI Self-Assessment Tool: Inter-Rater and Intra-Rater Agreement Between Vascular Technologists and Interpreting Physicians

Introduction: Vascular laboratories need to improve efficiency while maintaining examination quality. Vascular ultrasound examinations were retrospectively evaluated using the Intersocietal Accreditation Commission (IAC) Quality Improvement (QI) Self-Assessment Tool to evaluate the quality of the examinations and to determine inter-rater and intra-rater agreement between groups of vascular technologists and interpreting physicians. Methods: Vascular technologists and attending interpreting physicians evaluated 100 carotid Doppler and 100 lower extremity venous Doppler examinations utilizing the IAC QI Self-Assessment Tool. Gwet’s First-Order Agreement Coefficient (AC1) statistic and 95% confidence intervals were calculated to determine both inter-rater and intra-rater agreement. Results: The inter-rater agreement for 91% of all questions ranged from substantial (AC1 = 0.6) to almost perfect (AC1 = 1) for both examination types across all reviewers. Agreement on 2 questions was suboptimal: specifically, the technical quality section for the vascular technologists showed slight agreement for carotid Doppler and venous Doppler examinations (AC1 = 0.108 and 0.087, respectively), and the case review section for the interpreting physicians showed poor agreement for carotid Doppler examinations (AC1 = –0.087) and fair agreement for venous Doppler examinations (AC1 = 0.329). The intra-rater agreement among the interpreting physicians for both examinations was in the almost perfect range (Carotid AC1 = 0.875-1; Venous AC1 = 0.871-1). The intra-rater agreement among the vascular technologists for both examinations ranged from slight to almost perfect (Carotid AC1 = 0.191-1; Venous AC1 = 0.155-1). Conclusion: Substantial to almost perfect agreement among all reviewers was observed for most of the quality review questions. The IAC QI Self-Assessment Tool aided in identifying areas for improvement in vascular studies and the comments captured in the technical quality section of the tool were instrumental in establishing areas for quality improvement.

Validity of vision screening program conducted by preschool teachers: An interventional study.

Clear vision is crucial for effective learning among preschool children. Hence, early detection of vision impairment and prompt treatment are required to improve prognosis. Currently, limited information is available, and no program exists to screen for vision impairment among preschoolers in Bangladesh. This study aimed to validate the KieVision™ Preschool Vision Screening Kit, translated into the Bengali language, to improve vision impairment detection among preschool children. In this prospective case-control study, 60 preschool teachers from Chittagong were randomly selected. The study group was trained to conduct vision screening among preschool children using the translated kit, whereas the control group was trained using the Chittagong Eye Infirmary and Training Complex (CEITC) School Teachers' Training Module. Fifteen preschool children aged 4-6 years were screened by each preschool teacher and again by the optometrist. Sixty preschool teachers screened 900 children. The results showed a higher validity of vision screening findings by the preschool teachers in the study group (sensitivity, 68.00%; specificity, 92.75%) than in the control group (sensitivity 47.37%, specificity 70.39%). The level of agreement between the preschool teachers and optometrists was high for all tests (first-order agreement coefficient [AC1] ≥ 0.80 in the study group). The sensitivity and specificity of the visual acuity test for the study group were 59.65% and 94.15%, respectively, while in the control group it was 13.33% and 62.54%, respectively. A similar trend was noted in the general observation component and Hirschberg's test. The Bengali Language KieVision™ Preschool Vision Screening Kit can be used effectively by preschool teachers in vision screening programs to improve the identification of vision impairment among preschool children in Bangladesh.

Diagnosing Persistent Hypertransmission Defects on En Face OCT Imaging of Age-Related Macular Degeneration

A training exercise was performed to study the ability of graders to reliably identify precursor lesions to geographic atrophy (GA), known as persistent choroidal hypertransmission defects (hyperTDs), using en face OCT images from eyes with nonexudative age-related macular degeneration (AMD). Intergrader agreement study. Eleven graders participated in this exercise. Formal training on how to identify persistent hyperTDs on en face OCT images was provided to the graders. A persistent hyperTD was defined as a bright lesion having a greatest linear dimension (GLD) of at least 250 μm. Training consisted of a tutorial session followed by the grading of 3 pretest exercises, each consisting of 3 cases. After all graders scored 100% on the pretest exercises, they performed a final exercise consisting of 30 en face OCT images from 29 eyes with nonexudative AMD containing 107 hyperTDs that each grader needed to evaluate. The cases contained a variety of AMD-related atrophic lesions. The sensitivity, positive predictive value (PPV), and modified accuracy were assessed for each grader. A total of 1177 hyperTDs from 30 en face OCT images were reviewed by the graders. The mean sensitivity, PPV, and modified accuracy for all the graders were calculated to be 99.0%, 99.2%, and 98.2%, respectively. There was a 97% agreement observed between all the graders (first-order agreement coefficient [AC1]= 0.97). Internal graders from the Bascom Palmer Eye Institute had a slightly higher agreement compared with the external graders (AC1= 0.98 vs. AC1= 0.96). The hyperTDs most often incorrectly identified included the following features: (1) hyperTDs containing hypotransmission defect cores, (2) single hyperTDs that were incorrectly graded as 2 separate lesions, and (3) hyperTDs with borderline GLDs that were close to 250 μm. The accurate detection of persistent hyperTDs on en face OCT images by graders demonstrates the feasibility of using this OCT biomarker to identify disease progression in eyes with nonexudative AMD, especially when used as a clinical trial end point in studies designed to test new therapies that may slow disease progression from intermediate AMD to GA.

Diagnostic Performance of an App-Based Symptom Checker in Mental Disorders: Comparative Study in Psychotherapy Outpatients.

BackgroundDigital technologies have become a common starting point for health-related information-seeking. Web- or app-based symptom checkers aim to provide rapid and accurate condition suggestions and triage advice but have not yet been investigated for mental disorders in routine health care settings.ObjectiveThis study aims to test the diagnostic performance of a widely available symptom checker in the context of formal diagnosis of mental disorders when compared with therapists’ diagnoses based on structured clinical interviews.MethodsAdult patients from an outpatient psychotherapy clinic used the app-based symptom checker Ada–check your health (ADA; Ada Health GmbH) at intake. Accuracy was assessed as the agreement of the first and 1 of the first 5 condition suggestions of ADA with at least one of the interview-based therapist diagnoses. In addition, sensitivity, specificity, and interrater reliabilities (Gwet first-order agreement coefficient [AC1]) were calculated for the 3 most prevalent disorder categories. Self-reported usability (assessed using the System Usability Scale) and acceptance of ADA (assessed using an adapted feedback questionnaire) were evaluated.ResultsA total of 49 patients (30/49, 61% women; mean age 33.41, SD 12.79 years) were included in this study. Across all patients, the interview-based diagnoses matched ADA’s first condition suggestion in 51% (25/49; 95% CI 37.5-64.4) of cases and 1 of the first 5 condition suggestions in 69% (34/49; 95% CI 55.4-80.6) of cases. Within the main disorder categories, the accuracy of ADA’s first condition suggestion was 0.82 for somatoform and associated disorders, 0.65 for affective disorders, and 0.53 for anxiety disorders. Interrater reliabilities ranged from low (AC1=0.15 for anxiety disorders) to good (AC1=0.76 for somatoform and associated disorders). The usability of ADA was rated as high in the System Usability Scale (mean 81.51, SD 11.82, score range 0-100). Approximately 71% (35/49) of participants would have preferred a face-to-face over an app-based diagnostic.ConclusionsOverall, our findings suggest that a widely available symptom checker used in the formal diagnosis of mental disorders could provide clinicians with a list of condition suggestions with moderate-to-good accuracy. However, diagnostic performance was heterogeneous between disorder categories and included low interrater reliability. Although symptom checkers have some potential to complement the diagnostic process as a screening tool, the diagnostic performance should be tested in larger samples and in comparison with further diagnostic instruments.

High-resolution three\u2011dimensional contrast\u2011enhanced magnetic resonance venography in children: comparison of gadofosveset trisodium with ferumoxytol

BackgroundGadofosveset is a gadolinium-based blood pool contrast agent that was approved by the United States Food and Drug Administration in 2008. Its unanticipated withdrawal from production in 2016 created a void in the blood pool agent inventory and highlighted the need for an alternative agent with comparable imaging properties.ObjectiveThe purpose of our study is to compare the diagnostic image quality, vascular contrast-to-noise ratio (CNR) and temporal signal characteristics of gadofosveset trisodium and ferumoxytol at similar molar doses for high-resolution, three-dimensional (3-D) magnetic resonance (MR) venography in children.Materials and methodsThe medical records and imaging data sets of patients who underwent high-resolution 3-D gadofosveset-enhanced MR venography (GE-MRV) or ferumoxytol-enhanced MR venography (FE-MRV) were retrospectively reviewed. Two groups of 20 pediatric patients (age- and weight-matched with one patient common to both groups; age range: 2 days–15 years) who underwent high-resolution 3-D GE-MRV or FE-MRV at similar molar doses were identified and analyzed. Qualitative analysis of image quality and vessel definition was performed by two blinded pediatric radiologists. Interobserver agreement was assessed with the AC1 (first-order agreement coefficient) statistic. Signal-to-noise ratio (SNR) and CNR of the inferior vena cava and aorta were measured in the steady-state venous phase. Medical records were retrospectively reviewed for any adverse reactions associated with either contrast agent.ResultsMeasured SNR and CNR of the inferior vena cava were higher for FE-MRV than GE-MRV (P = 0.034 and P < 0.001, respectively). The overall image quality score and individual vessel scores of FE-MRV were equal to or greater than GE-MRV (P = 0.084), with good interobserver agreement (AC1 = 0.657). The venous signal on FE-MRV was stable over the longest interval measured (1 h, 13 min and 46 s), whereas venous signal on GE-MRV showed more variability and earlier loss of signal. No adverse reactions were noted in any patient with either contrast agent.ConclusionFerumoxytol produces more uniform and stable enhancement throughout the entire venous circulation in children than gadofosveset, offering a wider time window for optimal image acquisition. FE-MRV offers a near-ideal approach to high-resolution venography in children at all levels of anatomical complexity.

Prevalence of intestinal parasites in dogs in southern Ontario, Canada, based on fecal samples tested using sucrose double centrifugation and Fecal Dx® tests.

In southern Ontario, Canada, there is a lack of information concerning the prevalence of intestinal parasites in dogs. As such, this study aimed to characterize the prevalence of intestinal parasites in dogs visiting off-leash parks in the region using sucrose double centrifugation and Fecal Dx® tests. Additionally, data obtained via the sucrose double centrifugation method were used to evaluate the performance of the Fecal Dx® tests. Fecal samples were collected from 466 dogs aged ≥6months from May to November 2018 (mean age=3.7years). Overall, eleven intestinal parasites were identified using sucrose double centrifugation. Roundworm eggs (Toxocara canis and Baylisascaris procyonis), hookworm eggs (Ancylostoma caninum and Uncinaria stenocephala), and whipworm eggs (Trichuris vulpis) were identified in 1.07% (95% confidence interval [CI] 0.38-2.56%), 5.79% (95% CI 3.85-8.31%), and 5.15% (95% CI 3.33-7.57) of samples, respectively. Using the Fecal Dx® tests, 1.07% (95% CI 0.38-2.56%), 4.29% (95% CI 2.64-6.55%), and 2.15% (95% CI 1.03-3.91) of the samples tested positive for roundworm, hookworm, and whipworm antigen, respectively. To assess the level of agreement between the Fecal Dx® tests and sucrose double centrifugation, three methods were used. Cohen's kappa indicated a fair-to-moderate level of agreement between Fecal Dx® tests and sucrose double centrifugation. In contrast, the prevalence-adjusted bias-adjusted kappa and Gwet's first-order agreement coefficient indicated almost perfect agreement between these tests, ranging from 0.87 to 0.99 among the parasites examined. This study provides valuable information on the prevalence of intestinal parasites in mature dogs in southern Ontario that will help guide parasite control recommendations for dogs in this region.

Evaluation of the Third edition of the City University Colour Vision Test.

The 3rd edition of the City University Colour Vision Test (CUT) was originally based on the Farnsworth-Munsell D-15 test (D15). The first part of the test is for detecting a defect, and the second part is used to diagnose the type and severity of the defect. This study evaluates the CUT 3rd edition relative to the Ishihara and the D15 colour vision tests. Fifty nine colour vision normal subjects and 60subjects with a congenital red-green colour vision defect were recruited. Subjects were tested with the Ishihara and CUT tests. Subjects who failed the Ishihara also performed the D15 test. The agreement between the Ishihara and CUT screening plates was marginally higher when using the CUT failure criterion of >1 error compared with using >2 errors. If the diagnostic plates were included with the screening plates in determining the pass/fail outcomes, the agreement between the Ishihara and CUT was high, with a first-order agreement coefficient (AC1) of 0.90. The AC1 coefficient agreement between the D15 and CUT diagnostic plates in terms of pass/fail was 0.81 when using the D15 failure criteria of >1 or >0 crossing. The level of agreement between the 3rd edition of the CUT and D15 was lower than the 2nd edition of the CUT. The primary reason for the lower agreement of the 3rd edition of the CUT was that it had a lower specificity relative to the D15 compared to the 2nd edition. Although the CUT predictive value for failing the D15 is over 90%, the predictive value for passing shows that 19%-25% of patients who pass the 3rd edition of the CUT test will fail the D15. The 3rd edition tends to misclassify protans as deutans or cannot classify the type of defect relative to the D15 and Ishihara.

Magnetic resonance imaging in diagnosis of indeterminate breast (BIRADS 3 & 4A) in a general population

ObjectiveCurrently, mammography and ultrasonography are the most used imaging techniques for breast cancer screening. However, these examinations report many indeterminate studies with a low probability of being malignant, i.e., BIRADS 3 and 4A. This prospective study aims to evaluate the value of breast magnetic resonance imaging (MRI) to clarify the BIRADS categorization of indeterminate mammography or ultrasonography studies.MethodsMRI studies acquired prospectively from 105 patients previously classified as BIRADS 3 or 4A were analyzed independently by four radiologists with different experience levels. Interobserver agreement was determined by the first-order agreement coefficient (AC1), and divergent results were re-analyzed for consensus. The possible correlation between the MRI and the mammography/ultrasound findings was evaluated, and each study was independently classified in one of the five BIRADS categories (BIRADS 1 to 5). In lesions categorized as BIRADS 4 or 5 at MRI, histopathological diagnosis was established by image-guided biopsy; while short-term follow-up was performed in lesions rated as BIRADS 3.ResultsBreast MRI was useful in diagnosing three invasive ductal carcinomas, upgraded from BIRADS 4A to BIRADS 5. It also allowed excluding malignancy in 86 patients (81.9%), avoiding 22 unnecessary biopsies and 64 short-term follow-ups. The MRI showed good diagnostic performance with the area under roc curve, sensitivity, specificity, PPV, and NPV of 0.995, 100%, 83.5%, 10.5%, and 100%, respectively.ConclusionsMRI showed to be useful as a problem-solving tool to clarify indeterminate findings in breast cancer screening and avoiding unnecessary short-follow-ups and percutaneous biopsies.

The ROBINS-I and the NOS had similar reliability but differed in applicability: A random sampling observational studies of systematic reviews/meta-analysis.

There is a lack of evidence on the usage of the quality assessment tool-the Risk Of Bias In Nonrandomized Studies-of Interventions (ROBINS-I). This article aimed to measure the reliability, criterion validity, and feasibility of the ROBINS-I and the Newcastle-Ottawa Scale (NOS). A sample of systematic reviews or meta-analyses of observational studies were selected from Medline (2013-2017) and assessed by two reviewers using ROBINS-I and the NOS. We reported on reliability in terms of the first-order agreement coefficient (AC1) statistic. Correlation coefficient statistic was used to explore the criterion validity of the ROBINS-I. We compared the feasibility of the ROBINS-I and NOS by recording the time to complete an assessment and the instances where assessing was difficult. Five systematic reviews containing 41 cohort studies were finally included. Interobserver agreement on the individual domain of the ROBINS-I as well as the NOS was substantial with a mean AC1 statistic of 0.67 (95% CI: 0.50-0.83) and 0.73 (95% CI: 0.65-0.81), respectively. The criterion validity of the ROBNS-I was moderate (K=0.52) against NOS. The time in assessing a single study by ROBINS-I varied from 7hours initially to 3hours compared with 30 minutes for the NOS. Both reviewers rated "bias due to departure from the intended interventions" the most time-consuming domain in the ROBINS-I, items in the NOS were equal. The ROBINS-I and the NOS seem to provide the same reliability but vary in applicability. The over-complicated feature of ROBINS-I may limit its usage and a simplified version is needed.

OCT Signs of Early Atrophy in Age-Related Macular Degeneration: Interreader Agreement: Classification of Atrophy Meetings Report 6

To determine the interreader agreement for incomplete retinal pigment epithelium (RPE) and outer retinal atrophy (iRORA) and complete RPE and outer retinal atrophy (cRORA) and their related features in age-related macular degeneration (AMD). Interreader agreement study. Twelve readers from 6 reading centers. After formal training, readers qualitatively assessed 60 OCT B-scans from 60 eyes with AMD for 9 individual features associated with early atrophy and performed 7 different annotations to quantify the spatial extent of OCT features within regions of interest. The qualitative and quantitative features were used to derive the presence of iRORA and cRORA and also in an exploratory analysis to examine if agreement could be improved using different combinations of features to define OCT atrophy. Interreader agreement based on Gwet's first-order agreement coefficient (AC1) for qualitatively graded OCT features and classification of iRORA and cRORA, and smallest real difference (SRD) for quantitatively graded OCT features. Substantial or better interreader agreement was observed for all qualitatively graded OCT features associated with atrophy (AC1= 0.63-0.87), except for RPE attenuation (AC1= 0.46) and disruption (AC1= 0.26). The lowest SRD for the quantitatively graded horizontal features was observed for the zone of choroidal hypertransmission (± 190.8 μm). Moderate agreement was found for a 3-category classification of no atrophy, iRORA, and cRORA (AC1= 0.53). Exploratory analyses suggested a significantly higher level of agreement for a 3-category classification using (1) no atrophy; (2) presence of inner nuclear layer and outer plexiform layer subsidence, or a hyporeflective wedge-shaped band, as a less severe atrophic grade; and (3) the latter plus an additional requirement of choroidal hypertransmission of 250 μm or more for a more severe atrophic grade (AC1= 0.68; P= 0.013). Assessment of iRORA and cRORA, and most of their associated features, can be performed relatively consistently and robustly. A refined combination of features to define early atrophy could further improve interreader agreement.

Blended learning program for the development of skills in the aspiration of artificial airways.

Objective:to develop and validate a blended learning program, of the inverted classroom type, on the aspiration of artificial airways.Method:applied and methodological research that involved technological production for teaching a Nursing Intervention, based on Vygotsky’s theoretical frameworks and on the Nursing Process. For elaboration and validation, a classic instructional design model was followed. The general and pedagogical requirements were validated, as well as those for videos and interface. For the analysis, the Content Validity Index and the First-order agreement coefficient were used.Results:34 experts participated, 27 of whom were nurses and seven were professionals in Information Technology. In the nurses’ opinion, the general and pedagogical requirements obtained a Content Validity Index of 0.99 and 0.98 was obtained for the videos and for the interface. The interface for the IT professionals was 0.94. All requirements showed almost perfect agreement.Conclusion:the teaching program was elaborated and validated by experts and constitutes an innovative proposal to train nurses. The mediation of teaching by means of duly validated technologies can favor learning and reaching positive results in the development of skills in the practice of aspiration of artificial airways.

Occupational Therapists, Physiotherapists and Orthopaedic Surgeons Agree on the Decision for Carpal Tunnel Surgery.

Therapist-led pathways have been proposed as waitlist management strategies prior to surgery for conditions such as carpal tunnel syndrome (CTS) in public hospitals. These models of care typically shift the initial care of patients and decision-making from surgeons to therapists and, have been shown to reduce the number of patients requiring surgery and improve wait-times. This occurs despite limited evidence of surgeon-therapist agreement on key decisions, such as the need for surgery. The purpose of this was study was to assess the agreement between therapists and orthopaedic surgeons regarding the need for surgery for patients who have CTS. This blinded inter-rated agreement study was embedded in a multicentre randomised parallel groups trial of 105 patients with CTS referred to four orthopaedic departments and waitlisted for an appointment. The trial evaluated the effect of a therapist-led care pathway on the need for surgery and outcomes related to symptoms and function. Patients were randomised to either remain on the orthopaedic waitlist or receive group education, a splint and home exercises. The decision on the need for surgery at 6 months was made by a member of the orthopaedic consultant team or by one of the 14 participating therapists. The therapists and surgeons were blinded to each other's decision. Agreement was determined using percentage agreement, kappa coefficients (k), prevalence-adjusted and bias-adjusted kappa (PABAK), and Gwet's first-order agreement coefficient (AC1). Substantial agreement was seen between therapists and surgeons regarding the need for surgery (PABAK=0.74 (0.60-0.88)). Agreement was significantly associated with experience (P=.02). Therapists with advanced experience and scope of practice demonstrated perfect agreement with surgeons (PABAK=1.00 (95% CI: 1.00-1.00)). Mid-career therapists demonstrated substantial agreement (PABAK=0.67 (95% CI: 0.42-0.91)) and early-career therapists demonstrated fair agreement (PABAK=0.43 (95% CI: -0.04-0.90)). Therapists with advanced scope of practice make decisions that are consistent with orthopaedic surgeons.