Diagnostic Concordance Rate Research Articles

Routine Surgical Telepathology in the Department of Veterans Affairs: Experience-Related Improvements in Pathologist Performance in 2200 Cases

To determine whether diagnostic concordance, case deferral rate, and/or time required to review slides changed significantly as telepathologists gained additional experience using a hybrid dynamic/store-and-forward (HDSF) telepathology (TP) system on the 2000 cases following an initial 200 consecutive surgical cases, previously reported. Gross surgical pathology specimens were prepared by specially trained personnel in Iron Mountain, Michigan. For TP, glass slides were placed on the stage of a robotic microscope at the Iron Mountain VAMC (remote site); control of the motorized microscope was then transferred to a pathologist located 220 miles away at the Milwaukee, Wisconsin, VAMC (host site). For each case, a telepathologist had the option of either rendering a diagnosis or deferring the case for later analysis by conventional light microscopy (LM). After the slides were read by TP and a surgical pathology report had been generated (for nondeferred cases), the slides were transported to Milwaukee, where they were reexamined by the same pathologist, now using LM. When there was disagreement between the TP and LM diagnosis, a supplemental or revised report was issued, and the referring physician was notified by telephone immediately. All supplemental and revised reports were reviewed by a third pathologist in the group. The slides were then reviewed by the pathology group practice or, when there was no consensus, by the Armed Forces Institute of Pathology to establish a "truth" diagnosis. To determine changes in telepathologist performance with experience after the initial start-up of the service, their performance in handling 10 consecutive sets of 200 surgical pathology cases was analyzed. Concordance rates for clinically significant TP and LM diagnoses were high for all 10 sets, ranging from 99% to 100%. Comparing the first set (Cases 201-400) with the last set (Cases 2001-2200), viewing times per case were reduced from 10.26 min to 3. 58 min. Viewing times per slide were reduced from 3.44 min to 1.13 min per slide, comparing the first and last sets. Case turnaround times (TAT) decreased from 2.46 days to < or =1.5 days. Thes results demonstrate that improvements in TP services occur over time as the result of additional experience using the TP system. The high diagnostic concordance and low rate of case deferral lend additional support to the proposal that a host-site pathologist using HDSF TP can substitute effectively for an on-site pathologist as a service provider.

Diagnostic accuracy and image quality using a digital camera for teledermatology.

The study was designed to evaluate the effectiveness of digital photography for dermatologic diagnoses and compare it with in-person diagnoses. Patients referred for specialty consultations (n = 308) were recruited from a university dermatology clinic. Patients were examined in-person by one of three board-certified dermatologists who provided clinical diagnoses. Digital photos were obtained on all patients and were evaluated as computer images by a panel of dermatologists. There was 83% concordance between in-person versus digital photo diagnoses. Intradermatologist concordance averaged 84%, and interdermatologist concordance averaged 81%. Decision confidence was rated as "very definite" to "definite" 62% of the time. Concordance with biopsy results was achieved in 76% of the cases. Image sharpness and color quality were rated "good" to "excellent" 83% and 93% of the time, respectively. Digital photography for store-and-forward teledermatology produces high-quality images and diagnostic concordance rates that compare favorably with in-person clinical diagnoses.

Improving diagnostic accuracy and interobserver concordance in the classification and grading of primary gliomas.

Accurate histologic diagnosis of gliomas is fundamental to proper patient management and to the interpretation of basic and clinical investigations. Diagnostic accuracy and reproducibility are compromised by the subjective histologic criteria currently used to classify and grade gliomas. The histologic features of 4 sets of gliomas (a total of 244 cases) were reviewed independently by 4 neuropathologists to determine interobserver diagnostic concordance rates. Cases wherein diagnostic disagreements arose were reviewed jointly to identify and refine the histologic criteria that were adversely affecting diagnostic reproducibility. Using the criteria developed in the study, a set of 315 gliomas with known survival data was evaluated in order to validate the usefulness of the criteria. There was significant improvement in diagnostic concordance with each session (P = 0.02). For the first session, the concordance rates were as follows: all 4 reviewers, 52%; any 3 reviewers, 60%; 2 reviewers, 70%. For the fourth session, the respective rates were 69%, 75%, and 80%. Although features important in grading, particularly microvascular proliferation, were sometimes problematic, most disagreements related to the classification of tumors. Much of the improvement related to the refinement of criteria distinguishing diffuse astrocytomas from oligodendrogliomas/oligoastrocytomas and pilocytic astrocytomas. It was concluded that the presence of any typical oligodendroglioma was sufficient to remove a tumor from the astrocytoma category. The authors' data indicate that oligodendroglial tumors comprise up to 25% of gliomas, a significantly higher proportion than was previously recognized. The data also suggest that the wide range of survival times reported for patients with anaplastic astrocytoma may reflect "contamination" resulting from misdiagnosis, particularly of oligodendroglial tumors and pilocytic astrocytomas.

Reproducibility of the morphological diagnostic criteria for acute myeloid leukemia: the GIMEMA group experience

Diagnostic reproducibility of the FAB morphological subtypes of acute leukemia is a basic step in the assessment of the clinical outcome in multicenter trials. Unusual cytologic variables and slightly different interpretations of the FAB morphological criteria have been the most significant factors affecting the overall diagnostic concordance rate among the various centers. An evaluation of the diagnostic concurrence between 35 institutions of the Italian Cooperative Study Group GIMEMA and two reviewers of the ad hoc morphological committee has been performed on 377 patients entering the AML 8A and AML 8B GIMEMA protocols. Overall concordance rate was 62.6%. The most significant differences were observed for M2 vs M4, M4 vs M5, M1 vs M2, and M2 vs M5 subtypes. In order to minimize the impact of some diagnostic deviations on the mean cytologic concordance rate, a distinction between "major" and "minor" discrepancies in the diagnostic procedures has been proposed. When the results of the single institutions were corrected by considering the "major" discrepancies only, a mean diagnostic agreement of 78.1% was reached.