Intraobserver Agreement Rates Research Articles

Inter- and Intraobserver Variability on Endoscopic Scoring Systems in Crohn's Disease and Ulcerative Colitis: A Systematic Review and Meta-Analysis.

Endoscopy scoring is a key component in the diagnosis of ulcerative colitis (UC) and Crohn's disease (CD). Variability in endoscopic scoring can impact patient trial eligibility and treatment effect measurement. In this study, we examine inter- and intraobserver variability of inflammatory bowel disease endoscopic scoring systems in a systematic review and meta-analysis. We included observational studies that evaluated the inter- and intraobserver variability using UC (endoscopic Mayo Score [eMS], Ulcerative Colitis Endoscopic Index of Severity [UCEIS]) or CD (Crohn's Disease Endoscopic Index of Severity [CDEIS], Simple Endoscopic Score for Crohn's Disease [SES-CD]) systems among adults (≥18 years of age) and were published in English. The strength of agreement was categorized as fair, moderate, good, and very good. A total of 6003 records were identified. After screening, 13 studies were included in our analysis. The overall interobserver agreement rates were 0.58 for eMS, 0.66 for UCEIS, 0.80 for CDEIS, and 0.78 for SES-CD. The overall heterogeneity (I2) for these systems ranged from 93.2% to 99.2%. A few studies assessed the intraobserver agreement rate. The overall effect sizes were 0.75 for eMS, 0.87 for UCEIS, 0.89 for CDEIS, and 0.91 for SES-CD. The interobserver agreement rates for eMS, UCEIS, CDEIS, and SES-CD ranged from moderate to good. The intraobserver agreement rates for eMS, UCEIS, CDEIS, and SES-CD ranged from good to very good. Solutions to improve interobserver agreement could allow for more accurate patient assessment, leading to richer, more accurate clinical management and clinical trial data.

Diagnostic performance of anterior segment optical coherence tomography in detecting plateau iris

ObjectiveTo evaluate the diagnostic performance of manual grading of anterior segment optical coherence tomography (AS-OCT) in detection of plateau iris configuration (PIC) based on the presence of standardised ultrasound biomicroscopy...

Reliability of the Penny and Beit CURE Radiologic Classifications of Pediatric Patients with Chronic Hematogenous Osteomyelitis in the Philippine General Hospital

Objective. This study aimed to evaluate the inter- and intraobserver reliability of the Penny and Beit CURE radiologic classifications of pediatric patients with Chronic Hematogenous Osteomyelitis (CHOM) in the Philippine General Hospital (PGH).
 Methods. Thirty-four pre-operative radiographs of PGH pediatric patients with CHOM were classified by seven orthopedic surgeons using both Penny and Beit CURE Classification systems. Two sets of radiographs were sent to the surgeons twice, four weeks apart, to classify. The Fleiss and Cohen κ statistics were used to determine inter- and intraobserver reliabilities, respectively.
 Results. The Penny Classification had a slight to fair interobserver reliability (Fleiss κ = 0.17 and 0.24) and a fair intraobserver reliability (Cohen κ =0.35) with a 49.58% average intraobserver agreement. The interobserver reliability when including all Beit CURE classification subtypes was fair (κ = 0.28 and 0.31). This improved to moderate (κ = 0.41 and 0.54) when using only the four main types of the Beit CURE classification with a 77.31% intraobserver agreement.
 Conclusion. The Beit CURE classification for pediatric CHOM had higher inter- and intraobserver agreement rates than the Penny classification. Further improvement in reliability can be made by combining B2 and B3 subtypes under the Beit CURE classification.

Accuracy and reliability of the AO Spine subaxial cervical spine classification system grading subaxial cervical facet injury morphology.

A classification system was recently developed by the international association AO Spine for assessing subaxial cervical spine fractures. Significant variability exists between users of the facet component, which consists of four morphological types (F1-F4). The primary aims of this study were to assess the diagnostic accuracy and reliability of this new system's facet injury morphological classifications. A survey consisting of 16 computed tomography (CT) scans of patients with cervical facet fractures was distributed to spine surgeon members of AO Spine Latin America. To provide a gold standard diagnosis for comparison, all 16 injuries had been classified previously by six co-authors and only were included after total consensus was achieved. Demographic and surgical practice characteristics of all respondents were analyzed, and diagnostic accuracy calculated. Inter- and intra-observer agreement rates were calculated across two survey rounds, conducted one month apart. A total of 135 surgeons completed both surveys, among whom the mean age was 41.6years (range 26-71), 130 (96.3%) were men, and 83 (61.5%) were orthopedic surgeons. The mean time in practice as a spine surgeon was 9.7years (1-30). The overall diagnostic accuracy of all responses was 65.4%. Inter-observer and intra-observer agreement rates for F1/F2/F3/F4 were 55.4%/47.6%/64.0%/94.7% and 60.0%/49.1%/58.0%/93.0%, respectively. This study evaluates the AO Spine Classification System specifically for facet injuries involving the subaxial cervical spine in a large sample of spine surgeons. There was significant variability in diagnostic accuracy for F1 through F3-type fractures, whereas almost universal agreement was achieved for F4-type injuries.

Endocytoscopy for the differential diagnosis of colorectal low-grade adenoma: a novel possibility for the “resect and discard” strategy

Endocytoscopy, a next-generation endoscopic system, facilitates observation at a maximum magnification of×520. To our knowledge, no study has reported high-precision diagnosis of colorectal low-grade adenoma, endoscopically. We aimed to reveal which endocytoscopic findings may be used as indicators of low-grade adenoma and to assess whether a "resect and discard" strategy using endocytoscopy is feasible. Lesions diagnosable with endocytoscopy were examined retrospectively between May 2005 and July 2017. A normal pit-like structure in endocytoscopic images was considered a normal pit (NP) sign and used as an indicator of low-grade adenoma. The primary outcome was the diagnostic accuracy of the NP sign for low-grade adenoma. We evaluated agreement rates between endocytoscopic and pathologic diagnosis for surveillance colonoscopy interval recommendation (SCIR) and performed a validation study to verify the agreement rates. For 748 lesions in 573 cases diagnosed as colorectal adenoma using endocytoscopy, the results were as follows: sensitivity of the NP sign for low-grade adenoma, 85.0%; specificity, 90.7%; positive predictive value, 96.6%; negative predictive value, 66.1%; accuracy, 86.4%; and positive likelihood ratio, 9.2 (P< .001). The agreement rate between endocytoscopic and pathologic diagnosis for SCIR was 94.4% (95% confidence interval [CI], 92.2%-96.1%; P< .001) under United States guidelines and 96.3% (95% CI, 94.5%-97.7%; P< .001) under European Union guidelines. All inter- and intraobserver agreement rates for expert and nonexpert endoscopists had κ values≥0.8 except one nonexpert pair. Endocytoscopy is an effective modality in determining the differential diagnosis of colorectal low-grade adenoma. (University Hospital Medical Information Network Clinical Trials database registration number: UMIN000018623.).

Intraobserver and interobserver reliability in sonographic size measurements of gallbladder polyps.

To evaluate the intraobserver and interobserver reliability of gallbladder polyp measurements using transabdominal US and the factors that affect reliability. From November 2017 to February 2018, two radiologists measured the maximum diameter of 91 gallbladder polyps using transabdominal US. Intraobserver and interobserver agreement were determined using 95% Bland-Altman limits of agreement and intraclass correlation coefficients (ICCs). The effects of image settings, polyp location, and polyp size were evaluated by comparing ICCs using z tests. The intraobserver agreement rates were 0.960 (95% confidence interval [CI], 0.939-0.973) for observer 1 and 0.962 (95% CI, 0.943-0.975) for observer 2. The ICCs between the two observers were 0.963 (95% CI, 0.926-0.979) for the first measurement and 0.973 (95% CI, 0.950-0.984) for the second measurement. The 95% limits of agreement on repeated measurements were 22.3-25.2% of the mean, and those between the two observers were 25.5-34.2% of the mean. ICCs for large polyps (≥ 5mm) were significantly higher than those for small polyps (< 5mm). There were no significant differences in the ICCs between image settings and polyp location. Polyp size measurements using transabdominal US are highly repeatable and reproducible. Polyp size significantly affects the reliability of measurement. Diameter changes of approximately less than 25% may fall within the measurement error; this should be considered while interpreting the change in size during follow-up US, especially for small polyps. • Gallbladder polyp size measurement using transabdominal US is highly repeatable and reproducible. • Diameter changes of approximately less than 25% should be interpreted carefully, especially in small polyps.

INTER- AND INTRA-OBSERVER AGREEMENT IN THE MILCH AND WEISS SYSTEMS.

ABSTRACTObjective:The aim of this study is to estimate the inter- and intra-observer agreement of the Weiss and Milch classification systems in radiological studies of fractures of the lateral humeral condyle in pediatric patients.Methods:An agreement study was performed with non-probability sampling of consecutive cases with a sample size of a hundred radiological studies, which were evaluated by three experienced orthopedic surgeons and three resident physicians; following a thorough comparison of both inter- and intra-observer agreements over a six-week period based on the Fleiss’ kappa, which was used to determine the inter- and intra-observer agreement rates of both classifications.Results:The overall reliability of the entire group of evaluators for the Milch classification in the inter-observer evaluation was κ = 0.13, 95% CI, 0.08-0.18, and the intra-observer evaluation was κ = 0.08, 95% CI, 0.06-0.11. For the Weiss classification, the overall evaluation had an inter-observer agreement of κ = 0.53, 95% CI, 0.50-0.57, and an intra-observer agreement of κ = 0.22, 95% CI, 0.20 −0.24.Conclusion:In the present study, the Weiss classification system demonstrated greater agreement than the Milch classification; however, the latter may require complementary studies, such as an arthrography to enhance classification accuracy. Level of Evidence II, Diagnostic Studies - Investigating Diagnostic Examination.

The auricular surface as age indicator in a modern Greek sample: A test of two qualitative methods

The auricular surface is often found very well preserved, thus age-related changes in this anatomical area can be important for any set of human remains that require identification under different taphonomic conditions. This study tests the Buckberry and Chamberlain (2002) and Schmitt et al. (2005) methods in predicting the age of individuals in a documented sample from Crete, Greece. Both methods were used to record changes on the auricular surface in a mixed-sex sample of 74 individuals, directly as well as through photographs, by two independent observers. Cohen’s kappa and intra class correlation coefficients (ICC) were used in order to assess inter-observer and intra-observer agreement. Results showed than none of the methods predicted age with sufficient accuracy, as high error rates were recorded. The Schmitt et al. (2005) method performed better, mainly because the age ranges it uses are broader. Scoring through photographs does not seem to introduce bias in predicting age, as demonstrated by the high intra-observer agreement rates. Inter-observer agreement was also high. The low intra- and inter-observer error rates suggest that the poor performance of both methods in the Cretan sample is not due to a lack of clarity in the description of the morphological changes recorded on the auricular surface; rather it should be attributed to a poor correlation between these changes and age at death in our material.

Diagnostic Reproducibility: What Happens When the Same Pathologist Interprets the Same Breast Biopsy Specimen at Two Points in Time?

Surgeons may receive a different diagnosis when a breast biopsy is interpreted by a second pathologist. The extent to which diagnostic agreement by the same pathologist varies at two time points is unknown. Pathologists from eight U.S. states independently interpreted 60 breast specimens, one glass slide per case, on two occasions separated by ≥9months. Reproducibility was assessed by comparing interpretations between the two time points; associations between reproducibility (intraobserver agreement rates); and characteristics of pathologists and cases were determined and also compared with interobserver agreement of baseline interpretations. Sixty-five percent of invited, responding pathologists were eligible and consented; 49 interpreted glass slides in both study phases, resulting in 2940 interpretations. Intraobserver agreement rates between the two phases were 92% [95% confidence interval (CI) 88-95] for invasive breast cancer, 84% (95% CI 81-87) for ductal carcinoma-in-situ, 53% (95% CI 47-59) for atypia, and 84% (95% CI 81-86) for benign without atypia. When comparing all study participants' case interpretations at baseline, interobserver agreement rates were 89% (95% CI 84-92) for invasive cancer, 79% (95% CI 76-81) for ductal carcinoma-in-situ, 43% (95% CI 41-45) for atypia, and 77% (95% CI 74-79) for benign without atypia. Interpretive agreement between two time points by the same individual pathologist was low for atypia and was similar to observed rates of agreement for atypia between different pathologists. Physicians and patients should be aware of the diagnostic challenges associated with a breast biopsy diagnosis of atypia when considering treatment and surveillance decisions.

Prospective study of intracranial translucency and the posterior brain in normal fetuses at the 11- to 13-week scan.

To evaluate the ability of sonographers to prospectively identify intracranial translucency and posterior brain structures at 11 to 13 weeks and to evaluate measurement reproducibility of brain stem and brain stem-occipital bone diameters on stored images. After specific training for intracranial translucency visualization, 10 nonphysician sonographers prospectively identified intracranial translucency at the 11- to 13-week scan, noting whether intracranial translucency was present, absent, or uncertain. If absent/uncertain, they documented the reason as spina bifida or an inadequate image (with reasons for the inadequate image). Measurements of brain stem and brain stem-occipital bone diameters were performed on stored images. Fifty randomly selected cases were reviewed for intraobserver and interobserver variability. In 313 singleton pregnancies, the posterior brain including intracranial translucency was evaluated; 293 (93.6%) had known pregnancy outcomes. None had open spina bifida, but 7 had chromosomal or congenital abnormalities. In the remaining 286 normal fetuses, intracranial translucency was seen in 275 (96%) and uncertain in 11 (4%), due to inadequate images (top 3 reasons were fetal position [n = 8], obesity [n = 5], and retroverted uterus [n = 4]). Fetal position and gestational age were significantly associated with intracranial translucency visualization (P < .05). Intraobserver and interobserver agreement rates were moderate for measurements of brain stem diameter (intraclass correlation coefficients, 0.59 and 0.57) and substantial for brain stem-occipital bone diameter (intraclass correlation coefficients, 0.76 and 0.61). Bland-Altman analysis revealed negligible intraobserver and interobserver differences in brain stem and brain stem-occipital bone diameter measurements. Intracranial translucency can be prospectively identified by trained sonographers in 96% of normal fetuses at 11 to 13 weeks. Measurements of brain stem and brain stem-occipital bone diameters are reproducible.

Intra- and Interobserver Variability in CT Measurements in Oncology

To assess variability of computed tomographic (CT) measurements of lesions of various sizes and margin sharpness in several organs taken by readers with different levels of experience, as would be found in routine clinical practice. In this institutional review board-approved, HIPAA-compliant retrospective study, 17 radiologists with varying levels of experience independently obtained bidimensional orthogonal axial measurements of 80 lymph nodes, 120 pulmonary lesions, and 120 hepatic lesions, categorized by size and margin sharpness. Repeat measurements were performed 2 or more weeks later. Intraclass correlation coefficients and Bland-Altman plots were used to assess intra- and interobserver variability. For long- and short-axis measurements, respectively, overall intraobserver agreement rates were 0.957 (95% confidence interval [CI]: 0.947, 0.966) and 0.945 (95% CI: 0.933, 0.955); interobserver agreement rates were 0.954 (95% CI: 0.943, 0.963) and 0.941 (95% CI: 0.929, 0.951). Both intra- and interobserver agreement differed by lesion size, margin sharpness, location, and reader experience. Agreement ranged from 0.847 to 0.886 for lesions 20 mm or larger versus 0.745-0.785 for lesions smaller than 10 mm, 0.961 to 0.975 for smooth margins versus 0.924-0.942 for irregular margins, 0.955 to 0.97 for lung lesions versus 0.884-0.94 for lymph nodes, and 0.95 to 0.97 for attending radiologists versus 0.928-0.945 for fellows. Measurement variability decreased with increasing lesion size; 95% limits of agreement for short-axis measurements were -11.6% to 6.7% for lesions smaller than 10 mm versus -6.2% to 4.7% for lesions 20 mm or larger. Overall intra- and interobserver variability rates were similar; in clinical practice, serial CT measurements can be safely performed by different radiologists. Smooth margins, larger lesion size, and greater reader experience resulted in a higher consistency of measurements. Depending on lesion size, increases of 4%-6% or greater in long axis and 5%-7% or greater in short axis and decreases of -6% to -10% or greater in long axis and -6% to -12% or greater in short axis at CT can be considered true changes rather than measurement variation, with 95% confidence.

Intra- and Interobserver Variability in CT Measurements in Oncology

To assess variability of computed tomographic (CT) measurements of lesions of various sizes and margin sharpness in several organs taken by readers with different levels of experience, as would be found in routine clinical practice. In this institutional review board-approved, HIPAA-compliant retrospective study, 17 radiologists with varying levels of experience independently obtained bidimensional orthogonal axial measurements of 80 lymph nodes, 120 pulmonary lesions, and 120 hepatic lesions, categorized by size and margin sharpness. Repeat measurements were performed 2 or more weeks later. Intraclass correlation coefficients and Bland-Altman plots were used to assess intra- and interobserver variability. For long- and short-axis measurements, respectively, overall intraobserver agreement rates were 0.957 (95% confidence interval [CI]: 0.947, 0.966) and 0.945 (95% CI: 0.933, 0.955); interobserver agreement rates were 0.954 (95% CI: 0.943, 0.963) and 0.941 (95% CI: 0.929, 0.951). Both intra- and interobserver agreement differed by lesion size, margin sharpness, location, and reader experience. Agreement ranged from 0.847 to 0.886 for lesions 20 mm or larger versus 0.745-0.785 for lesions smaller than 10 mm, 0.961 to 0.975 for smooth margins versus 0.924-0.942 for irregular margins, 0.955 to 0.97 for lung lesions versus 0.884-0.94 for lymph nodes, and 0.95 to 0.97 for attending radiologists versus 0.928-0.945 for fellows. Measurement variability decreased with increasing lesion size; 95% limits of agreement for short-axis measurements were -11.6% to 6.7% for lesions smaller than 10 mm versus -6.2% to 4.7% for lesions 20 mm or larger. Overall intra- and interobserver variability rates were similar; in clinical practice, serial CT measurements can be safely performed by different radiologists. Smooth margins, larger lesion size, and greater reader experience resulted in a higher consistency of measurements. Depending on lesion size, increases of 4%-6% or greater in long axis and 5%-7% or greater in short axis and decreases of -6% to -10% or greater in long axis and -6% to -12% or greater in short axis at CT can be considered true changes rather than measurement variation, with 95% confidence.

Diagnosis of synovitis by ultrasonography in RA: A one-year experience is enough for reliability on static images

Objective To evaluate the inter- and intra-observer agreement of ultrasonographic metacarpophalangeal joint static images in patients with rheumatoid arthritis by two investigators with different ultrasonographic experience. Methods Ultrasonography was performed by the senior on 386 metacarpophalangeal joints respectively in B-mode and 408 in power Doppler of 17 patients with active rheumatoid arthritis. A first interpretation was done and images were stored at examination time. Static images were then read twice by two independent investigators of different experiment (4-year and 1-year experience in musculoskeletal ultrasonography respectively for the senior and the junior). Results For the intra-investigator reproducibility kappa or weighted kappa coefficient ranged from 0.74 to 0.99 for the junior and the senior for B and power Doppler mode. For inter-investigator reproducibility kappa or weighted kappa coefficient ranged from 0.61 and 0.98 for qualitative B and power Doppler modes and semi-quantitative power Doppler. The inter-investigator weighted kappa was 0.49 for semi-quantitative B-mode. The agreement between the dynamic exam and the static exam; results were very good for both readers in power Doppler Mode (0.89). In B-Mode, they didn't reach statistical significance. The reliability for measuring synovial thickness was excellent – rho = 0.7609 ( p = 0.00001). Conclusion An experienced rheumatologist and a junior achieved high inter- and intra-observer agreement rates for the identification of synovitis and power Doppler activity for static images of ultrasonography. Trainees could use that method as a first step in US learning.

Three-Dimensional Power Doppler Vascular Network Assessment of Adnexal Masses

The purpose of this study was to assess intraobserver and interobserver agreement for tumor vascular network evaluation as assessed by 3-dimensional (3D) power Doppler sonography for discriminating benign from malignant adnexal masses. Stored 3D power Doppler angiographic volume data from 39 women with a diagnosis of a vascularized adnexal mass who were evaluated and treated at our institution were retrieved from our database for analysis. Two different examiners (observer A, with 6 years of experience in 3D sonography; and observer B, with 1 year of experience) reviewed 3D sonograms blinded to each other. Three-dimensional vascular network reconstruction was done with surface rendering in the color mode. Malignancy was considered in the presence of at least 2 of the following: irregular branching, vessel caliber changes, microaneurysms, and vascular lakes. A definitive histologic diagnosis was obtained in all cases. Intraobserver and interobserver agreement rates were estimated by calculating the kappa index. Twenty (51%) tumors were malignant, and 19 (49%) were benign. Intraobserver agreement was good for observer A (kappa = 0.69) and moderate for observer B (kappa = 0.54). Interobserver agreement was moderate (kappa = 0.49). We found intraobserver and interobserver agreement to be moderate for 3D power Doppler assessment of the vascular network in adnexal masses.

Interobserver and Intraobserver Variability in the Sonographic Assessment of Fatty Liver

The purpose of this study was to evaluate interobserver and intraobserver variability in the sonographic assessment of the presence and severity of fatty liver. We retrospectively evaluated the static images of 168 adult patients who had undergone abdominal sonography. Three experienced radiologists independently graded the hepatic images as normal, mild steatosis, moderate steatosis, or severe steatosis. Assessment of liver steatosis was repeated on the same set of images 1 month later under the same conditions and blinded to the initial reading. Weighted kappa statistics were used to analyze interobserver and intraobserver agreement, and the agreement percentages were calculated. The mean interobserver and intraobserver agreement rates for the presence of fatty liver were 72% (kappa = 0.43) and 76% (kappa = 0.54). For severity of fatty liver, the initial reading for pairs of observers had 47-59% (kappa = 0.40-0.51) interobserver agreement. The interobserver agreement for the second reading was 59-64% (kappa = 0.43-0.54). The mean agreement rates for pairs of observers were 53% (kappa = 0.47) and 62% (kappa = 0.50) on the first and second readings. Intraobserver agreement for severity of fatty liver ranged from 55% to 68% (kappa = 0.51-0.63). Subjective visual assessment of fatty liver on sonography has substantial observer variability. There is a need for a more objective quantitative method of grading fatty liver on sonography that would be easily available and applicable in routine clinical practice.

Semiquantitative Optic Nerve Grading Scheme for Determining Axonal Loss in Experimental Optic Neuropathy

To describe and evaluate a semiquantitative optic nerve grading scheme for assessing axonal loss in endothelin (ET)-1-induced chronic optic neuropathy. Optic nerve cross-sections from both eyes of 39 Brown Norway rats unilaterally treated with various concentrations of ET-1 or physiological saline solution via a surgically implanted osmotic minipump were processed for light and transmission electron microscopy (TEM). The optic nerve damage grade, between 0 (no damage) and 10 (total damage), was based on the number of zones of approximately equal damage and the mean percentage of damage within each zone. Grading was performed under light microscopy by three observers and compared with axonal survival determined with TEM using two quantification methods: the sampling method, in which approximately 10% of the section was counted, and the full-count method, in which the whole section was counted (n = 12). Axonal survival was expressed as a ratio of axon counts in the experimental to control eye. Before these comparisons, the inter- and intraobserver agreement rates were determined in another group of 85 and 12 ET-1-treated animals, respectively. The interobserver kappa was 0.66 (95% confidence interval [CI]: 0.58-0.74) for all eyes and 0.55 (95% CI: 0.43-0.67) for the experimental eyes only. The intraobserver kappa was 0.80, 0.81, and 0.80 for all 24 eyes and 0.60, 0.64, and 0.71 for experimental eyes only. The correlation between damage grade in the experimental eye and axonal survival using the TEM sampling method (Spearman's rho = -0.677 for all animals and -0.827 for the subset of animals with full counts only) was lower than that with the full-count method (Spearman's rho = -0.926). When axonal survival was less than 0.7, the sampling method always underestimated the extent of damage. The grading scheme had good inter- and intraobserver agreement, and high correlation with the TEM methods. It is a practical and time-saving method, requiring less than 1 minute per nerve and is an alternative to sampling methods that can yield significant errors.

Reliability of histopathologic assessment for the differentiation of recurrent hepatitis C from acute rejection after liver transplantation.

Histopathologic assessment is considered essential for the differentiation of recurrent hepatitis C (RHC) from acute cellular rejection (ACR) after liver transplantation (LT); however, there is limited information regarding its reliability. The aim of this study was to determine the interobserver and intraobserver agreement of the histopathologic diagnosis of RHC vs. ACR, and to determine the reliability of specific histopathologic features for the differentiation of RHC from ACR. Liver biopsy specimens from 105 consecutive patients transplanted for hepatitis C virus (HCV)-related liver disease were studied retrospectively. All the biopsies were performed for evaluation of abnormal liver enzymes within the 1st year after LT. The slides were blindly coded and assessed by 5 liver-transplant pathologists, practicing at 3 medical centers. The pathologists were asked to render a diagnosis, and determine the severity of the disease. Four of the pathologists were asked to determine the presence and severity of 36 histopathologic features. A total of 34 of the samples were then blindly resubmitted to each of the 4 pathologists to determine the intraobserver agreement. There was a slight agreement (kappa = .12) among the 5 pathologists on the histopathologic diagnosis. All 5 pathologists were in agreement on the diagnosis of RHC in only 5 patients (5%) and on the diagnosis of ACR in only 2 patients (2%). The best agreement among any 4 pathologists was fair (kappa = .20). Slight to moderate agreement occurred on the main histological features considered to be important in the diagnosis of ACR. Intraobserver agreement ranged from slight (kappa = .19) to moderate (kappa = .42) among 4 pathologists. In conclusion, the histopathologic differentiation of RHC from ACR after LT had relatively low interobserver and intraobserver agreement rates, and hence showed low reliability. Histopathologic assessment should be used cautiously for the differentiation of RHC from ACR post-LT.

Health Related Messages in Advertising: A Comparative Study of Prime-Time Television Commercials Broadcast in 1992 and 1998

Television is the primary source of nutrition and health information for most Americans. However, little research has investigated the health information embedded in TV broadcasts. Thus, the purpose of this study was to content analyze the HRMs in commercials aired during 17.5 hours of prime-time network programming shown in October 1992 and an equivalent amount of air time in October 1998. Two trained researchers coded all commercials, crosschecking for unanimous inter-rater agreement. To establish intra-reliability, each researcher independently viewed and coded the commercials in 2 30-minute programs that were not part of the sample twice (2 weeks apart). The intra-observer agreement rates were 93% and 92% for the 2 researchers as calculated by the Holsti formula. The total sample included 568 commercials in 1992 and 667 in 1998, having a mean length, respectively, of 22.07±8.69SD and 22.07±10.12SD seconds. The vast majority of advertisements were for commercially sold products (97.5%). Although there were virtually no public service announcements (PSA) aired during prime-time (<2%), most of those that were shown focused on a public health issue. In 1992, nearly 1 in 5 commercials advertised a food product and another 8% promoted medications. In 1998, only 1 in 7 commercials were for food and 4% advertised medications. Breakfast cereals, fast foods, candy, and gum were the most commonly advertised foods items and cold and flu remedies were the most frequently promoted medications. Data analysis indicated that the main themes used to sell food items were taste, quality, and economy. Nutrition information was rarely offered in food ads, however nutrients were often used to sell cosmetics. More than 2/3 of the health messages embedded in food commercials were judged to be inaccurate or misleading. It's important to note that HRMs were not limited to medication or food commercials. In fact, 43% of all commercials contained HRMs. This study indicates that HRMs are often embedded in TV commercials and that HRMs tend to be incongruent with those promoted by health professionals. When the HRMs in commercials are coupled with those embedded in TV programs themselves, the average TV viewer receives a healthy dose of some not so healthwise information. The time has come for health professionals to actively work with advertisers and television writers to improve the accuracy of the health information delivered daily to American homes.

Technique for Determining Glaucomatous Visual Field Progression by Using Animation Graphics

The first two visual field examinations of each of 16 glaucoma suspects and 16 glaucoma patients, who were followed up for a median of 7.46 years with seven examinations, were averaged. Three-dimensional color-coded images of the visual field were then generated. After correcting for test-retest variability, the images, as well as additional interpolated images, were aligned and presented in rapid succession to create an animation sequence. Five glaucoma specialists trained themselves to classify the visual fields as either progressing or not progressing. The interobserver and intraobserver agreement rates were then calculated. Perfect agreement (100% concordance) between the observers was obtained for 18 (56.3%) subjects, and at least 80% concordance was obtained for 27 (84.4%) subjects. Of the eight sequences that were repeated to test intraobserver agreement, four of the five observers had a value of at least 87.5%.

Examiner agreement in estimating changes in periodontal bone from conventional and subtraction radiographs

It has previously been shown that computer-assisted subtraction of serially-obtained radiographs yields a higher degree of accuracy in the detection of small changes in the marginal periodontal bone than conventional radiographs. This study concerns another important aspect of such diagnostic methods, namely the intra- and inter-examiner agreement rates. On 10 patients with moderate to severe periodontal bone loss involved in a clinical trial to evaluate the effectiveness of subgingival antimicrobial irrigation, conventional radiographs were taken at baseline and after 32 and 52 weeks. The changes in terms of gain or loss of bone occurring between the examination at baseline and that after 32 weeks, as well as those occurring between the examination performed after 32 weeks and that made after 52 weeks, were evaluated by means of conventional radiographs and by subtraction images. Both types of image were interpreted by each of 4 observers. The images were read a 2nd time after a period of at least 2 weeks. The inter-observer as well as the intra-observer agreement were assessed by calculating 3 different measures of agreement: the overall agreement, the specific agreement and the kappa value. Regardless of measure, higher inter-observer agreement rates were found for all observers when the subtraction technique was employed. A similar pattern was found with respect to the intra-observer agreement rates.