Inter-observer Readings Research Articles

New measurements to determine changes after intra-articular high tibial osteotomy

Background: Most high tibial osteotomies (HTO), performed for medial compartment osteoarthritis of the knee (MCOA) are extra-articular osteotomies of the upper tibia. Recently, attention has turned to detecting and treating intra-articular deformities of the upper tibia causing MCOA. Chiba introduced the tibial condylar valgus osteotomy (TCVO) in Japan and few English language articles have described indications, surgical techniques of results of these osteotomies. Two angles commonly measure and detect the intra-articular deformity and measure the difference between preoperative and postoperative parameters: Joint line convergence angle (JLCA) and condylar plateau angle (CPA). Aims and Objectives: JLCA is relatively easy to measure as it uses clearly visible landmarks to draw tangents to femoral and tibial condyles to subtend the angle. CPA is a little difficult to measure and we found it to be less reliable in intra-observer as well as interobserver readings. Materials and Methods: We decided to measure the intra-articular deformity by using spine edge angle (SEA) and spine vertical distance (SVD) as two new measurements. These have proved to be reliable in intra as well as interobserver measurements. We compared readings of SEA and SVD in 57 patients each who had an intra-articular TCVO and also an extraarticular medial open wedge HTO (OWHTO). Results: We found a significant change between preoperative and postoperative measurements of SEA and SVD in patients who underwent TCVO, but no change in patients who underwent OWHTO. Conclusions: The two new measurements of SEA and SVD accurately measure the change in intra-articular deformity parameters in patients who undergo TCVO and are more reliable than CPA.

Is there a good agreement between MRI readers for Thaunat’s classification in arthroscopically-proven meniscal ramp lesions?

ObjectiveTo describe and evaluate the reproducibility by MRI of an arthroscopically-based classification for meniscal ramp lesions. We hypothesize that MRI would present good interobserver and intraobserver reliability to evaluate meniscal ramp lesions. Materials and MethodsTwenty MRI of the knee with arthroscopically-proven meniscal ramp lesions were independently assessed by two skilled musculoskeletal radiologists and a third-year radiology resident. Reading was performed in a randomized and anonymous manner, in two steps, with a minimum of 1-month interval between each. Cohen’s kappa coefficient statistic was used to analyze intra and interobserver reading agreement. Associate findings were also categorized. ResultsFrom 20 subjects, 17 were male, with mean age of 35 years. MRI reading showed type IV ramp lesion as most prevalent with eight cases (37%), followed by type V – four (21%), type I – four (20%), type III – three, (16%) and type II – one (6%). Regarding ramp lesion types, intraobserver agreement was substantial for both skilled readers (Kappa = 0.72), and moderate for the less experienced reader (Kappa = 0.51); interobserver agreement was moderate. Results between most experienced readers were also analyzed in two categories: stable (types I and II) and unstable (types III, IV and V), also resulting in moderate agreement (Kappa = 0.54). Intraobserver agreement was substantial for both readers (Kappa = 0.68). The most common associate findings were joint effusion (85%), posteromedial capsular structures injury (60%), and medial meniscus extrusion (60%). ConclusionThe arthroscopy classification for meniscal ramp lesions stability adapted for MRI has good reproducibility when applied by trained musculoskeletal radiologists.

Evaluation of Imaging Software Accuracy for 3-Dimensional Analysis of the Mandibular Condyle. A Comparative Study Using a Surface-to-Surface Matching Technique.

The aim of this study was to assess the accuracy of 3D rendering of the mandibular condylar region obtained from different semi-automatic segmentation methodology. A total of 10 Cone beam computed tomography (CBCT) were selected to perform semi-automatic segmentation of the condyles by using three free-source software (Invesalius, version 3.0.0, Centro de Tecnologia da Informação Renato Archer, Campinas, SP, Brazil; ITK-Snap, version2.2.0; Slicer 3D, version 4.10.2) and one commercially available software Dolphin 3D (Dolphin Imaging, version 11.0, Chatsworth, CA, USA). The same models were also manually segmented (Mimics, version 17.01, Materialise, Leuven, Belgium) and set as ground truth. The accuracy of semi-automatic segmentation was evaluated by (1) comparing the volume of each semi-automatic 3D rendered condylar model with that obtained with manual segmentation, (2) deviation analysis of each 3D rendered mandibular models with those obtained from manual segmentation. No significant differences were found in the volumetric dimensions of the condylar models among the tested software (p > 0.05). However, the color-coded map showed underestimation of the condylar models obtained with ITK-Snap and Slicer 3D, and overestimation with Dolphin 3D and Invesalius. Excellent reliability was found for both intra-observer and inter-observer readings. Despite the excellent reliability, the present findings suggest that data of condylar morphology obtained with semi-automatic segmentation should be taken with caution when an accurate definition of condylar boundaries is required.

Correlation between Skeletal Age and Metacarpal Bones and Metacarpophalangeal Joints Dimensions.

Statement of the Problem: Currently, two major methods have been introduced for bone age assessment using left hand radiography. The first approach is Greulich and Pyle, which is very subjective. The second method is Tanner and Whitehouse, which is very time consuming and its morphological criteria are not quantitative, therefore it is hardly used. Purpose:The purpose of this study is to evaluate the relationship between skeletal age and bone size and joint space measurements among Asian children using hand radiographs and using this correlation as an aid in determining bone age. Materials and Method: In this analytic research, 304 hand radiographs from Asian children with normal development have been included in this study (155 female, 149 male). Two radiologists using Greulich and Pyle method assessed their bone ages. The 2nd-5th metacarpal bones length and width and 2nd-5th metacarpophalangeal joints width and length were manually measured by Adobe Photoshop and compared with subjects’ skeletal age. Pearson correlation was used to determine the relationship. Results:Pearson correlation between bone age and metacarpal bones length was 0.902-0.938; metacarpal bones width was 0.452-0.850; metacarpophalangeal joints width was 0.656 - 0.811, and metacarpophalangeal joints length was 0.920 - 0.947. Conclusion:Regarding Pearson correlation, metacarpophalangeal joints length, metacarpal bones length, metacarpophalangeal joints width, and metacarpal bones width showed significant relationship with bone age, respectively. These measurements can be used as accessory criteria for bone age assessment using left hand radiography, to reduce inter-observer reading differences.

The inter-observer reading variability in anti-nuclear antibodies indirect (ANA) immunofluorescence test: A multicenter evaluation and a review of the literature.

Recently there has been an increase demand for Computer-Aided Diagnosis (CAD) tools to support clinicians in the field of Indirect ImmunoFluorescence (IIF), as the novel digital imaging reading approach can help to overcome the reader subjectivity. Nevertheless, a large multicenter evaluation of the inter-observer reading variability in this field is still missing. This work fills this gap as we evaluated 556 consecutive samples, for a total of 1679 images, collected in three laboratories with IIF expertise using HEp-2 cell substrate (MBL) at 1:80 screening dilution according to conventional procedures. In each laboratory, the images were blindly classified by two experts into three intensity classes: positive, negative, and weak positive. Positive and weak positive ANA-IIF results were categorized by the predominant fluorescence pattern among six main classes. Data were pairwise analyzed and the inter-observer reading variability was measured by Cohen's kappa test, revealing a pairwise agreement little further away than substantial both for fluorescence intensity and for staining pattern recognition (k=0.602 and k=0.627, respectively). We also noticed that the inter-observer reading variability decreases when it is measured with respect to a gold standard classification computed on the basis of labels assigned by the three laboratories. These data show that laboratory agreement improves using digital images and comparing each single human evaluation to potential reference data, suggesting that a solid gold standard is essential to properly make use of CAD systems in routine work lab.

Reliability and Usefulness of Intraoperative 3-Dimensional Imaging by Mobile C-Arm With Flat-Panel Detector.

Reliability and agreement study. To assess the reliability of intraoperative 3-dimensional imaging with a mobile C-arm (3D C-arm) equipped with a flat-panel detector. Pedicle screws are widely used in spinal surgery. Postoperative computed tomography (CT) is the most reliable method to detect screw misplacement. Recent advances in imaging devices have enabled surgeons to acquire 3D images of the spine during surgery. However, the reliability of these imaging devices is not known. A total of 203 screws were used in 22 consecutive patients who underwent surgery for scoliosis. Screw position was read twice with a 3D C-arm and twice with CT in a blinded manner by 2 independent observers. Screw positions were classified into 4 categories at every 2 mm and then into 2 simpler categories of acceptable or unacceptable. The degree of agreement with respect to screw positions between the double readings was evaluated by κ value. With unanimous agreement between 2 observers regarding postoperative CT readings considered the gold standard, the sensitivity of the 3D C-arm for determining screw misplacement was calculated. A total 804 readings were performed. For the 4-category classification, the mean κ value for the 2 interobserver readings was 0.52 for the 3D C-arm and 0.46 for CT. For the 2-category classification, the mean κ value for the 2 interobserver readings was 0.80 for the 3D C-arm and 0.66 for CT. The sensitivity, specificity, positive predictive value, and negative predictive value of intraoperative imaging with the 3D C-arm were 70%, 95%, 44%, and 98%, respectively. With respect to screws with perforation ≥4 mm, the sensitivity was 83%. No revision surgery was performed. Intraoperative imaging with a 3D C-arm was reliable for detecting screw misplacement and helpful in decreasing the rate of revision surgery for screw misplacement.

Reliability of mercury-in-silastic strain gauge plethysmography curve reading: Influence of clinical clues and observer variation

Aim. Mercury-in-silastic strain gauge pletysmography (SGP) is a well-established technique for blood flow and blood pressure measurements. The aim of this study was to examine (i) the possible influence of clinical clues, e.g. the presence of wounds and color changes during blood pressure measurements, and (ii) intra- and inter-observer variation of curve interpretation for segmental blood pressure measurements. Methods. A total of 204 patients with known or suspected peripheral arterial disease (PAD) were included in a diagnostic accuracy trial. Toe and ankle pressures were measured in both limbs, and primary observers analyzed a total of 804 pressure curve sets. The SGP curves were later reanalyzed separately by two observers blinded to clinical clues. Intra- and inter-observer agreement was quantified using Cohen's kappa and reliability was quantified using intra-class correlation coefficients, coefficients of variance, and Bland-Altman analysis. Results. There was an overall agreement regarding patient diagnostic classification (PAD/not PAD) in 202/204 (99.0%) for intra-observer (κ = 0.969, p < 0.001), and 201/204 (98.5%) for inter-observer readings (κ = 0.953, p < 0.001). Reliability analysis showed excellent correlation between blinded versus non-blinded and inter-observer readings for determination of absolute segmental pressures (all intraclass correlation coefficients ≥ 0.984). The coefficient of variance for determination of absolute segmental blood pressure ranged from 2.9–3.4% for blinded/non-blinded data and from 3.8–5.0% for inter-observer data. Conclusion. This study shows a low inter-observer variation among experienced laboratory technicians for reading strain gauge curves. The low variation between blinded/non-blinded readings indicates that SGP measurements are minimally biased by clinical clues.

Quantification of left ventricular trabeculae using fractal analysis.

BackgroundLeft ventricular noncompaction (LVNC) is a myocardial disorder characterized by excessive left ventricular (LV) trabeculae. Current methods for quantification of LV trabeculae have limitations. The aim of this study is to describe a novel technique for quantifying LV trabeculation using cardiovascular magnetic resonance (CMR) and fractal geometry. Observing that trabeculae appear complex and irregular, we hypothesize that measuring the fractal dimension (FD) of the endocardial border provides a quantitative parameter that can be used to distinguish normal from abnormal trabecular patterns.MethodsFractal analysis is a method of quantifying complex geometric patterns in biological structures. The resulting FD is a unitless measure index of how completely the object fills space. FD increases with increased structural complexity. LV FD was measured using a box-counting method on CMR short-axis cine stacks. Three groups were studied: LVNC (defined by Jenni criteria), n=30(age 41±13; men, 16); healthy whites, n=75(age, 46±16; men, 36); healthy blacks, n=30(age, 40±11; men, 15).ResultsIn healthy volunteers FD varied in a characteristic pattern from base to apex along the LV. This pattern was altered in LVNC where apical FD were abnormally elevated. In healthy volunteers, blacks had higher FD than whites in the apical third of the LV (maximal apical FD: 1.253±0.005 vs. 1.235±0.004, p<0.01) (mean±s.e.m.). Comparing LVNC with healthy volunteers, maximal apical FD was higher in LVNC (1.392±0.010, p<0.00001). The fractal method was more accurate and reproducible (ICC, 0.97 and 0.96 for intra and inter-observer readings) than two other CMR criteria for LVNC (Petersen and Jacquier).ConclusionsFD is higher in LVNC patients compared to healthy volunteers and is higher in healthy blacks than in whites. Fractal analysis provides a quantitative measure of trabeculation and has high reproducibility and accuracy for LVNC diagnosis when compared to current CMR criteria.

Reliability of left ventricular noncompaction imaging criteria - the fractal facts

Background Left ventricular noncompaction (LVNC) is a cardiomyopathy with important prognostic implications. Identification of patients with LVNC using current criteria is challenging. Fractal analysis is a novel approach which summarises global LV trabecular complexity as a continuous variable, the fractal dimension, enabling the establishment of ethnically and disease-appropriate reference ranges for trabeculation. Methods We aimed to determine the reproducibility and accuracy of the fractal method compared to other LVNC criteria. We used these results to estimate sample size requirements for population studies of trabeculation. Two independent observers analyzed CMR data from 20 nonselected LVNC cases (mean age 47±13, 11 men) and 40 non-selected healthy volunteers (healthy whites, n=20; healthy blacks, n=20, mean age 45±14, 23 men). Datasets were evaluated using the fractal method (Figure 1) and two other CMR criteria (Petersen and Jacquier). Factorial repeated measures analysis of variance was performed to estimate within-subject variance components and total variability to be used in sample size calculations for the CMR criteria. Results The fractal approach was reproducible (for intra and inter-observer readings: repeatability coefficients, 0.059 and 0.067; intraclass correlation coefficients, 0.98 and 0.97; coefficients of variation, 5%, both). This reproducibility was greater than that calculated for the other LVNC analysis techniques (Figure 2a). Likelihood ratio graphs (Figure 2b) showed superior accuracy for the fractal method over the comparator techniques based on a composite of sensitivity, specificity and positive predictive values. These results translate into superior ability to detect difference and more powerful clinical trials - the minimum number of individuals needed to detect a clinically significant difference in trabeculation between diseased and healthy study populations would be 26 for the fractal method; 60 for the Petersen and 94 for the Jacquier technique (assuming power, 0.90; two-tailed a, 0.05). Conclusions Fractal analysis of LV trabeculae demonstrates good reproducibility and is more accurate in diagnosing LVNC than other techniques. The fractal dimension, if used in clinical trials would more than halve the number of patients required to detect clinically relevant differences in trabecular complexity.

Comparison of the Accuracy of CT Volume Calculated by Circumscription to Prolate Ellipsoid Volume (Bidimensional Measurement Multiplied by Coronal Long Axis)

Tumor volume is one of the most important factors in evaluating the response to treatment of patients with cancer. The objective of this study was to compare computed tomographic (CT) volume calculation using a semiautomated circumscribing tracing tool (manual circumscription [MC]) to prolate ellipsoid volume calculation (PEVC; bidimensional measurement multiplied by coronal long axis) and determine which was more accurate and consistent. The study included six patients with nine neoplasms, six phantoms, and two radiologists. The neoplasms and phantoms of varying sizes and shapes were imaged using multidetector CT scanners, with slice thicknesses ranging from 0.5 to 3 mm. Measurements were performed using a TeraRecon 3D workstation. Each lesion and phantom was manually circumscribed, and its three dimensions were measured. The measurements were repeated 2 weeks later. MC of the phantoms deviated from their true volumes by an average of 3.0 +/- 1%, whereas PEVC deviated by 10.1 +/- 3.99%. MC interobserver readings varied by 1.2 +/- 0.6% and PEVC by 4.8 +/- 3.3%. MC intraobserver readings varied by 1.95 +/- 1.75% and PEVC by 2.5 +/- 1.55%. Patient tumor volume predicted by MC and PEVC varied greatly; MC interobserver readings differed by 3.3 +/- 2.1% and PEVC by 20.1 +/- 10.6%. MC intraobserver readings varied by 2.5 +/- 1.9% and PEVC by 5.5 +/- 3.2%. Variability was greater for complex shapes than for simple shapes. Bidimensional analysis demonstrated an interobserver difference of 12.1 +/- 8.7% and an intraobserver difference of 5.05 +/- 3.3%. These results demonstrate large interobserver and intraobserver variability. Variability was greater for complex shapes than for simple shapes. MC of neoplasms provided more accurate and consistent volume predictions than PEVC. More complicated shapes demonstrated the superiority of MC over PEVC.

Accuracy of linear measurements using dental cone beam and conventional multislice computed tomography

The aim of this study was to evaluate the accuracy of linear measurements obtained with dental cone beam CT (CBCT) and multislice CT (MSCT) by altering radiation doses using pre-operative planning of the placement of oral implants as a model. A human cadaver mandible was examined in two edentulous areas and one dentate area using CBCT and MSCT. The mandible was examined both dry and immersed in sucrose solution isointense with soft tissue. Two readers measured four linear distances twice from each section. The mandible was cut into 4 mm thick slices at three marked places. These slices were microradiographed and used as the gold standard for measurements from each section. The intraclass correlations between the intra- and interobserver readings obtained with the different methods showed almost perfect matches. The measurement error (ME) showed significant differences between the methods studied (P = 0.022): the mean ME was 4.7% for CBCT and 8.8% for MSCT of the dry mandible, 2.3% and 6.6%, respectively, for the mandible immersed in sucrose solution and 5.4% for low-dose MSCT. Lowering the MSCT radiation dose to less than a quarter of its conventional original value did not significantly affect the ME. CBCT is a reliable tool for implant-planning measurements when compared with MSCT. In this study, a considerable radiation dose reduction could be achieved with low-dose MSCT examinations without a major loss of measurement accuracy.

Reliability of radiographical measurements of spondylolisthesis and extension-flexion radiographs of the lumbar spine

We studied the reliability of extension-flexion radiography by analysing intra-observer and inter-observer variations in measurements of 30 patients with established L5-S1 spondylolisthesis. The highest intra-observer angular variations among three radiologists were found at the L5-S1 level (mean 1.6°, S.D. 1.6°, max. 9°) and the highest sagittal translation also at the L5-S1 level (mean 0.6 mm, S.D. 0.8 mm, max. 4 mm). The highest angular inter-observer variation was found at the L5-S1 level (mean 2.6°, S.D. 2.3°, max. 11°) while the highest variation in sagittal translatory movement was found at the L4–L5 level (mean 1.4 mm, S.D. 1.2 mm, max. 6 mm). The mean intra-observer variation for L5 olisthesis was 1.0 mm (S.D. 0.9 mm, max. 5 mm) and the corresponding inter-observer variation 1.3 mm (S.D. 1.1 mm, max. 6 mm). Thus, in general, the overall consistency and concordance were good. The variations in intra-observer and inter-observer readings were similar. Variability in readings did not depend on the magnitude or abnormality of the readings. on the other hand, variability may occur because of difficulty in defining the exact landmarks used for the measurements. We point out that in certain cases the diagnostic value of one single reading of an extension-flexion radiography examination may be questionable.

Comparison of the Challenger Digital Applanation Tonometer and the Goldmann Applanation Tonometer

We compared the Challenger electronic tonometer to the Goldmann applanation tonometer in 70 eyes without corneal abnormalities. There was a good overall correlation between the two machines. Correlations between interobserver readings were excellent, demonstrating that obtaining reproducible measurements is possible with either machine. However, the scattergrams indicated that the Challenger tonometer gave consistently lower readings and showed more variability than the Goldmann tonometer. Additionally, the mean underestimation of intraocular pressure increased as the intraocular pressure increased above 20 mm Hg. Therefore, the Challenger electronic tonometer as presently calibrated is not accurate enough for clinical use in the detection and management of glaucoma.