Moderate Interobserver Reliability Research Articles

Validation of the visual body image classification in adolescent idiopathic scoliosis: a retrospective study.

A prospective study. To diagnose scoliosis, a visit to the hospital for radiography is typically necessary. In such cases, children with scoliosis are exposed to radiation, which may place their health at risk. Therefore, we sought to determine whether a classification method based on visual body images obtained through photography can be used to diagnose scoliosis. Scoliosis can be diagnosed and classified into various types using radiographs. However, no studies have attempted to classify scoliosis based on visual body images. From January 1, 2019 to December 31, 2022, 136 patients newly diagnosed with Adolescent idiopathic scoliosis and 124 healthy candidates from our institution were enrolled. This study classified body images into five types based on visual confirmation of the positional relationship of the body. The accuracy of this classification method was identified by calculating its sensitivity, specificity, and reproducibility of this classification method within and between observers according to kappa value. Overall, 136 patients and 124 control subjects who visited Pusan National University Hospital, Busan, Korea were photographed and compared by obtaining back images and X-ray radiographs. The sensitivity and specificity of the classification method showed a satisfactory-to-good degree of accuracy, although the degree varies depending on the visual body image type. The classification methods exhibited good intraobserver reliability (κ=0.855) and moderate interobserver reliability (κ=0.751). Our classification method showed a high degree of sensitivity and specificity (98.1% sensitivity, 98.9% specificity, and 98.4% accuracy) while exhibiting high reproducibility and ease of access. Based on our findings, we believe that our classification method can be used for scoliosis screening.

Interrater reliability of different scoring systems for drug-induced sleep endoscopy

PurposeTo explore the interobserver reliability of drug-induced sleep endoscopy (DISE) for patients with obstructive sleep apnea syndrome (OSAS) of two classification systems.MethodsDISE examinations were recorded digitally for all patients and were evaluated independently by five examiners blinded to all patient data. Areas of obstruction were rated using VOTE (velum, oropharynx lateral wall, tongue base, epiglottis) classification and PTLTbE (palate, tonsils, lateral pharyngeal wall, tongue base, epiglottis) classification. Additionally, palatal coupling was assessed during the jaw thrust maneuver. Interobserver reliability was evaluated with Fleiss’ kappa for categorical data and linearly weighted kappa for ordinal data.ResultsIn total, 123 patients were included in this study, 92 males and 31 females, with a mean (SD) age of 50.7 (12.1) years and a body mass index (BMI) of 28.3 (5.0) kg/m2. The mean apnea-hypopnea index was 22.2 (18) per hour, and the Epworth Sleepiness Scale was 7.3 (2.3). In our cohort, the interobserver reliability for the VOTE classification ranged from 0.32 to 0.59 and for the PTLTbE classification from 0.23 to 0.49 over all assessed levels, indicating fair to moderate interobserver reliability. The weighted kappa for palatal coupling was 0.37. In the VOTE classification, the level with the best agreement was the velum, while in PTLTbE, the best agreement was observed for tonsillar obstruction.ConclusionThe interrater agreement was fair to moderate for both classifications, with no clear superiority for one classification. The large variability shows the need to objectively quantify upper airway collapse during DISE and natural sleep endoscopy.

Comparison of remote and in-person respiratory function grading of brachycephalic dogs.

To compare the reliability of respiratory function grading (RFG) scores assigned in-person and remotely via video and electronic stethoscope recordings, evaluated by novice and expert graders. Prospective study. Fifty-seven brachycephalic dogs. Dogs were evaluated in person by expert graders and RFG scores were assigned. Audio and video recordings were made during the in-person evaluations. Four expert and four novice graders evaluated the recordings and assigned an RFG score to each dog. Agreement between in-person and remote RFG scores was assessed using Cohen's kappa statistic. Interobserver reliability was assessed using Fleiss' kappa statistic. The median RFG score from the in-person assessment was 1 (range, 0-3). Distribution of RFG scores included 12 grade 0 scores, 19 grade 1 scores, 25 grade 2 scores, and 1 grade 3 score. The raw percentage agreements between remote and in-person scores were 68.4%, 59.6%, 64.9%, and 61.4% for the four experts, and 52.6%, 64.9%, 50.9%, and 42.1% for the four novices. Reliability between remote and in-person RFG scores was poor to moderate both for the experts (Cohen's kappa: .48, .37, .46, .41) and novices (Cohen's kappa: .28, .47, .28, .21). Interobserver reliability was moderate among the experts (Fleiss' kappa: .59) and poor among the novices (Fleiss' kappa: .39). Remote RFG scores had poor to moderate interassessment and interobserver reliability. Novice evaluators performed worse than experts for remote or in-person RFG evaluations. Remote RFG, as measured in this study, is not reliable for assigning RFG scores. Modifications could be made to remote evaluation to improve reliability. Based upon the performance of novice evaluators, training of evaluators is justified.

The validity and reliability of CT scan based tibial plateau mapping for tibial plateau fractures

Introduction The Schatzker and computed tomography (CT)-based three-column classifications are the most used for tibial plateau fractures. The newer “10-segment classification” suggested to have better fracture identification and more accurate planning. This study aimed to assess the interobserver and intraobserver reliability of this new classification and to clarify its validity in clinical practice. Patients and methods A retrospective analysis of 30 patients with tibial plateau fractures who were admitted to a university hospital through the period between January 2020 and December 2022 was done. Patients with complete preoperative imaging, including radiographs, CT scans with three-dimensional reconstruction, and postoperative radiographs were included. Missing imaging, open fractures, pathological fractures, conservative management, or definitive fixation by circular external fixator were excluded. Data were reviewed independently by three expert trauma surgeons twice with 2-week intervals with randomization of case sequencing to evaluate their interobserver and intraobserver reliability for the Schatzker, CT-based three-column, and the new 10-segment classifications. The validity of the 10-segment classification was assessed by the agreement on the approach and implant position suggested by the observers. Results Good interobserver and intraobserver reliability was found as regards the Schatzker and CT-based three-column classifications on both intervals. Moderate and poor interobserver reliability “on both intervals respectively” and poor intraobserver reliability was found for the 10-segment classification. As regards the agreement on surgical approach on both time intervals, moderate and good interobserver agreements were found. For the implant position, poor interobserver agreement on both intervals was found. Intraobserver agreement for the surgical approach was good, while the intraobserver agreement for the implant position was moderate. Conclusion The Schatzker and CT-based three-column classifications are still more reliable than the newer 10-segment classification. This may be explained as it is still not familiar to surgeons and needs more training to be applied in clinical practice.

Effect of clinician's experience and expertise on the inter- and intra-observer reliability of the computed tomography-based classification systems in posterior malleolus fractures.

Three computed tomography (CT)-based classifications, including Haraguchi, Bartoníček-Rammelt, and Mason-Molloy systems, have been developed to better determine the characteristics of posterior malleolus fractures (PMFs). The aims of this study were (1) to determine the intra- and inter-observer reliability of the computed tomography-based classification systems and (2) to investigate the clinical experience and expertise on their reliabilities. Sixty-seven preoperative ankle CT scans of 67 adult patients with "ankle fracture with the involvement of the posterior malleolus"'' were retrospectively identified. CT images were assessed by 10 observers with different levels of clinical experience from 2 different specialties, including orthopedics and radiology. The observers were asked to classify PMFs according to 3 CT-based classifications on 2 separate occasions with a 4-week interval. Cohen's κ values were measured for 2 raters and Fleiss' κ values were measured for 3 raters and more. Overall, each classification had moderate to very good intraobserver reliability (κ=0.41 to 0.95, P < .01) as well as moderate interobserver reliability for each of the 2 separate assessments (κ=0.41 to 0.60, P < .01 for the first occasion; κ=0.44 to 0.59, P < .01 for the second occasion). Interobserver agreement among the foot and ankle surgeons regarding the Haraguchi and Bartoníček classifications was substantial for both assessment periods, whereas there was a moderate agreement for the Mason classification. Orthopedic residents showed moderate interobserver agreement in each period for both Bartoníček and Mason classifications. Radiology experts illustrated slight and fair agreements in the 2 assessments for Mason classification, moderate agreement in both assessments for Haraguchi classification, and substantial to moderate agreement in the first and second assessments for Bartoníček classification, respectively. Computed tomography-based classification system for PMFs demonstrated moderate interobserver reliability as well as moderate to very good intraobserver reliability. Moreover, foot and ankle specialists exhibit enhanced K values for both inter and intraobserver reliability for each classification system, consistency seems to increase as the interest in the field condenses.

In Which Cases Do We Operate? Posterior Malleolar Fractures-Intraobserver and Interobserver Reliability of the Bartoníček/Rammelt Classification and Corresponding Surgery Rates.

The Bartoníček/Rammelt classification is established for posterior malleolar fractures. It subdivides the fractures into 5 types and outlines treatment recommendations. This study aims to determine the intraobserver and interobserver reliability of the Bartoníček/Rammelt classification and investigates its applicability regarding treatment recommendations. Computed tomography (CT) scans of 80 ankle fractures with a posterior malleolar fracture were analyzed by four observers at two different time points 30 days apart (d1 and d2). Intrarater and interrater reliability was measured using kappa values. The corresponding surgery rates of the fracture subtypes were analyzed, and the surgery rates were correlated with fragment sizes and displacements. A moderate interobserver reliability for d1 0.41 (CI 0.35-0.47) and d2 0.42 (CI 0.36-0.48) was detected. Intraobserver reliability was documented as perfect, with a mean kappa of 0.83. Type II fractures were operated on in 50% of cases. In 50% of type II cases, a nonoperative treatment was chosen. Fragment size correlated strongly with the chosen therapy, and osteosynthesis was performed significantly more often when the fragment size exceeded 3 cm3 (P < .01). The Bartoníček/Rammelt classification system showed moderate interobserver reliability and perfect to substantial intraobserver reliability. In clinical practice of this study cohort, the size of the posterior malleolar fragment rather than the dislocation and joint impaction seemed to have the decision to operate on type II or III fractures. Existing treatment recommendations based on the Bartoníček/Rammelt classification correspond to the therapy algorithm carried out in this cohort of patients.Levels of Evidence: Level III: Retrospective study.

Inter-observer reliability in transect-based observations of environmental waste in greater accra and kisumu: implications for waste management

Transect surveys are widely used to quantify mismanaged plastic waste discarded to the environment. However, very few studies have quantified inter-observer reliability in environmental waste surveys. The aim of this study was to assess inter-observer reliability for a set of environmental waste indicators derived from transect surveys in slum areas of two sub-Saharan African cities. Pairs of observers independently recorded counts of scattered waste items, large waste piles, and burnt waste along 64 environmental transects in Kisumu, Kenya, and Greater Accra, Ghana. Concordance correlation coefficients were used to measure inter-observer reliability for derived indicators measuring mismanaged waste density, waste composition, waste origins of policy concern, and waste disposal practices. Evidence across all observers consistently showed that single-use disposable diapers, discarded Personal Protective Equipment, and bagged or bottled water are locally important constituents of mismanaged waste in both cities that should be addressed through urban waste management strategies. In both cities, there was generally excellent inter-observer reliability for density of burnt waste and density of large waste piles (concordance correlation coefficient > 0.9 for all but one observer pair), but weak to moderate inter-observer reliability for scattered waste density and densities of specific waste items such as disposable nappies and discarded Personal Protective Equipment. Our study shows that beach litter survey protocols can be adapted for use in slums. However, to generate robust estimates of scattered waste, its composition, and waste origins of policy concern in slums, assessment of inter-observer reliability should be incorporated into field team training.

Mayo classification of olecranon fractures revisited – Assessment of intra- and interobserver reliability based on CT scans

PurposeOlecranon fractures are classified using the commonly accepted Mayo classification. Its reliability has been analyzed by means of radiographs. A CT scan is often obtained due to joint involvement. Purpose of this study was to evaluate the intra- and interobserver reliability of the Mayo classification based on CT examination. MethodsRadiographic and CT images of 20 olecranon fractures were classified by four surgeons at two time points 30 days apart. Intra- and interobserver reliability were assessed using kappa coefficients. ResultsMean intraobserver reliability between X-rays was substantial and between CTs almost perfect (0.76 and 0.82, respectively). Mean interobserver reliability was fair for X-rays and moderate for CTs (0.32 and 0.44, respectively). ConclusionDespite the more detailed imaging compared with radiography only moderate interobserver reliability was found for the classification of olecranon fractures based on CT imaging. This might lead to inconsistent fracture classification in both scientific and clinical setting.

P229 Comparison of Different Histological Scoring Systems for Ulcerative Colitis [Nancy Histological Index, Robarts Histopathology Index and IBD-DCA (Inflammatory Bowel Disease-Distribution, Chronicity, Activity Score)] Among Specialists in GI Pathology and General Pathologists Pre- &amp; Post Workshop

Abstract Background Histopathology is an emerging treatment target and an important parameter in predicting clinical outcomes of patients with ulcerative colitis (UC). Histological scoring indices Nancy Histological Index (NHI) and Robarts Histopathology Index (RHI) have been developed and validated for UC. We aim to compare the inter-observer reliability of NHI, RHI and the recently described Inflammatory Bowel Disease-Distribution, Chronicity, Activity (IBD-DCA) Score among gastrointestinal (GI) pathologists versus general pathologists pre- and post-workshop to determine the scoring system with the best reproducibility. Methods Digital whole slide images of 20 H&amp;E-stained biopsies of ulcerative colitis (UC) cases are scored independently by 6 GI pathologists and 44 general pathologists that attended the Singhealth GI Pathology Course 2023 using NHI, RHI and IBD-DCA on the digital Pathpresenter platform. The 44 course participants performed the scoring before the course and again after attending a 3-hour IBD workshop on the assessment of histological remission using these 3 scoring systems. Data tabulation using “Free Online Surveys” platform is collated and intraclass correlation coefficient (ICC) of each component of the scoring indices is calculated. The ICC values of &amp;lt;0.5, 0.5–0.75, 0.75–0.9, and &amp;gt;0.9, indicate ‘poor’, ‘moderate’, ‘good’, and ‘excellent’ agreement, respectively. Results There is good inter-observer reliability for IBD-DCA ‘Activity’ component (ICC 0.85) and NHI (ICC 0.83) among GI pathologists while lBD-DCA ‘Distribution’ component (ICC 0.395) has the poorest agreement. Poor to moderate inter-observer reliability for all 3 scoring systems (ICC 0.4 – 0.6) is seen among the 44 participants pre-workshop with an observed post-workshop improvement, achieving best agreement for the NHI, ‘lamina propria neutrophils’ component of RHI and IBD-DCA ‘activity’ component (ICC 0.7). Conclusion GI pathologists are generally consistent in assessing disease activity in UC with good inter-observer reliability for NHI (a scoring system with an emphasis on activity grade) and only the ‘activity’ component of the IBD-DCA. Our study confirms NHI as a reliable scoring system for UC with the best reproducibility and favour its application to assess histological response in routine clinical practice to help gastroenterologists better manage patients with UC. We have also demonstrated that improvement in NHI scoring reproducibility can be achieved after training workshop for pathologists less familiar with the application of IBD histological scoring.

The PJI-TNM classification for periprosthetic joint infections.

This study aimed to evaluate the clinical application of the PJI-TNM classification for periprosthetic joint infection (PJI) by determining intraobserver and interobserver reliability. To facilitate its use in clinical practice, an educational app was subsequently developed and evaluated. A total of ten orthopaedic surgeons classified 20 cases of PJI based on the PJI-TNM classification. Subsequently, the classification was re-evaluated using the PJI-TNM app. Classification accuracy was calculated separately for each subcategory (reinfection, tissue and implant condition, non-human cells, and morbidity of the patient). Fleiss' kappa and Cohen's kappa were calculated for interobserver and intraobserver reliability, respectively. Overall, interobserver and intraobserver agreements were substantial across the 20 classified cases. Analyses for the variable 'reinfection' revealed an almost perfect interobserver and intraobserver agreement with a classification accuracy of 94.8%. The category 'tissue and implant conditions' showed moderate interobserver and substantial intraobserver reliability, while the classification accuracy was 70.8%. For 'non-human cells,' accuracy was 81.0% and interobserver agreement was moderate with an almost perfect intraobserver reliability. The classification accuracy of the variable 'morbidity of the patient' reached 73.5% with a moderate interobserver agreement, whereas the intraobserver agreement was substantial. The application of the app yielded comparable results across all subgroups. The PJI-TNM classification system captures the heterogeneity of PJI and can be applied with substantial inter- and intraobserver reliability. The PJI-TNM educational app aims to facilitate application in clinical practice. A major limitation was the correct assessment of the implant situation. To eliminate this, a re-evaluation according to intraoperative findings is strongly recommended.

Reliability of the 2018 Revised Version of AO/OTA Classification for Femoral Shaft Fractures.

The Arbeitsgemeinschaft für Osteosynthesefragen (AO) and the Orthopaedic Trauma Association (OTA) classification system for diaphyseal fracture has been recently revised to refine and enhance the accuracy of fracture categorization. This study aimed to investigate the interobserver reliability of the new AO/OTA classification and to compare it with the older version in femoral shaft fractures. We retrospectively analyzed 139 patients (mean age, 43.8 ± 19.5 years; 92 men and 47 women) with femoral shaft fractures who were treated from 2003 to 2017. Four well-trained observers independently classified each fracture following the previous and revised AO/OTA classification system. We calculated the Fleiss kappa for the interobserver reliability. The previous classification showed the kappa value of 0.580 (95% confidence interval [CI], 0.547-0.613), and the revised version showed 0.528 (95% CI, 0.504-0.552). Both the old and the revised versions showed moderate reliability. Our study highlights the moderate interobserver reliability of both the previous and new AO/OTA classification systems for diaphyseal femur fractures. These findings emphasize the importance of standardized systems in clinical decision-making and underscore the need for ongoing education and collaboration to enhance fracture classification.

The Reliability of Measurements for Tibial Torsion: A Comparison of CT, MRI, Biplanar Radiography, and 3D Reconstructions With and Without Standardized Measurement Training

Background: Accurate and reliable assessment of tibial torsion is important for the identification and treatment of tibial rotation malalignment; however, the ideal rotational measurement modality and technique are controversial. This study compares rotational measurements between computed tomography (CT), magnetic resonance imaging (MRI), biplanar erect radiograph (BER) reconstructions, and three-dimensional (3D) reconstructed CT before and after standardized training of observers to evaluate the reliability of each assessment method.Methods: Eight adult cadaveric specimens underwent CT, MRI, and BER imaging. Tibial torsion was measured by three independent observers (one resident and two experienced orthopaedic surgeons) both before and after standardized measurement instruction. Reliability for inter-observer measurement was evaluated using the Intraclass Correlation Coefficient (ICC). Measurement values for CT, MRI, and BER reconstructions were compared to 3D CT reconstructions analyzed using custom software to align and measure tibial torsion (used as the reference standard).Results: Before training, there was poor inter-observer reliability for CT (ICC=0.492, p=0.014) and moderate interobserver reliability for MRI (ICC=0.633, p=0.002). There was no inter-method reliability between 3D CT and MRI for two of the three surgeons and moderate to good reliability between 3D CT and CT. After training, the interobserver reliability for CT improved to 0.536 and the inter-observer reliability for MRI improved to 0.701. The BER measurements (no observer involvement) had moderate reliability compared to the 3D CT reconstructions (ICC=0.69, p=0.026). Measurement error was 4 degrees for CT pre-training and 7 degrees post-training, and 7 degrees for MRI pre-training and 8 degrees post-training.Conclusions: A standardized training regimen for MRI measurements improved both inter-observer and intraobserver reliability. Inter-method reliability between CT, MRI, and BER compared to reference 3D CT reconstructions demonstrated that all imaging modalities are a valid means to measure tibial rotation but differ in reliability from moderate to good. When assessing tibial torsional deformities, it is important to consider these variations from true rotation and feel comfortable using them for pre-operative planning purposes.Level of Evidence: N/A for a cadaveric imaging study Key Concepts•A standardized training regimen for MRI measurements of tibial torsion significantly improved inter-observer and intra-observer reliability.•CT, MRI, and BER measurements are valid imaging modalities compared to 3D CT reference standards for measuring tibial rotation.•Established manual measurements of tibial torsion from MRI may be improved with adequate training.•Measurement error of up to 8 degrees can be seen from true tibial torsion during the imaging assessment.

Diagnostic Yield of Combined Lumbar Puncture and Brain MRI in Critically Ill Patients With Unexplained Acute Encephalopathy: A Retrospective Cohort Study.

We sought to characterize the yield of combined LP and brain MRI (bMRI) in such patients as determined by both the frequency of abnormal results and the therapeutic efficacy of these investigations, that is, how often results changed management. Retrospective cohort study of medical ICU patients admitted to a tertiary academic center between 2012 and 2018 who had documented diagnoses of "AMS" and/or synonymous terms, no clear etiology of encephalopathy, and had undergone both LP and bMRI. The primary outcome was the frequency of abnormal diagnostic testing results determined objectively for LP using cerebrospinal fluid (CSF) findings and subjectively for bMRI through team agreement on imaging findings deemed significant through retrospective chart review. We subjectively determined the frequency of therapeutic efficacy. Finally, we analyzed the effect of other clinical variables on the likelihood of discovering abnormal CSF and bMRI findings through chi-square tests and multivariate logistic regression. One hundred four patients met inclusion criteria. Fifty patients (48.1%) had an abnormal CSF profile or definitive microbiological or cytological data by LP, 44 patients (42.3%) had bMRI with significant abnormal findings, and 74 patients (71.2%) had abnormal results on at least one of these investigations. Few clinical variables were associated with the abnormal findings in either investigation. We judged 24.0% (25/104) of bMRI and 26.0% (27/104) of LPs to have therapeutic efficacy with moderate interobserver reliability. Determining when to perform combined LP and bMRI in ICU patients with unexplained acute encephalopathy must rely on clinical judgment. These investigations have a reasonable yield in this selected population.

Relationship between Ventricular Size on Latest Ultrasonogram and the Bayley Scores ≥ 18 Months in Extremely Low Gestational Age Neonates: A Retrospective Cohort Study.

A ventricle-to-brain index (VBI) >0.35 is associated with low scores on the Bayley Scales of Infant and Toddler Development, Third Edition (BSID-III) in preterm infants with birth weight <1,250 g. However, VBI obtained at the third ventricle has only moderate interobserver reliability. The objective of this study was to test (1) reliability of VBI measured at the foramen of Monro on the latest ultrasonogram (US) before discharge using the intraclass correlation coefficient (ICC) and (2) the relationship between VBI and BSID-III scores at ≥18 months corrected age. The present study is a single-center retrospective cohort study. The study included 270 preterm infants born at 230/7 to 286/7 weeks of gestational age. The ICC of VBI between independent measurements by two study radiologists on the first 50 patients was 0.934. Factors associated with the value of VBI included severe intraventricular hemorrhage, bronchopulmonary dysplasia, and systemic steroid administration for BPD but not postmenstrual age. In multivariate analysis, VBI was negatively and independently associated with cognitive (p = 0.002), language (p = 0.004), and motor (p < 0.001) BSID-III scores. The association between VBI and BSID-III scores was observed even in infants in whom the latest US was obtained before term equivalent age. The association between VBI and BSID-III scores was also observed after excluding those with severe intraventricular hemorrhage. In this very preterm cohort the measurement of VBI had excellent reliability. Moreover, VBI measurements were negatively associated with motor, language, and cognitive BSID-III scores. · Mean values of VBI are stable with postmenstrual age.. · Values at the foramen of Monro are reliable and reproducible.. · VBI is negatively associated with Bayley scores.. · The association is observed even before term age..

Periprosthetic humerus fractures after shoulder arthroplasty: an evaluation of available classification systems

Periprosthetic proximal humerus fractures (PPHFs) are a detrimental complication of shoulder arthroplasty, yet their characterization and management have been poorly studied. We aimed to determine the intra- and interobserver reliability of 4 previously described PPHF classification systems to evaluate which classifications are the most consistent. We retrospectively reviewed 32 patients (34 fractures) that were diagnosed with a PPHF between 1990 and 2017. Patient electronic medical records and research electronic data capture (REDCap) were used for data collection. Post-PPHF radiographs in multiple views for all 34 cases were organized into an encrypted, randomized Qualtrics survey. Four blinded fellowship-trained shoulder and elbow surgeons graded each fracture using previously reported classification systems by (1) Wright and Cofield (1995), (2) Campbell etal (1998), (3) Worland etal (1999), and (4) Groh etal (2008), along with selecting a preferred management strategy for each fracture. Grading was performed twice with at least 2 weeks between each randomized attempt. Intraobserver reliability was calculated as an unweighted Cohen kappa coefficient between attempt 1 and attempt 2 for each surgeon. Interobserver reliability and agreeability between surgeons' preferred management strategies were calculated for each classification system using Fleiss kappa coefficient. The kappa coefficients were interpreted using the Landis and Koch criteria. The average intraobserver kappa coefficient for each classification was as follows: Wright and Cofield=0.703, Campbell=0.527, Worland=0.637, Groh=0.699. The overall Fleiss kappa coefficient for interobserver reliability for each classification was as follows: Wright and Cofield=0.583, Campbell=0.488, Worland=0.496, Groh=0.483. Interobserver reliability was significantly greater with the Wright and Cofield classification. Using Landis and Koch criteria, all the classification systems assessed demonstrated only moderate interobserver agreement. Additionally, the mean interobserver agreeability kappa coefficient for preferred management strategy was 0.490, indicating only moderate interobserver agreement. There is only moderate interobserver reliability among the 4 PPHF classification systems and the preferred management strategy for the fractures assessed. Of the 4 PPHF classification systems, Wright and Cofield demonstrated the greatest mean intraobserver reliability and overall interobserver reliability. Our study highlights a need for the development of a PPHF classification system that can achieve high intra- and interobserver reliability and that can allow for a standardized treatment algorithm in the management of PPHFs.

The Lateral Drawer Test: A New Clinical Test to Assess Mortise Instability in Weber B Fibula Fractures.

Background:Assessment of mortise stability is paramount in determining appropriate management of ankle fractures. Although instability is readily apparent in bimalleolar or trimalleolar ankle fractures, determination of instability in the isolated Weber B fibula fracture often requires further investigation. Prior authors have demonstrated poor predictive value of physical examination findings such as tenderness, ecchymosis, and swelling with instability. The goal of this study is to test the validity of a new clinical examination maneuver, the lateral drawer test, against the gravity stress view (GSV) in a cohort of patients with Weber B fibula fractures. Secondary goals included assessing pain tolerability of the lateral drawer test, as well as testing interobserver reliability.Methods:Sixty-two patients presenting with isolated fibula fractures were prospectively identified by an orthopaedic nurse practitioner or resident. Three nonweightbearing radiographic views of the ankle as well as a GSV were obtained. Radiographs were not visualized before conducting the lateral drawer test. Two foot and ankle fellowship–trained orthopaedic surgeons performed and graded the lateral drawer test. Radiographs were then examined and medial clear space (MCS) was measured. Visual analog scale (VAS) pain scores were obtained before and after testing. The results of the lateral drawer test were compared with radiographic measurements of MCS on GSV. A cadaveric experiment was devised to assess interobserver reliability of the lateral drawer test.Results:Thirty (48%) of 62 consecutively enrolled patients demonstrated radiographic instability with widening of the MCS ≥5 mm on GSV. When correlated with MCS measurement, the lateral drawer test demonstrated a sensitivity of 83%, specificity of 97%, positive predictive value (PPV) of 96%, and negative predictive value (NPV) of 86%. There was a strong correlation between the lateral drawer test grade and amount of MCS widening (Spearman correlation ρ = 0.82, P < .005). Patients tolerated the maneuver well with an average increase of 0.7 on the VAS pain scale. Testing of 2 observers utilizing the cadaveric model demonstrated a Cohen’s Kappa coefficient of 0.7 indicating moderate interobserver agreement.Conclusion:The lateral drawer test demonstrates high sensitivity, specificity, PPV, and NPV with moderate interobserver reliability compared with the MCS on GSV in patients presenting with Weber B fibula fractures. Although further external validation is required, the lateral drawer test may offer an adjunct tool via physical examination to help determine mortise stability.Level of Evidence:Level II, Prospective Cohort Study.

Contrast-enhanced ultrasound for the evaluation of symptomatic and asymptomatic carotid plaques: A systematic review and meta-analysis.

Contrast-enhanced ultrasound (CEUS) is a promising imaging modality for the assessment of plaque vulnerability. We aimed to systematically review and meta-analyze the ability of CEUS parameters to differentiate between symptomatic and asymptomatic carotid plaques and to assess its reproducibility. PubMed, EMBASE, and Cochrane Library databaseswere searched for studies that potentiallyevaluated carotid plaques using CEUS. From the initial 2870 searches, 11 relevant publications comprising a total of 821 carotid plaques were reviewed. Data on CEUS parameters including quantitative and semi-quantitative parameters were extracted and analyzed. The overall analysis showed significantly higher CEUS parameters in symptomatic carotid plaques compared to asymptomatic carotid plaques (standardised mean difference (SMD) .95, 95% confidence interval (CI) .56-1.27, p<.01). Intra and inter-observer reproducibility of quantitative CEUS parameters were excellent (intra-observer, r=.95, 95% CI .87-1; inter-observer, r=.93, 95% CI .80-.1). Semi-quantitative CEUS parameters showed good intra-observer reliability and moderate inter-observer reliability (intra-observer, r=.77, 95% CI .64-.89; inter-observer, r=.75, 95% CI .61-.89). Heterogeneity among studies compared CEUS parameters in symptomatic and asymptomatic plaques and studies assessed inter-observer reproducibility, and significant biases in studies assessing CEUS reproducibility were present. CEUS is a useful vascular imaging method to differentiate between symptomatic and asymptomatic carotid plaques with moderate to excellent reproducibility. Quantitative CEUS analysis appeared to be more sensitive and reliable in assessing carotid plaques than semi-quantitative parameters. Further longitudinal prospective trials evaluating carotid plaque in asymptomatic population using CEUS to determine plaque characteristics that can become symptomatic are required.

The Linear Hallux Valgus Offset– A novel way to measure Hallux Valgus

IntroductionHallux Valgus (HV) is a complex deformity involving the first ray of the forefoot and a common cause of forefoot pain. Several radiological measurements such as Hallux Valgus Angle (HVA), First Metatarsophalangeal Angle (IMA) and Distal metatarsal articular angle (DMAA) exist to calculate the severity of HV and direct patient management. However, these are angular measurements are prone to error with variable intra- and inter-observer reliability. PurposeTo describe a new radiological linear hallux valgus offset (LHVO) to measure HV deformity. Patient and methodsWe performed a retrospective cohort study looking at Antero-posterior, weight-bearing foot radiographs of 100 consecutive patients with forefoot pain referred to our foot and ankle clinic. Demographic details, clinical indication, HVA (hallux valgus angle) and LHVO were measured for each patient and data were analyzed using the student t-test. Intraclass Correlation Coefficient (ICC) analysis was evaluated to assess the intra-class reliability between observers. ResultsThere was a female predominance of approximately 2:1, with 51.3 years (range 13–86 years). There was a statistically significant difference of LHVO between normal and hallux valgus cohorts with a p-value of 0.0001. The LHVO gave moderate intra-observer and inter-observer reliability on ICC analysis of 0.7. ConclusionThe LHVO can be an additional measure of assessing severity of hallux valgus. In contrary to the traditional angular measurements, this linear measure is easier to calculate and reproducible on plain, weight bearing radiographs. LHVO measurement has shown a moderate inter-observer reliability in the study to complement traditional radiological evaluation of hallux valgus alignment.

Reliability of Magnetic Resonance Imaging Interpretation of Lateral Discoid Meniscus: A Multicenter Study

Background:Lateral discoid meniscus (LDM) often present with complex morphology that can be challenging to assess and treat arthroscopically. Preoperative magnetic resonance imaging (MRI) is frequently used for diagnosis and surgical planning, however it is not known whether surgeons are reliable and consistent in their interpretation of MRI findings.Hypothesis/Purpose:We hypothesize that surgeons experienced in treating LDM are able to reliably interpret discoid pathology using MRI, with the exception of evaluating dynamic factors (i.e. instability).Methods:Forty five discoid meniscus MRI selected from a pool of surgical discoid meniscus cases were included in this review. Five reviewers (experienced pediatric sports medicine surgeons) who were not involved in the MRI selection process performed independent review of each MRI to determine discoid meniscus classification. More than 4 weeks later, a second reading was performed by 3 of the 5 reviewers. Interobserver and intraobserver reliability of the primary (width, presence of instability or tear) and secondary (location of instability or tear, tear type) rating factors was assessed using the Fleiss κ coefficient, designed for multiple readers with nominal variables (reliability: fair, 0.21–0.40; moderate, 0.41–0.60; substantial, 0.61–0.80; excellent, 0.81–1.00). Reliability is reported as κ (95% CI).Results:Interobserver reliability of assessment of meniscal width was substantial 0.67 (0.58-0.76), and intraobserver was moderate 0.52 (0.35-0.69). Assessment of presence of peripheral instability had moderate interobserver reliability 0.54 (0.45-0.63) and substantial intraobserver 0.61 (0.44-0.78). Presence of tear had fair interobserver reliability 0.39 (0.29–0.48) and substantial intraobserver 0.68 (0.51-0.85). When identifying location of instability or tear, interobserver reliability was moderate while intraobserver agreement was substantial for assessment of anterior instability (0.47 (0.37-0.56) and 0.68 (0.51-0.85), respectively); posterior instability (0.56 (0.47-0.65) and 0.62 (0.45-0.79), respectively); and posterior tear (0.41 (0.32-0.50) and 0.69 (0.52-0.86), respectively). The exception was identifying anterior tear, with fair interobserver reliability 0.33 (0.23-0.42) and moderate intraobserver 0.56 (0.39-0.73); Interobserver reliability was fair for tear type 0.34 (0.28-0.41) and intraobserver reliability moderate 0.55 (0.43-0.67).Conclusion:Orthopaedic surgeons experienced in the treatment of LDM vary from each other in their classification using MRI, especially with regard to assessment of meniscus tears. MRI evaluation may be helpful to diagnose discoid by width and identify presence of instability, two major factors in the decision to proceed with surgery. However, definitive treatment should be guided by a comprehensive arthroscopic evaluation.

MRI quantification of femoral neck version using the posterior lesser trochanteric line: a comparison of three measurements.

To validate MRI for the quantification of the femoral neck version (FNV) using posterior lesser trochanteric Line (PLTL) and to compare reliability of the PLTL to the epicondylar and retrocondylar measurements. A retrospective review of 3T MRI scans performed for femoroacetabular impingement (FAI). Two musculoskeletal radiologists performed the measurements. MRI measurements of the PLTL were compared to CT using Bland Altman, Lin's concordance, and Lin's correlation coefficients. Interobserver reliability was determined using Bland Altman, Lin's concordance, and Lin's correlation coefficients. Intraobserver reliability was determined using Lin's concordance and Lin's correlation coefficients. Forty-five patients (90 lower extremities) met the inclusion criteria. Ages ranged from 20 to 41years, with a mean of 31.5years. There were 22 females and 23 males. Lin's concordance correlation coefficient for MRI and CT measurements of PLTL was substantial: 0.96 (95% CI: 0.94-0.98). PLTL Lin's correlation coefficient was 0.825 (95% CI 0.732-0.918) and indicated good interobserver reliability. Epicondylar and retrocondylar methods Lin's correlation coefficients demonstrated moderate interobserver reliability at 0.601 (0.415-0.786) and 0.632 (0.456-0.807), respectively. There was moderate 95% confidence interval overlap between the PLTL and the other measurements. Bland-Altman plots for each measurement were similar and demonstrated no bias. There was excellent intraobserver reliability (> 0.900) with significant 95% confidence interval overlap. MRI measurements of the PLTL are comparable to CT. The PLTL has good reliability between readers for the quantification of FNV using MRI, which could help avoid unnecessary radiation exposure using CT and reduce MRI scan time.