Interrater Intrarater Intraclass Correlation Coefficients Research Articles

Lung ultrasound score in dogs and cats: A reliability study.

Lung ultrasound (LUS) is a noninvasive tool for examining respiratory distress patients. The lung ultrasound score (LUSS) can be used to quantify and monitor lung aeration loss with good reliability. Assess the reliability of a new LUSS among raters with different levels of experience and determine how well the same raters agree on identifying patterns of LUS abnormalities. Forty LUS examinations of dogs and cats and 320 videos were reviewed from a digital database. Retrospective reliability study with post hoc analysis. Protocolized LUS were randomly selected; intrarater and interrater reliability of the LUSS and pattern recognition agreement among 4 raters with different levels of experience in LUS were tested. The intrarater intraclass correlation coefficient (ICC) single measurement, absolute agreement, and 2-way mixed effects model was 0.967 for the high-experience rater (H-Exp), 0.963 and 0.952 for the medium-experience raters (M-Exp-1; M-Exp-2), and 0.950 for the low-experience rater (L-Exp). The interrater ICC average measurement, absolute agreement, and 2-way random effects model among the observers was 0.980. The Fleiss' kappa (k) values showed almost perfect agreement (k = 1) among raters in identifying pleural effusion and translobar tissue-like pattern, strong agreement for A-lines (k = 0.881) and B-lines (k = 0.806), moderate agreement (k = 0.693) for subpleural loss of aeration, and weak agreement (k = 0.474) for irregularities of the pleural line. Our results indicate excellent intra- and interrater reliability for LUS scoring and pattern identification, providing a foundation for the use of the LUSS in emergency medicine and intensive care.

Intra- and inter-rater reliability, agreement, and minimal detectable change of the handheld dynamometer in individuals with symptomatic hip osteoarthritis.

The handheld dynamometer has been validated to measure muscle strength in different muscle groups. However, to date, it has not been tested in individuals who experience pain induced by hip osteoarthritis. The current study aimed to evaluate the intra- and inter-rater reliability, agreement, and minimal detectable change of the Lafayette handheld dynamometer, model 1165, to assess the peak force (Pk) and average peak force (Af) of hip muscles in individuals with symptomatic hip osteoarthritis. Twenty participants with hip osteoarthritis (mean ± SD age: 58.7±15.3 years; body mass index: 28.8±4.2 kg/m2) and pain intensity on the Visual Analogue Scale ≥ 4 (8.05±1.2) were recruited to participate in this study. Pk and Af of hip flexors (seated position), abductors and adductors (supine position), and extensors (prone position) were collected in a single day by two independent raters, each one obtaining test and retest in randomly ordered separate sessions. The intra-rater intraclass correlation coefficient (ICC) was classified as good (>0.75) or excellent (≥0.90) for all muscle groups and all inter-rater ICCs were classified as excellent. Rater A had a lower standard error of measurement compared to rater B, ranging from 0.15 to 0.58 kilogram-force (Kgf) compared with 0.34 to 1.25 kg, respectively. However, the inter-rater comparison showed a minimal detectable change (MDC) of < 10% for all Pk and Af measures for hip adductors and extensors. Finally, the inter-rater Bland-Altman analysis demonstrated good agreement for abductors, adductors, and extensors. Despite pain and dysfunction related to hip osteoarthritis, the mean of two measures using a handheld dynamometer was shown to be a reliable tool to assess hip muscle strength, with good to excellent intra- and inter-rater ICCs, satisfactory agreement, and small values for MDC.

Validationof the Spanish version of the Sunnybrook facial grading system.

The Sunnybrook facial grading system (SFGS) is one of the most widely employed tools to assess facial function. The present study aimed to determine the validity and reliability of the Spanish language version of the SFGS. Forward-backward translation from the original English version was performed by fluent speakers of English and Spanish. Videos from 65 patients with facial paralysis (FP) were evaluated twice by five otolaryngologists with experience in FP evaluation. Internal consistency and intra- and inter-rater reliability were assessed. The House-Brackmann scale was used to display concurrent validity which was established by Spearman's rho correlation. The Cronbach's α score exceeded 0.70. The intra-rater intraclass correlation coefficient (ICC) was nearly perfect for the composite score (0.96-0.99), voluntary movements (0.97-0.99), and synkinesis (0.91-0.98), and important to almost perfect for symmetry at rest (0.79-0.97). In both evaluations, the inter-rater ICC was higher than 0.90 for the composite score (0.92-0.96) and voluntary movements (0.91-0.96) and slightly lower for symmetry at rest (0.66-0.85) and synkinesis (0.72-0.87). A strong negative correlation was found between the H-B scale and SFGS (Spearman's rho coefficient = -0.92, p < 0.001) in both evaluations. The Spanish version of the SFGS is a reliable and valuable instrument for the assessment of facial function in the diagnosis and treatment of patients with FP.

Relative Validity and Reliability of Isometric Lower Extremity Strength Assessment in Older Adults by Using a Handheld Dynamometer.

Handheld dynamometry (HHD) is a practical alternative to traditional testing of lower extremity strength. However, its reliability and validity across different populations and settings are not clear. We hypothesize that HHD is a valid and reliable device to assess lower extremity strength in a population of older adults. Cross-sectional/cohort. Level 3. This study included 258 older adults (≥65 years). Isometric knee extension and flexion force were measured by 1 examiner, using an HHD (n = 222), including 3 repetitions to calculate within-day intrarater reliability. These measurements were repeated by the examiner in a subgroup (n = 23) to analyze intrarater reliability over a test-retest period of on average 8 weeks. In addition, HHD force measures were performed by a second examiner (n = 29) to analyze interrater reliability. In another subgroup (n = 77), isometric knee extension and flexion torque were measured by 1 examiner using both the HHD and Biodex System 4 to assess relative validity. HHD and Biodex measurements were highly correlated and showed excellent concurrent validity. HHD systematically overestimated torque as compared with Biodex by 8 N·m on average. Same-day intrarater intraclass correlation coefficients (ICCs) ranged from 0.97 to 0.98. Interrater reliability ICCs ranged from 0.83 to 0.95. HHD represents a reliable and valid alternative to Biodex to rank individuals on leg strength, or to assess within-person changes in leg strength over time, because of the high validity and reliability. The HHD is less suited for absolute strength assessment because of significant systematic overestimations. Clinicians are encouraged to use HHD to rank older adults on leg strength, or to assess within-person changes in leg strength over time, but not to compare readings with cut-offs or normative values.

Correlation of Pulmonary Function to Novel Radiographic Parameters of Collapsing Parasol Deformity in Spinal Muscular Atrophy.

Spinal muscular atrophy (SMA) is a neuromuscular disease with manifestations of scoliosis, pulmonary function decline, and, uniquely, collapse of the ribs. Methods to quantify rib deformity and its impact on pulmonary function are sparse. The authors propose new radiographic measurements to quantify the aspect of SMA known as collapsing parasol deformity and correlate these measurements with pulmonary function. Twenty-eight full-spine radiographs of pediatric SMA patients were measured twice by 3 independent investigators, with 2 weeks separating each measurement. Radiographic measurements, demographics, spirometry results, and assisted ventilation rating were obtained. Twenty-one patients with spirometry metrics were assessed to correlate pulmonary function and spinal measurements. The intrarater intraclass correlation coefficient (ICC) for the measurements ranged from 0.706 to 0.99, and the interrater ICC ranged from 0.64 to 0.97. Eighteen of 19 variables had ICC values greater than 0.75 for inter- and intrarater reliability. Twenty-one patients with forced expiratory volume in 1 second and forced vital capacity were assessed in terms of these measurements. Ratio of the concave hemithoracic width at T6/convex hemithoracic width at T6 (P=.004) and ratio of convex vertical rib displacement at the apical rib/concave vertical rib displacement (P=.021) were both significantly correlated with decreased pulmonary function. No significant correlation was found examining the average vertical rib displacement at the apical rib. High inter-and intrarater reliability can be obtained in a variety of spinal measurements of SMA patients. Various measurements are correlated to diminished pulmonary function, specifically variables showing asymmetric changes in the chest cavity. [Orthopedics. 2021;44(2):e287-e293.].

Ultrasound Assessment of Weight-Bearing and Non-Weight-Bearing Meniscal Extrusion: A Reliability Study.

Ultrasound has become a useful instrument in evaluating musculoskeletal pathology. Recent studies suggest that ultrasound imaging of weight-bearing menisci may enhance the assessment of knee pathology, such as osteoarthritis (OA) and meniscal injuries. The primary aim of this study was to determine the intrarater and interrater reliability of ultrasound measurements of medial meniscal extrusion (MME) after a brief training session. Prospective reliability study. Physical medicine and rehabilitation (PM&R) department within a tertiary care institution. Forty-five participants (29 female, 16 male) were recruited to serve as models, 24 of whom had healthy knees and 21 of whom had radiographically confirmed medial compartment knee OA. Three physician sonographers (1 = experienced, 1 = sports medicine fellow, 1 = post-graduate year [PGY]-4 PM&R resident) were recruited to serve as operators. Operators received a brief training session on identifying and measuring MME. All operators measured bilateral MME in each model in the standing and supine positions on two separate days. Operators were blinded to all measurements. Primary outcomes were inter- and intrarater intraclass correlation coefficients (ICCs) of MME measurements among operators with different levels of ultrasound experience. Supine MME intrarater reliability ICCs were 0.927, 0.885, and 0.780 for the experienced physician, sports medicine fellow, and PGY-4 operators, respectively. Standing MME intrarater reliability ICCs were 0.941, 0.902, and 0.824 for the experienced physician, sports medicine fellow, and PGY-4 operators, respectively. Interrater reliability ICCs were 0.896 and 0.842 for supine and standing measurements, respectively. There was a statistically significant increase in intrarater reliability with experience between the PGY-4 resident and experienced physician operators. Operators with different levels of ultrasound experience demonstrated good MME measurement intra- and interrater reliabilities in both supine and standing positions.

Italian Version of the Jebsen-Taylor Hand Function Test for the Assessment of Hand Disorders: A Cross-Sectional Study.

Having a test to evaluate hand function is fundamental to occupational therapy practice. To assess the psychometric properties of the Italian version of the Jebsen-Taylor Hand Function Test (JTHFT). Cross-sectional study. Three health care institutions in Rome, Italy. 136 people with injuries, burns, or neurological diseases of the hand. No intervention was provided. We administered the JTHFT, an assessment of fine motor skills during performance of activities of daily living, and compared results with dynamometer readings. The mean ± standard deviation total time required to perform all subtests was 89.47 ± 67.98 s for the dominant hand (DH) and 167.11 ± 257.58 s for the nondominant hand (NDH). Reliability procedures were applied to data from 51 participants; mean intrarater intraclass correlation coefficient (ICC) was .814 for the DH and .981 for the NDH, and mean interrater ICC was .818 for the DH and .821 for the NDH. Pearson's correlation coefficients were significant. Results support the use of the Italian version of the JTHFT as a measure of functional dexterity in people with upper limb disorders. The JTHFT is a valid and reliable assessment tool for nonspecific hand diseases. Italian health professionals can now use the JTHFT with more confidence.

Influence of Radiographic Viewing Perspective on Glenoid Inclination Measurement.

IntroductionThe purposes of this study were to determine (1) whether glenoid inclination (GI) could be accurately measured on plain radiographs as compared to a gold-standard 3-dimensional (3D) measure and (2) whether GI could be reliably measured on plain radiographs.Materials and MethodsDigitally reconstructed radiographs (DRRs) were made from 3D computed tomography reconstructions of 68 normal cadaver scapulae. DRRs were made in a variety of viewing angles. Inclination was measured on these DRRs. These measurements were also made using a gold-standard 3D method. Measurements were made by 2 orthopedic surgeons and 1 surgeon twice, to calculate interrater and intrarater intraclass correlation coefficients (ICCs).ResultsThe gold-standard 3D β was 83 ± 5° (72°–98°). On neutral plain radiographs, the mean ± standard deviation 2D β angle was 80 ± 6° (range, 66°–99°). With regard to accuracy, the 2D β angle was significantly different from the 3D β angle, with the 2D β underestimating the 3D β by 5° (95% confidence intervals −1 to 12). With regard to reliability, interrater ICCs for 2D β with a neutral viewing angle was 0.79. Two-dimensional β varied widely with viewing angle from 0.24 to 0.88. Interrater ICCs for the 3D method was 0.83 (0.60–0.92). Intrarater ICCs for all 3 techniques were high (>0.91).ConclusionsTwo-dimensional radiographic GI measurement is not accurate, as it underestimates the 3D value by an average of 5° when compared to the gold-standard 3D measurement. GI 2D measurement reliability varies with viewing angle on plain radiographs and thus to accurately and reliably measure inclination 3D imaging is necessary.

Intra- and Interrater Reliability of Sagittal Spinopelvic Parameters on Full-Spine Radiographs in Adults With Symptomatic Spinal Disorders.

Background/AimsTo evaluate the intra- and interrater reliability (I-IR) of sagittal spinopelvic parameters from digital full-spine plain radiographs with basic software tools in an unselected adult population with degenerative spinal complaints who were evaluated for surgery. MethodsForty-nine adult full-spine digital radiographs were measured twice by 3 independent observers, including an experienced spine surgeon, an experienced radiologist, and a resident orthopedic surgeon. Clinical picture archiving and communication system workstations and software tools were used and landmarks were set manually. The I-IR of the sagittal vertical axis (SVA), pelvic tilt (PT), pelvic incidence (PI), sacral slope (SS), and thoracic kyphosis in T4–T12 (TK) were assessed. ResultsThe intrarater intraclass correlation coefficient (ICC) scores varied from 0.82 to 0.99. The interrater ICC scores ranged from 0.78 to 0.99. The intrarater standard error of measurement (SEM) values for SS, PT, PI, and TK varied from 0.8° to 5.0°, and the interrater SEM values ranged from 2.5° to 6.2°, depending on the parameter and the reading round. The I-IR SEM values for SVA varied from 2.2 to 5.7 mm and from 4.6 to 5.0 mm, respectively. Kappa values were >0.88 for all readers. The intrarater variability was the smallest for the most experienced rater. ConclusionThe I-IR of measuring sagittal spinopelvic parameters on digital full-spine images with basic software tools was high. Parameters consisting of several anatomic landmarks were more liable to error. Rater experience had a positive influence on reliability and repeatability. Reader experience should be assessed before accepting measurements for surgical planning and the interpretation of surgical correction during postoperative follow-up.

Evaluation of retinal nerve fiber layer defect using wide-field en-face swept-source OCT images by applying the inner limiting membrane flattening.

PurposeThe assessment of retinal nerve fiber layer defects (RNFLDs) is a useful part of glaucoma care. Here, we obtained en-face images of retinal layers below the inner limiting membrane (ILM) with swept source-optical coherence tomography (SS-OCT), and measured RNFLD angle with new software.MethodsThis study included 105 eyes of 105 normal tension glaucoma (NTG) patients (age, 59.8 ± 13.2). Exclusion criteria were best-corrected visual acuity < 0.5, axial length > 28 mm, non-glaucoma ocular disease, and systemic disease affecting the visual field. We obtained 12 x 9 mm 3D volume scans centered on the macula with SS-OCT (DRI OCT-1, Topcon), and from these scans, created 3 averaged en-face images, each comprising 7 horizontal en-face images (total thickness: 18.2 μm). We labeled these averaged images, according to their depth below the ILM, as en-face images 1 (shallowest), 2 (middle) and 3 (deepest). In each image, a circle was drawn centered on the disc, with a radius of half the distance between the centers of the disc and macula. The investigator marked points where the edge of the RNFLD intersected this circle, and RNFLD angle (RNFLDA) was calculated with new software. Finally, we analyzed the association between RNFLDA, cpRNFLT, weighted RGC count (wrgc) and Humphrey field analyzer (HFA)-measured mean deviation (MD) and hemifield total deviation (TD), both overall and in each hemifield.ResultsEn-face image 2 had the highest interclass reproducibility for measuring RNFLDA (intra-rater intraclass correlation coefficient (ICC): 0.988, inter-rater ICC: 0.962). The correlation coefficients with RNFLDA were: HFA MD, -0.60; superior TD, -0.73; inferior TD, -0.69; overall cpRNFLT, -0.27; superior hemifield cpRNFLT, -0.39; and inferior hemifield cpRNFLT, -0.53 (all p<0.001).ConclusionsRNFLDA measured in SS-OCT images had high reproducibility and was correlated to glaucoma severity. Our new method may be a valuable future part of glaucoma care.

Reliability of Ultrasonography in Evaluating Hyoid Bone Movement

BackgroundTimely and adequate laryngeal elevation along with hyoid bone movement is an essential component of the swallowing movement under normal physiological conditions. The purpose of this study was to verify the reproducibility of using ultrasonography to evaluate hyoid bone displacement during swallowing through the assessment of inter- and intrarater reliability and examine its accuracy by comparing the results with videofluoroscopic swallowing study (VFSS). MethodsA self-designed water balloon was fixed to the transducer, which provided good contact between the transducer and the submental skin. Ten participants with dysphagia were recruited. The measurements of hyoid bone displacement using ultrasonography were performed by two of the authors. All the participants underwent ultrasonographic examinations and VFSS within 24 hours. ResultsThe intrarater intraclass correlation coefficient (ICC) of the two examiners was 0.996 and 0.959, respectively (p<0.01); the interrater ICC between the two examiners was 0.892 (p<0.05). ICCs between VFSS and ultrasonography for two researchers were 0.815 and 0.916 (p<0.01). ConclusionSubmental ultrasonography is a reliable and accurate method for assessing the hyoid bone movement.

Is Pes Cavus Alignment Associated With Lisfranc Injuries of the Foot?

Lisfranc (tarsometatarsal joint) injuries are relatively rare, accounting for less than 1% of all fractures, and as many as 20% of subtle Lisfranc injuries are missed at the initial patient presentation. An undiagnosed Lisfranc injury can have devastating consequences to the patient. Therefore, any factor that can raise a clinician's index of suspicion to make this diagnosis is potentially important. The cavus foot has been associated with various maladies of the lower extremity, but to our knowledge, it has not been reported to be associated with Lisfranc injury. Do patients who experience a low-energy Lisfranc injury have greater talar head coverage and a greater talo-first metatarsal angle than control subjects? A retrospective, case-control study was conducted from September 2011 to December 2014 to identify patients diagnosed and treated for a low-energy Lisfranc injury. Twenty-three adult patients with an average age of 42.6 years (SD, 16.3 years) were identified and compared with 61 adult control subjects with an average age of 49.4 years (SD, 14.1 years). Control subjects came from the practice of a fellowship-trained foot and ankle orthopaedic surgeon. Control subjects underwent a history and physical, clinical examination, and diagnostic imaging to confirm that they had no prior foot disorder, no prior foot surgeries, were within 3 years of age of a patient with a Lisfranc injury, and were independent ambulators. Two authors (DSD and JDP) measured the talonavicular and talo-first metatarsal angles on weightbearing AP and lateral radiographs of the foot. The intrarater reliability and interrater reliability for the talo-first metatarsal angle and the talonavicular angle showed high agreement. The intrarater intraclass correlation coefficients (ICC) of the talo-first metatarsal angle were 0.94 (95% CI, 0.91-0.96) and 0.93 (95% CI, 0.9-0.96). For the talonavicular angle the ICCs were 0.83 (95% CI, 0.75-0.89) and 0.88 (95% CI, 0.81-0.92) for Raters 1 and 2 respectively. The interrater ICCs were 0.91 (95% CI, 0.69-0.96) for the talo-first metatarsal angle and 0.9 (95% CI, 0.85-0.94) for the talonavicular angle. The patients and controls were compared to determine if the patients who sustained a Lisfranc injury were more likely to have a pes cavus foot alignment. We performed a mixed modeling analysis to control for potential cofounding variables and determine if there was an association of Lisfranc injury with the talo-first metatarsal angle and the talonavicular angle. After controlling for confounding variables such as the effect of the measurement round effect and the effect of the rater, our repeated measures analysis via mixed model showed patients were associated with a higher talo-first metatarsal angle than control subjects (adjusted least square mean for patients = 3.05; for controls = -2.65; mean difference, 5.7; p = 0.001). Repeated measures analysis via mixed model showed that patients also were associated with a more positive talonavicular angle than control subjects (adjusted least square mean for patients = -4.83, for controls = -11; mean difference, 6.17; p = 0.002). Patients with Lisfranc injuries had a higher mean talo-first metatarsal angle than did control subjects (1.9° ± 7.9° versus -2.2° ± 7.3°; mean difference, 4.1°; 95% CI, -7.7° to -0.5°; p = 0.028), and less talar uncovering (-4.2° ± 9.7° versus -11° ± 8°; mean difference, 6.7°; 95% CI, -6.7° to -10.8°; p = 0.001). We found that cavus midfoot alignment was more prevalent among patients with Lisfranc injuries than among individuals with no foot injury or disorder. Although this does not suggest that cavus alignment causes or predisposes patients to this injury, we believe the finding is important because this provides a radiographic parameter that clinicians can use to raise their index of suspicion for a Lisfranc injury and aggressively pursue this diagnosis. Future studies would benefit from obtaining contralateral foot imaging at the time of injury in all patients with Lisfranc injury or prospectively following patients with foot imaging and recording the incidence of future foot injury. Level III, prognostic study.

First quality score for referral letters in gastroenterology—a validation study

ObjectiveTo create and validate an objective and reliable score to assess referral quality in gastroenterology.DesignAn observational multicentre study.Setting and participants25 gastroenterologists participated in selecting variables for a Thirty Point Score...

Measurement Properties of Instruments for Measuring of Lymphedema: Systematic Review.

Lymphedema is a common complication of cancer treatment, resulting in swelling and subjective symptoms. Reliable and valid measurement of this side effect of medical treatment is important. The purpose of this study was to provide best evidence regarding which measurement instruments are most appropriate in measuring lymphedema in its different stages. The PubMed and Web of Science databases were used, and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed. Clinical studies on measurement instruments assessing lymphedema were reviewed using the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) scoring instrument for quality assessment. Data on reliability, concurrent validity, convergent validity, sensitivity, specificity, applicability, and costs were extracted. Pooled data showed good intrarater intraclass correlation coefficients (ICCs) (.89) for bioimpedance spectroscopy (BIS) in the lower extremities and high intrarater and interrater ICCs for water volumetry, tape measurement, and perometry (.98-.99) in the upper extremities. In the upper extremities, the standard error of measurement was 3.6% (σ=0.7%) for water volumetry, 5.6% (σ=2.1%) for perometry, and 6.6% (σ=2.6%) for tape measurement. Sensitivity of tape measurement in the upper extremities, using different cutoff points, varied from 0.73 to 0.90, and specificity values varied from 0.72 to 0.78. No uniform definition of lymphedema was available, and a gold standard as a reference test was lacking. Items concerning risk of bias were study design, patient selection, description of lymphedema, blinding of test outcomes, and number of included participants. Measurement instruments with evidence for good reliability and validity were BIS, water volumetry, tape measurement, and perometry, where BIS can detect alterations in extracellular fluid in stage 1 lymphedema and the other measurement instruments can detect alterations in volume starting from stage 2. In research, water volumetry is indicated as a reference test for measuring lymphedema in the upper extremities.

Feasibility of the Medial Temporal lobe Atrophy index (MTAi) and derived methods for measuring atrophy of the medial temporal lobe.

Introduction: The Medial Temporal-lobe Atrophy index (MTAi), 2D-Medial Temporal Atrophy (2D-MTA), yearly rate of MTA (yrRMTA) and yearly rate of relative MTA (yrRMTA) are simple protocols for measuring the relative extent of atrophy in the medial temporal lobe (MTL) in relation to the global brain atrophy. Albeit preliminary studies showed interest of these methods in the diagnosis of Alzheimer’s disease (AD), frontotemporal lobe degeneration (FTLD) and correlation with cognitive impairment in Parkinson’s disease (PD), formal feasibility and validity studies remained pending. As a first step, we aimed to assess the feasibility. Mainly, we aimed to assess the reproducibility of measuring the areas needed to compute these indices. We also aimed to assess the efforts needed to start using these methods correctly.Methods: A series of 290 1.5T-MRI studies from 230 subjects ranging 65–85 years old who had been studied for cognitive impairment were used in this study. Six inexperienced tracers (IT) plus one experienced tracer (ET) traced the three areas needed to compute the indices. Finally, tracers underwent a short survey on their experience learning to compute the MTAi and experience of usage, including items relative to training time needed to understand and apply the MTAi, time to perform a study after training and overall satisfaction.Results: Learning to trace the areas needed to compute the MTAi and derived methods is quick and easy. Results indicate very good intrarater Intraclass Correlation Coefficient (ICC) for the MTAi, good intrarater ICC for the 2D-MTA, yrMTA and yrRMTA and also good interrater ICC for the MTAi, 2D-MTA, yrMTA and yrRMTA.Conclusion: Our data support that MTAi and derived methods (2D-MTA, yrMTA and yrRTMA) have good to very good intrarater and interrater reproducibility and may be easily implemented in clinical practice even if new users have no experience tracing the area of regions of interest.

Knee Function Assessment in Patients With Meniscus Injury: A Preliminary Study of Reproducibility, Response to Treatment, and Correlation With Patient-Reported Questionnaire Outcomes.

Background:Outcomes of meniscus surgery are typically assessed with patient questionnaires that help capture symptoms and functional limitations but may not provide an accurate representation of underlying joint health. There are currently no performance-based measures of knee function in patients with symptomatic meniscus injury.Purpose:To assess the reproducibility, response to partial meniscectomy, and correlation with patient-reported questionnaire outcomes of novel performance-based knee function tests.Study Design:Cohort study (diagnosis); Level of evidence, 2.Methods:A battery of 9 tests for activities that require knee movements essential for everyday living was developed. Intra- and interrater reproducibility was assessed in 50 meniscus tear patients completing the battery at 2 preoperative assessments with either the same or different examiners. Response to arthroscopic partial meniscectomy was evaluated in 35 of these patients 6 weeks after surgery. Subjects also completed the Knee Injury and Osteoarthritis Outcome Score (KOOS) and International Knee Documentation Committee (IKDC) questionnaires pre- and postoperatively.Results:The intrarater intraclass correlation coefficients (ICCs) were excellent for all tests (ICC > 0.8). Interrater ICC > 0.8 was observed for step-down, stair descent, star lunges, and timed treadmill travel. Performance on all tests improved significantly with surgery (P < .05), with the greatest improvement in sit-to-stand and stair ascent and descent. A greater percentage response to surgery was seen on questionnaire outcomes (20%-65%) than on performance-based tests (3%-15%). Moderate to poor correlations existed between the KOOS activities of daily living subscale and the performance-based tests (all ICCs ≤ 0.4).Conclusion:Performance-based knee function tests demonstrated good reproducibility and responsiveness in patients undergoing partial meniscectomy.Clinical Relevance:As both patient perception and functional performance are determinants of patient outcomes, questionnaires and performance-based tests could be used simultaneously to provide complementary data to monitor short- and long-term outcomes after meniscus surgery.

A new scoring system for upper airway pediatric sleep endoscopy.

Sleep-associated upper-airway obstruction in children is a significant cause of morbidity. Development of a simple, standardized, quantitative technique to assess anatomic causes of sleep-related breathing disorder is important for surgical planning, clinical communication, and research. To design, implement, and evaluate a scoring system to quantify airway obstruction in pediatric drug-induced sleep endoscopy. This study was a retrospective case series conducted at a tertiary pediatric hospital. The patients were children with sleep-related breathing disorder who underwent polysomnography and drug-induced sleep endoscopy. Flexible fiber-optic laryngoscopy was performed. Endoscopic examinations were recorded on video and assessed by 4 independent raters based on a scoring template. Five locations in the upper aerodigestive tract (adenoid, velum, lateral pharyngeal wall, tongue base, and supraglottis) were evaluated on a 4-point scale for minimum and maximum obstruction. Internal reliability was assessed by calculating interrater and intrarater intraclass correlation coefficients (ICCs). For external validation, aggregate and site-specific scores were correlated with preoperative polysomnographic indices. Videos recorded of sleep endoscopies from 23 children (mean age, 2.2 years) were reviewed and rated. Children had an average apnea-hypopnea index of 24.8. Seventy percent of interrater and intrarater ICC values (7 of 10 for each set) were above 0.6, demonstrating substantial agreement. Higher total obstructive scores were associated with lower oxygen saturation nadir (P = .04). The scoring system was also used to quantitatively identify children with multilevel airway obstruction, who were found to have significantly worse polysomnographic indices compared with children with single-level obstruction (P = .02). The proposed scoring system, which is designed to be easy to use and allow for subjectivity in evaluating obstruction at multiple levels, nonetheless achieves good internal reliability and external validity. Implementing this system will allow for standardization of reporting for sleep endoscopy outcomes, as well as aid the practicing clinician in the interpretation of sleep endoscopy findings to inform site-directed surgical intervention in cases of complicated obstructive sleep apnea.

Construction and pilot assessment of the Upper Limb Assessment in Daily Living Scale

ObjectiveThe upper limb function of hemiplegic patients is currently evaluated using scales that assess physical capacity or daily activities under test conditions. The present scale, the Upper Limb Assessment in...

Examination of intra and interrater reliability with a new ultrasonographic reference atlas for scoring of synovitis in patients with rheumatoid arthritis

ObjectiveSynovitis in patients with rheumatoid arthritis (RA) may be scored semiquantitatively (0–3) for B-mode (BM) and power Doppler (PD) ultrasonography. The objective was to assess the reliability of BM and...

P‐Wave Indices, Distribution and Quality Control Assessment (from the Framingham Heart Study)

P-wave indices of maximum P-wave duration and P-wave dispersion have been examined in a broad array of cardiovascular and noncardiovascular disease states. The P-wave indices literature has been highly heterogeneous in measurement methodologies, described quality control metrics, and distribution of values. We therefore sought to determine the reproducibility of P-wave indices in a community-based cohort. P-wave indices were measured in sequential subjects enrolled in the Framingham Heart Study. Electrocardiograms were obtained at the 11th biennial visit of the Original Cohort (n = 250) and the initial visit of the Offspring Cohort (n = 252). We determined the mean P-wave durations, interlead correlations, and P-wave indices. We then chose 20 ECGs, 10 from each cohort, and assessed intrarater and interrater variability. The maximum P-wave duration ranged from 71 to 162 ms with mean of 112 + or - 12 ms. The minimum P-wave duration ranged from 35 to 103 ms with mean of 65 + or - 10 ms. P-wave dispersion ranged from 12 to 82 ms. The mean P-wave dispersion was 48 + or - 12 ms (40-56). The intrarater intraclass correlation coefficient (ICC) was r = 0.80 for maximum P-wave duration and r = 0.82 for P-wave dispersion. The interrater ICC was 0.56 for maximum P-wave duration and 0.70 for P-wave dispersion. We demonstrated excellent intrarater reproducibility and fair interrater reproducibility for calculating P-wave indices. Reproducibility is frequently lacking in studies of P-wave indices, but is an essential component for the field's growth and epidemiologic contribution.