Substantial Intrarater Reliability Research Articles

Reliability and Validity Analysis of the Distal Radioulnar Joint Ballottement Test

Triangular fibrocartilage complex injuries can cause distal radioulnar joint (DRUJ) instability, which can be evaluated clinically with the DRUJ ballottement test. However, the reliability and validity of the test are unclear. This study aimed to analyze the reliability and validity of the test using a tracking device on healthy participants and patients with triangular fibrocartilage complex injuries. In this cross-sectional study, three orthopedic hand surgeons performed the DRUJ ballottement test using a technique of holding the carpal bones to the radius on 25 healthy participants (50 hands; 10 men and 15 women; mean age, 33 years; range, 20-51 years) and eight patients with triangular fibrocartilage complex injuries (16 hands; six men and two women; mean age, 43 years; range, 27-59 years). We used a three-dimensional electromagnetic tracking device to quantify the movement of the DRUJ and verify the reliability and validity of the test. The intrarater and interrater intraclass correlation coefficients for DRUJ movement were 0.77 and 0.61, respectively, and the kappa coefficient for grading of DRUJ instability was 0.79. The correlation coefficient between DRUJ movement measured using the tracking device and instability judged clinically was 0.77. A comparison of healthy participants and the patients showed significantly greater DRUJ movement in the patients. The test showed substantial intrarater and interrater reliability for assessing DRUJ movement and instability. The significant positive correlation between DRUJ movement and instability indicates the concurrent validity of the test. Moreover, the test showed discriminative validity in identifying mild or moderate DRUJ instability. The DRUJ ballottement test using the holding technique has a relatively high diagnostic accuracy and can be used to assess DRUJ instability.

Grading reflective essays: the construct validity and reliability of a newly developed Tool- GRE-9

BackgroundThe main objective of this study is to assess the construct validity and reliability of the Grading Reflective Essays-9 (GRE-9).MethodsThis study took place in a major tertiary academic medical center in Beirut, Lebanon. 104 reflective essays written by years 1–3 residents in the department of Family Medicine at the American University of Beirut Medical Center (AUBMC) were graded by 2 trained raters who independently scored the essays using GRE-9. GRE-9 scores were then correlated with scores on communication skills OSCE stations and in-training examinations to investigate, respectively, convergent and divergent validity. One of the 2 raters scored the essays twice one month apart to assess the reliability of the GRE-9 using intra rater reliability and internal consistency.ResultsThere was a weak, non-significant correlation between GRE-9 score and In training examination (ITE) score (r = − .213, p = .395). There was a moderate, non-significant correlation between GRE-9 scores and the Objective structured clinical examination (OSCE) communication station scores (r = − .412 p = .162). The correlation coefficient between trails 1 and 2 was significant (r = .832, p = .000). Intra class correlation coefficient (ICC) analysis demonstrated almost perfect intra-rater agreement (0.819; 95% CI: 0.741–0.875) of the test ratings over time.ConclusionsGRE-9, is a short, concise, easy-to-use reliable grading tool for reflective essays that has demonstrated moderate to substantial intra-rater reliability and evidence of divergent validity. The study found non-significant correlations between reflective writing scores OSCE communication scores demonstrating a lack of relationship between reflective writing and this measure of performance.

How well do we assess the adequacy of bending films in scoliosis?

To determine whether side-bending films in scoliosis are assessed for adequacy in clinical practice; and to introduce a novel method for doing so. Six surgeons and eight radiographers were invited to participate in four online surveys. The generic survey comprised erect and left and right bending radiographs of eight individuals with scoliosis, with an average age of 14.6 years. Respondents were asked to indicate whether each bending film was optimal (adequate) or suboptimal. In the first survey, they were also asked if they currently assessed the adequacy of bending films. A similar second survey was sent out two weeks later, using the same eight cases but in a different order. In the third survey, a guide for assessing bending film adequacy was attached along with the radiographs to introduce the novel T1-45B method, in which the upper endplate of T1 must tilt ≥ 45° from baseline for the study to be considered optimal. A fourth and final survey was subsequently conducted for confirmation. Overall, 12 (86%) of 14 respondents did not use any criteria to assess the bending film adequacy; the remaining two each described a different invalidated method. In total, 12 (86%) of the respondents felt T1-45B was easy to learn and apply. There was fair to substantial intra-rater reliability (k = 0.25 to 0.88) which improved to fair to almost perfect (k = 0.38 to 0.88) post-introduction of the guide. Inter-rater reliability varied considerably among the rater groups but similarly increased following introduction of the guide (kS1 = 0.19 to 0.34, kS2 = 0.33 to 0.43 vs kS3 = 0.49 to 0.5, kS4 = 0.35 to 0.43). Many surgeons and radiographers do not assess spinal bending films for adequacy. We propose that the change in the plane of the upper endplate of T1 on side-bending can be used in this evaluation. In the T1-45B method, a change of ≥ 45° on side bending qualifies as an adequate bend effort.

Existing Bowel Preparation Quality Scales Are Reliable in the Setting of Centralized Endoscopy Reading.

Development of bowel preparation products has been based upon colon cleansing rating by a local endoscopist. It is unclear how bowel preparation scales perform when centrally evaluated. To evaluate the reliability of bowel preparation quality scales when assessed by central readers. Four central readers evaluated 52 videos in triplicate, 2weeks apart, during the entire endoscopic procedure (insertion/withdrawal of the colonoscope) and exclusively on colonoscope withdrawal using the Boston Bowel Preparation Scale (BBPS), Chicago Bowel Preparation scale, Harefield Cleansing Scale, Ottawa Bowel Preparation Quality Scale (OBPQS), Aronchick score, a visual analogue scale, and additional items proposed in a modified Research and Development/University of California Los Angeles appropriateness process. Reliability was assessed with intraclass correlation coefficients. Intraclass correlation coefficients (95% confidence interval) for inter-rater reliability of the quality scales ranged from 0.51 to 0.65 (consistent with moderate to substantial inter-rater reliability) during the entire procedure. Corresponding intraclass correlation coefficients for intra-rater reliability ranged from 0.69 to 0.77 (consistent with substantial intra-rater reliability). Reliability was highest in the right colon and lowest in the left colon. No differences were observed in reliability when assessed for the procedure overall (insertion/withdrawal) relative to assessment on withdrawal alone. All five bowel preparation quality scales had moderate to substantial inter-rater reliability. Panelists considered the Aronchick score too simplistic for clinical trials and recognized that assessment of residual fluid in the Ottawa Bowel Preparation Quality Scale was not amenable to central assessment.

Reliability and validity of the gait classification system in children with cerebral palsy (GCS-CP)

BackgroundGait classification systems (GCS) may enable clinicians to differentiate gait patterns into clinically significant categories that assist in clinical decision-making and assessment of outcomes. Davids and Bagley in 2014 [1] described a GCS for children with cerebral palsy (GCS-CP). The purpose of our study was to use the GCS-CP for the first time on a sample of patients with CP and to evaluate the reliability and utility of the classification system. MethodsThe gait of 131 children with CP was retrospectively reviewed and classified according to Davids and Bagley’s classification using two-dimensional (2D) video and three-dimensional (3D) lower limb kinematics and kinetics. Gross Motor Function Classification System (GMFCS) levels were determined, and the Gait Profile Scores (GPS) calculated to characterize the sample concerning gait classification. The comparison between the groups was performed using the Kruskal-Wallis test with respect to the non-normal distribution of the data. The intrarater and interrater reliability was determined using the Kappa index (k) statistics with 95% CI. ResultsAll GCS-CP groups were represented within the evaluated sample. Of the 131 cases evaluated, 127 (96.95%) were able to be classified with respect to sagittal plane stance phase gait deviations. All patients in the sample were able to be classified with respect to sagittal plane swing phase and transverse plane gait deviations. The interrater reliability was 0.596 and 0.485 for the first and second levels of the classification, respectively, according to the Fleiss’s Kappa statistics. Intrarater reliability was 0.776 and 0.714 for the raters one and two, respectively, according to the Cohen’s Kappa statistics. SignificanceThe GCS-CP exhibited clinical utility, successfully classifying almost all subjects with CP in two planes, based upon kinematic and kinetic data. The classification is valid and has moderate interrater and moderate to substantial intrarater reliability.

The Clinical Significance of the Modic Changes Grading Score.

Cross-sectional retrospective observational study. To evaluate the reliability and clinical utility of the Modic changes (MC) grading score. Patients from the Danish national spine registry, DaneSpine, scheduled for lumbar discectomy were identified. MRI of patients with MC were graded based on vertical height involvement: Grade A (<25%), Grade B (25%-50%), and Grade C (>50%). All MRIs were reviewed by 2 physicians to evaluate the reliability of the MC grade. Of 213 patients included, 142 patients had MC, 71 with MC-1 and 71 with MC-2; 34% were Grade A, 45% were Grade B, and 21% were Grade C. MC grade demonstrated substantial intra-rater (κ = .68) and inter-rater (κ = .61) reliability. A significantly higher proportion (n = 40, 57%) of patients with MC-1 had a severe MC grade compared to patients with MC-2 (n = 30, 43%, P < .001). Severe MC grade was associated with the presence of severe lumbar disc degeneration (DD) (Pfirrmann grade = V, P = .024), worse preoperative ODI (52.49 vs 44.17, P = .021) and EQ-5D scores (.26 vs .46, P = .053). MC alone including type was not associated with a significant difference in patient-reported outcomes (P > .05). The MC grade score was demonstrated to have substantial intra- and inter-observer reliability. Severe MC grade was associated with both severe DD and MC type, being more prevalent in patients with MC-1. The MC grade was also significantly associated with worse disability and reduced health-related quality of life. Results from the study suggest that MC grade is more clinically important than MC type.

Reliability of new radiographic measurement techniques for elbow bony impingement.

BackgroundIdentifying the location and scale of radiographic changes in elbow bony impingement (EBI) is critical in formulating an appropriate diagnosis and treatment plan for such patients. The purpose of present study was to evaluate the intra-rater and inter-rater reliability of the new radiographic parameters, Anterior Impingement angle (AIa) and Posterior Impingement angle (PIa), for EBI. In addition, to determine if there was a relationship between radiographic parameters and clinical evaluation.Patients and methodsThree raters of different levels of training evaluated the radiographs of 60 patients (30 in EBI group and 30 in normal group) twice, at least 2 weeks apart. Intra-rater and inter-rater reliabilities were calculated by Intraclass Correlation Coefficients (ICC) with 95% confidence intervals. Correlation between radiographic parameters and clinical evaluation was calculated by Pearson correlation coefficient.ResultsIn both groups, intra-rater and inter-rater reliabilities were substantial. There were no significant differences in reliability between upper-hand expert surgeons and resident for either measurement. Good correlation was observed between impingement arcs and range of motion values.ConclusionsBoth AIa and PIa measurements demonstrated substantial intra-rater and inter-rater reliability for normal radiographs and in EBI patients. Good reliability, for either expert surgeons or residents in training, and good correlation between radiographic measurements and manual testing, appoints this method may be easily and reliably used in every day practice.

Utility of lateral scapular radiographs in initial evaluation of nontraumatic shoulder conditions

Lateral scapular radiographs have been routinely included in the initial radiographic examination of both traumatic and nontraumatic shoulder conditions. With the advance of modern imaging modalities, the clinical utility of the lateral scapular view has become questionable. The purpose of the study was to assess the utilization of the lateral scapular view among the members of the American Shoulder and Elbow Surgeons (ASES) and to determine the clinical utility of the lateral scapular view in the initial evaluation of nontraumatic shoulder conditions. The study consisted of two parts. The first part involved an online survey of ASES members, which asked them 3 questions regarding their preference for radiographic evaluation of new patients with nontraumatic shoulder pain. The second part involved a clinical vignette-based survey, where 4 shoulder surgeons at our institution were given 50 clinical vignettes and asked to independently answer 4 questions regarding the most probable diagnosis, abnormal radiographic findings, further imaging studies, and treatment plan for each case. The survey was repeated twice; the first was given without a lateral scapular view, and the second given 4 weeks later with a lateral scapular view included. We obtained diagnostic accuracy and percent agreement of each surgeon over two surveys and intraobserver and interobserver reliability on each variable. Of a total of 235 ASES members who responded to the online survey, 193 (82.1%) indicated their routine use of a lateral scapular view. The most common reason for obtaining the view was better characterization of acromion morphology (75.4%). The clinical vignette-based survey showed substantial intrarater reliability (κ > 0.6) of the 4 surgeons between the two surveys for the most probable diagnosis, abnormal x-ray findings, and further imaging studies, while the intrarater reliability for treatment plan was moderate (κ= 0.548). The mean diagnostic accuracy of the 4 surgeons was almost equal (74% vs. 75%) between the surveys. Overall, each surgeon's percent agreement across the 2 surveys was over 70%. None of the 4 surgeons recommended a lateral scapular view for further imaging during the first survey; each wanted either advanced imaging (computed tomography, magnetic resonance imaging) or none. The addition of a lateral scapular radiograph in the presence of other orthogonal views does not appear to improve surgeons' diagnostic accuracy or affect their decision-making on the treatment plan in nontraumatic shoulder conditions. The clinical utility of the lateral scapular view may need to be reassessed in this setting.

Accuracy and reliability of left atrial appendage morphology assessment by new 3D transesophageal echocardiographic rendering modalities: a comparative study with computed tomography

Abstract Funding Acknowledgements Type of funding sources: None. Background/Introduction. Left atrial appendage (LAA) morphology assessed by contrast-enhanced computed tomography (CT) has been associated to the risk of cardioembolic stroke in non-valvular atrial fibrillation. Subsequent studies with the traditional LAA classification system (CS) into 4 morphologies (Chicken wing, Cauliflower, Cactus and Windsock) yielded mixed results in terms of reliability and stroke risk association. Recently, a simple LAA morphology CS (new-LAAcs) based on the LAA bend angle measurement has been suggested. Three-dimensional transesophageal echocardiography (3D TOE) quality imaging has been improved and new volume rendering modalities developed. Purpose. Aim of this study was to evaluate the accuracy and reliability of 2D and new 3D TOE rendering modalities compared to CT in assessing LAA morphology. We used and validated a new simple LAA morphology classification system (new-LAAcs) based on the LAA bend angle in contrast to the traditional CS. Methods. 50 consecutive patients who underwent both cardiac CT and TOE were enrolled. LAA morphology was assessed by three different TEE modalities: (1) 2D TOE inspective evaluation (2D TOE), (2) 3D TOE multiplanar reconstruction (3D TOE MPR) and (3) 3D TOE Philips TrueVue Glass rendering (3D TOE GLASS). We assessed TOE accuracy compared to CT by sensitivity, specificity, accuracy, and Cohen’s kappa. Two trained readers independently adjudicated LAA morphologies in the new-LAAcs and the inter-rater reliability was obtained by percentage agreement and Cohen’s kappa. The reliability of the new- vs. traditional-LAAcs was assessed by CT in terms of reliability rates and influence on LAA morphology prevalence. Results. CT and TOE imaging analyses were feasible in all patients. 2D TOE was fairly accurate in identifying LAA morphology (κ 0.38, p = 0.022) and had only moderate inter-rater (κ 0.46, p = 0.027) and substantial intra-rater (κ 0.62, p = 0.003) reliability rates. 3D TOE showed high validity: 3D TOE MPR had an almost perfect accuracy (κ 0.84, p &amp;lt; 0.001) and substantial (κ 0.77, p &amp;lt; 0.001) inter-rater reliability; 3D TOE GLASS substantial accuracy (κ 0.67, p &amp;lt; 0.001) and almost perfect (κ 0.82, p &amp;lt; 0.001) inter-rater reliability. Intra-rater agreement was almost perfect for both 3D TOE modalities (κ 0.84, p &amp;lt; 0.001). In the comparison among CS the traditional-LAAcs inter-rater reliability was moderate (κ 0.47, p &amp;lt; 0.001) and the intra-rater reliability substantial (κ 0.68, p &amp;lt; 0.001) while the new-LAAcs yielded an almost perfect reliability level (inter-rater κ 0.84, p &amp;lt; 0.001 and intra-rater κ 0.93, p &amp;lt; 0.001). With the traditional-LAAcs, the prevalence of CW LAA was 30 (60%), while with the new-LAAcs the prevalence of low-risk-LAA was 13 (26%), leading to classify 17 (57%) CW morphologies as high-risk-LAA. Conclusions. 3D TOE is an accurate, reliable, and feasible alternative to CT in assessing LAA morphology with the new-LAAcs. The new-LAAcs shows higher reliability rates than the traditional one. Abstract Figure. Abstract Figure.

Inter-rater Reliability of the Classification of the J-Sign Is Inadequate Among Experts.

The purpose of this study was to determine the inter-rater and intra-rater reliability of the symmetry, classification, and underlying pathoanatomy associated with the J-sign in patients with recurrent lateral patellofemoral instability. Blinded, inter-rater reliability study. N/A. Thirty patellofemoral joint experts. Thirty clinicians independently assessed 30 video recordings of patients with recurrent lateral patellofemoral instability performing the J-sign test. Raters documented J-sign symmetry and graded it according to the quadrant and Donell classifications. Raters indicated the most significant underlying pathoanatomy and presence of sagittal plane maltracking. Intra-rater reliability was assessed by 4 raters repeating the assessments. Mean pairwise simple and/or weighted Cohen's kappa were performed to measure inter-rater and intra-rater reliability, as well as calculation of percent agreement. J-sign symmetry demonstrated fair inter-rater reliability (k = 0.26), whereas intra-rater reliability was moderate (k = 0.48). Inter-rater reliability for the quadrant and Donell classifications indicated moderate agreement, k = 0.51 and k = 0.49, respectively, whereas intra-rater reliability was k = 0.79 and k = 0.72, indicating substantial agreement. Inter-rater reliability of the foremost underlying pathoanatomy produced only slight agreement (k = 0.20); however, intra-rater reliability was substantial (k = 0.68). Sagittal plane maltracking demonstrated slight inter-rater agreement (k = 0.23) but substantial intra-rater agreement (k = 0.64). The symmetry, classification, and underlying pathoanatomy of the J-sign demonstrated fair to moderate inter-rater reliability and moderate to substantial intra-rater reliability among expert reviewers using video recordings of patients with recurrent lateral patellofemoral instability. These findings suggest individual raters have a consistent standard for assessing the J-sign, but that these standards are not reliable between assessors. III.

Validated 5‐point photonumeric scales for the assessment of the periorbital region

The objective of this investigation was to create and validate 5-point photonumeric scales for the assessment of dynamic crow's feet, static crow's feet, and infraorbital hollows. Three novel 5-point photonumeric scales were created by a medical team. A total of 12 raters from all over the world performed a digital validation, and a total of 5 raters a live validation of the created scale. The statistical analysis revealed almost perfect intra-rater and inter-rater reliability in the digital validation of the scales for the assessment of static and dynamic crow's feet as well as infraorbital hollows. In the live validation, both crow's feet scales showed almost perfect intra-rater reliability, while the Croma Infraorbital Hollow Assessment Scale showed substantial intra-rater reliability. Inter-rater reliability was substantial for all three scales in the live validation. All three scales, the Croma Dynamic Crow's Feet Assessment Scale, Croma Static Crow's Feet Assessment Scale, and Croma Infraorbital Hollow Assessment Scale, were validated digitally and in a live setting. The created scales to assess infraorbital hollowing, dynamic and static crow's feet have been shown to provide substantial to almost perfect agreement in the digital and live validation and can thus be considered as helpful tools in the clinical and research setting. While technical methods and appliances to assess the degrees of severity of age-dependent features are advancing, validated scales are of great importance due to their ease of use and, as shown by the validations, reliability, and reproducibility.

Usefulness Of Lateral Scapular View In Initial Evaluation Of Patients With Nontraumatic Shoulder Pain

Traditional evaluation of non-traumatic shoulder pain (NTSP) involves four radiographic views of the joint: AP, Grashey (G), axillary (AX), and lateral scapular (LS). The LS view has historically been useful in diagnosing various glenohumeral injuries. However, some studies have questioned the clinical utility of the LS view. PURPOSE: To determine if including the LS view makes meaningful contribution to accurate diagnosis and treatment plan for NTSP. METHODS: Two sets of fifty clinical vignettes were developed based on patients who presented with NTSP. Each set included identical patient history and physical exam findings, but different radiographs. The first set included AP, G, and AX views. The second set included AP, G, AX, and LS views. Four independent raters initially evaluated the first set of vignettes and provided diagnoses, need for further imaging, and treatment recommendations. Each rater repeated the evaluation one month later with the second set of vignettes. Cohen’s kappa was used to assess intra-observer reliability across both sets of vignettes. A survey was also created and distributed to members of American Shoulder and Elbow Surgeons (ASES) to evaluate how often surgeons utilize the LS view, and for what reason. RESULTS: Cohen’s kappa demonstrated substantial intra-rater reliability between the two sets of vignettes for diagnosis (0.702), x-ray findings (0.645) and further studies (0.620). Percent agreement was calculated and showed that raters maintained the same diagnosis in 77.5% of cases across both sets of vignettes. Furthermore, none of the raters recommended further x-rays when evaluating the first set of vignettes, suggesting they did not feel a need for the LS view prior to developing a diagnosis and treatment plan. Of surgeons who responded to the ASES survey, 82.6% routinely order a LS radiograph to evaluate patients with NTSP. Indications included: better characterization of acromion morphology (75.4%), better appreciation of humeral head relative to glenoid (38.2%), and better evaluation of scapular morphology (28.1%). CONCLUSION: Most surgeons who responded to the ASES survey report routinely ordering a LS radiograph in the initial evaluation of NTSP. However, responses to clinical vignettes suggest that a LS view may not provide a meaningful contribution to diagnosis.

The Reliability and Accuracy of Endoscopic Items and Scores Used in the Assessment of the Ileoanal Pouch and Cuff.

Currently used endoscopic items for the assessment of pouchitis and cuffitis have deficiencies in reliability and validation. We assessed the reliability and accuracy of new endoscopic items for pouchitis and of the Ulcerative Colitis Endoscopic Index of Severity [UCEIS] for cuffitis. Three new endoscopic items were assessed and included in the Monash pouchitis endoscopic subscore: bleeding [absent/contact/spontaneous]; erosions [absent/<10/≥10]; and ulceration [absent/<10%/≥10%]. Three raters evaluated 44 pouchoscopy videos in duplicates, in random order. Intra- and inter-rater reliability of all endoscopic items and UCEIS were assessed. Clinical and histological pouchitis disease activity index [PDAI] subscores were also assessed and faecal calprotectin was measured. All three Monash endoscopic items had substantial intra-rater reliability with intraclass correlation coefficients [ICCs] >0.61 [95% CI >0.61], compared with only ulcers from the currently used PDAI endoscopic subscore, but inter-rater reliability was only substantial for ulceration and no better than those of the currently used endoscopic items. The Monash endoscopic subscore had a strong positive correlation with the reference standard global endoscopic lesion severity r = 0.80 [95% CI 0.80-0.80] and the reference standard PDAI endoscopic subscore r = 0.70 [95% CI 0.67-0.73], which was higher than the correlation observed for the currently used PDAI endoscopic subscore. The UCEIS had substantial intra-rater reliability, but only fair inter-rater reliability and poor diagnostic performance for cuffitis. The Monash endoscopic items, and endoscopic subscore they generate, have enhanced overall performance compared with the currently used PDAI items and subscore. Further validation and responsiveness to change in disease state are indicated.

Inter- and intra-rater reliability and accuracy of Sanders Skeletal Maturity Staging System when used by surgeons performing vertebral body tethering.

Pediatric orthopedic surgeons must accurately assess the skeletal stage of adolescent idiopathic scoliosis (AIS) patients for selection and timing of optimal treatment. Successful treatment using vertebral growth modulation is highly dependent on skeletal growth remaining. We sought to evaluate the current-state use of the Sanders Skeletal Maturity System (SSMS) in regard to precision and accuracy. We hypothesized that pediatric orthopedic surgeons currently use SSMS with moderate precision and accuracy. Eight practicing pediatric orthopedic surgeons who perform vertebral body tethering surgery without specific training in SSMS were asked to assign the SSMS stage for 34 de-identified hand radiographs from AIS patients. Precision was evaluated as inter-rater reliability, using both Krippendorff's α and Weighted Cohen's kappa statistics, and as intra-rater reliability, using only Weighted Cohen's kappa statistics. Surgeon accuracy was evaluated using Weighted Cohen's kappa statistics with comparison of surveyed surgeons' responses to the gold standard rating. Inter-rater reliability across the surveyed surgeons indicated moderate to substantial agreement using both statistical methods (α = 0.766, κ = 0.627) with the majority of discord occurring when assigning SSMS stages 2 through 4. The surveyed surgeons displayed substantial accuracy when compared to the gold standard (κ = 0.627) with the majority of inaccuracy involving the identification of stage 3B. When re-surveyed, the surgeons showed substantial intra-rater reliability (κ = 0.71) with increased inconsistencies when deciding between SSMS stage 3A and stage 3B. The current-state use of SSMS across pediatric orthopedic surgeons for evaluation of AIS patients displays adequate but imperfect precision and accuracy with difficulties delineating SSMS stages 2 through 4, which correlate with adolescent growth periods germane to scoliosis growth modulation surgery. Centralized assessment of hand-bone age may help ensure standardized reporting for non-fusion scoliosis research.

Development and validation of a global photonumeric scale for evaluating skin quality of aged female facial skin

Skin quality plays an important role in overall attractiveness. However, so far, no visual grading scales have been published while their development seems to be an essential key step to provide validated grading scales for the evaluation of efficacy of minimally invasive procedures and cosmeceuticals aims on the improvement of skin quality, esthetic research, and clinical application. To develop and validate a visual five-point assessment scale for the evaluation of skin quality of female facial skin. The five-point photonumeric Scientific Assessment Scale of Skin Quality is based on six parameters. Fifty standardized photos were rated by 13 experts. This examination was carried out in two cycles with an interval of 4weeks. The intraclass correlation coefficient contributes to the identification of the inter-rater and intrarater reliability. Statistical analysis investigated six specific and two general parameters: The results of inter- and intrarater reliability for skin elasticity (ICC 0.816; ICC 0.883), wrinkles (ICC 0.840; 0.885), and age (ICC 0.885; 0.925) were almost perfect. The reliabilities for pigmentation (ICC 0.637; ICC 0.797), erythema (ICC 0.688; ICC 0.797), and overall skin quality (ICC 0.652; ICC 0.756) were substantial and for pore size moderate (ICC 0.405; ICC 0.584). Skin surface roughness (ICC 0.480; ICC 0.645) indicated a substantial intrarater reliability and a moderate interrater reliability. These data revealed good and excellent results. The Scientific Assessment Scale of Skin Quality represents an innovative universal and reliable measurement instrument for a valid and reproducible evaluation of six parameters of aged female facial skin quality.

Are visual inspection and digital palpation reliable methods to assess ability to perform a pelvic floor muscle contraction? An intra-rater study.

To investigate the intrarater reliability of visual inspection and digital palpation to classify women's ability to perform a voluntary pelvic floor muscle (PFM) contraction and the association between the two methods. This was a test-retest clinical study including 44 women. The ability to perform a PFM voluntary contraction was evaluated two times in all participants using visual inspection and digital palpation. All analyzed participants were assessed with a 7-day interval between the two assessments and by the same examiner. Kappa's agreement coefficient was used to estimate the intrarater reliability, and Fisher's exact test was used to analyze association between the two methods. This study found a substantial intrarater reliability of visual inspection (k = 0.73; p < .001) and digital palpation (k = 0.74; p < .001). A significant association between visual inspection and digital palpation was found at both time points (p < .001). Both visual inspection and digital palpation have substantial intrarater reliability and visual inspection can be recommended when vaginal palpation is not tolerated.

Validation of the acoustic breathiness index to the Brazilian Portuguese language

Objective To assess the concurrent validity and the diagnostic accuracy of the Acoustic Breathiness Index (ABI) in Brazilian Portuguese. Methods The counting numbers 1–20 and the vowel /a/ of 150 subjects were recorded (37 vocally healthy and 113 with dysphonia). The analyzed samples were the counting number 1–11 and 3 s of the sustained vowel. Nine voice specialists performed the perceptual judgment of the degree of breathiness. The Spearman Correlation and the receiver operating characteristic (ROC) curve were used to assess ABI’s concurrent validity and diagnosis accuracy. Results Results from five listeners were chosen for the study analyses due to moderate and substantial intra-rater reliability (Cohen’s Kappa values = 0.520–0.772) and moderate inter-rater reliability (Fleiss Kappa = 0.353). The ABI presented a high concurrent validity (r = 0.746); 55.6% of the breathiness vocal deviation can be explained by the acoustic analysis (r 2 = 0.556). The ROC curve presented good diagnostic accuracy (85.2%). At a threshold of 2.94, the sensitivity was 75.3% and the specificity was 93.4%. Conclusion The ABI is a valid tool for screening and patient’s follow-up regarding breathy vocal qualities in the Brazilian Portuguese language.

Assessment of validity and reliability of femoral shaft-patellar tendon angle measured on MRI.

Clinically measured Quadriceps angle (Q-angle) has low reliability. Measurement of angle between femoral shaft and patellar tendon (FSPT angle) on routine knee MRI was described in this study to represent the lateral vector forces of quadriceps mechanism. The cross-sectional study was designed to compare this angle between subjects with objective patellofemoral instability (PFI) versus those without PFI, to assess its reliability, and to assess its validity in terms of its ability to differentiate between PFI and non-PFI subjects using the "Receiver Operating Characteristic" (ROC) curve. MRI scans of 20 subjects with PFI and 20 without PFI were obtained. FSPT angle was measured in each MRI by three different raters. In addition, the clinical Q-angle was also measured in the control group. The FSPT angle was significantly higher in PFI group as compared with the non-PFI group (p < 0.001). It had substantial inter-rater reliability of 0.82 (95% CI = 0.67-0.92) in the non-PFI group and 0.89 (95% CI = 0.78-0.95) in the PFI group. Test-retest reliability was more than 0.90. The AUC for the ROC curve was 0.86 (95% CI = 0.74-0.97). The clinical Q-angle measured in non-PFI subjects had inter-rater reliability of only 0.48 (95% CI = 0.21-0.72), and showed a fair correlation of 0.58 with the MRI angle. Measurement of FSPT angle was described on MRI with substantial intra-rater and inter-rater reliability. The angle was significantly higher in PFI versus non-PFI subjects and also showed a good ability to differentiate between these two groups in the ROC curve.

Reliability of an adapted core strength endurance test battery in individuals with axial spondylarthritis

ObjectivesTo adapt the core strength endurance test battery (aCSE), previously used for testing athletes, to a target group of patients with axial spondylarthritis (axSpA), to evaluate its intra-tester reliability and its associations with disease-specific factors.MethodsA cross-sectional study was conducted at axSpA exercise therapy groups, including both axSpA patients and the physiotherapist group leaders (PTs). The aCSE was used to measure the isometric strength endurance of the ventral, lateral, and dorsal core muscle chains (measured in seconds), as well as to assess the disease-specific factors of functional status, self-reported pain, and perceived strength performance. The aCSE was repeated after 7–14 days to measure intra-tester reliability for the same rater (PT group leader). Reliability was calculated as an intra-class correlation coefficient (ICC) using a nested design. The associations between ventral, lateral, and dorsal strength endurance and the disease-specific factors were calculated using Pearson correlation coefficients.ResultsStudy participants were 13 PT group leaders and 62 axSpA patients. The latter were all capable of performing the aCSE, with the exception of one individual. A moderate to substantial intra-rater reliability (ICCs (95%CI)) was found for the ventral (0.54 (0.35, 0.74)), lateral (0.52 (0.33, 0.70)), and dorsal (0.71 (0.58, 0.86)) core muscle chains. None of the aCSE measures correlated with the disease-specific factors.ConclusionThe aCSE was found to be a reliable test battery for assessing core strength endurance in axSpA patients. Interestingly, aCSE performance was not associated with any disease-specific factors.Key Points • The adapted core strength endurance test battery measures the isometric strength of the ventral, lateral and dorsal core muscle chains. • The adapted core strength endurance test battery showed a moderate to substantial intra-rater reliability for all three muscle chains tested in axSpA patients. • No correlations were found between the adapted core strength endurance test battery and the disease-specific factors of self-reported pain, functional status and perceived strength performance.

Inter- and intra-rater reliability of swimming teachers with different skill levels, in different conditions, evaluating front crawl arm movement in non-expert swimmers

Abstract Aim: This study aimed (i) to test the inter-rater reliability of swimming teachers, (ii) to test the swimming teacher's discussion effect on inter-rater reliability and (iii) to verify the intra-rater swimming teacher's reliability. Method: Twenty-one learning swimmers (14.1 ± 5.1 years old) performed two 25-m front crawl courses at a comfortable speed without breathing between the sixth and 20-m, and had their displacements captured on film. Three swimming teachers with different academic backgrounds and skills evaluated the swimmer right upper limb using a 20-items checklist. In the 1st-step, teachers assessed 20-items and in 2nd-step discussed their particular evaluating criteria - selecting five items considered as the most relevant. The inter- and intra-rater reliability were tested using the Fleiss Kappa Coefficient. Results: In the 1st-step substantial reliability was found for item three and in movement descriptor for items three and 20. Nearly perfect reliability was found in the movement descriptor for item 13. In 2nd-step, moderate reliability was found only in the movement descriptor for item 20. Only the most experienced evaluator showed substantial intra-rater reliability for items four and 10 and moderate for item 20. Conclusion: The proposed discussion method did not cause the expected effect on inter-rater reliability. The swimming teacher with a higher degree and swimming skills showed better intra-rater reliability. Some items and movement descriptors proposed at the 20-items checklist can be used in practical settings.