Inter-rater Reliability Values Research Articles

Reliability of Three Pain Assessment Tools in Children Requiring Dental Treatment: A Comparative Clinical Study

ABSTRACT Background: Accurate pain assessment in pediatric dental patients is crucial for effective pain management and treatment planning. Materials and Methods: A total of 120 children aged 6-12 years, requiring dental treatment, were enrolled in this study. Each child was assessed using the three pain scales after undergoing a standardized dental procedure. The assessments were performed by two independent evaluators to determine inter-rater reliability. The intraclass correlation coefficient (ICC) was used to evaluate the reliability of each tool. Data were analyzed using descriptive statistics and repeated measures ANOVA to compare the mean pain scores across the three scales. Results: The mean pain scores reported were 4.3 ± 1.2 for the VAS, 4.5 ± 1.4 for the FPS-R, and 4.2 ± 1.3 for the WBFPRS. The ICC values for inter-rater reliability were 0.88 for the VAS, 0.86 for the FPS-R, and 0.90 for the WBFPRS, indicating high reliability for all tools. However, the WBFPRS showed slightly higher reliability compared to the other scales. No significant differences were found in pain scores across the three tools (P = 0.72). Conclusion: All three pain assessment tools demonstrated high reliability in assessing pain in pediatric dental patients. The Wong-Baker Faces Pain Rating Scale showed the highest inter-rater reliability, suggesting it may be the most reliable tool for clinical use in this population.

Psychometric and edumetric properties of the Turkish version of the assessment of physiotherapy practice

BackgroundClinical education is a crucial process in which students learn how to use theoretical knowledge in clinical settings. However, there is no standardized assessment tool routinely used to evaluate the clinical performance of physiotherapy students in Turkey. This study aimed to examine the psychometric (validity and reliability) and edumetric (acceptability, feasibility, and educational impact) properties of the Turkish version of the Assessment of Physiotherapy Practices (APP-T).MethodsThis methodological study included 7 clinical educators and 174 4th-grade physiotherapy students at three universities in Turkey. Students were assessed with the APP-T on completion of 4-week clinical placements. The construct validity was examined using the exploratory factor analysis. The internal consistency was determined using Cronbach’s α-coefficient. The test-retest and inter-rater reliability were evaluated with the intra-class correlation coefficient (ICC). For the measurement error of the APP-T, standard error of measurement (SEM) and minimum detectable change (MDC) values were calculated. After the administration of the APP-T was completed, clinical educators were requested to provide feedback on the acceptability, applicability, and educational impact of the APP-T.ResultsExploratory factor analysis demonstrated the 20 items of the APP-T represent a single dominant dimension explaining 76.28% of the variance. Excellent test-retest and inter-rater reliability was detected by ICC = 0.94 and ICC = 0.77, respectively, and good internal consistency was detected by Cronbach’s α = 0.935. The MDC90 values for test-retest and inter-rater reliability were 3.11 and 6.86, respectively. Clinical educators provided generally positive feedback on the acceptability, feasibility, and educational impact of the APP-T.ConclusionsThe current findings provided evidence for universities and clinical educators that the APP-T has sufficient psychometric and educational properties for evaluating the clinical performance of physiotherapy students in Turkey.

Interrater agreement and reliability of the Bosniak classification for cystic renal masses version 2019

BackgroundThe Bosniak classification for cystic renal masses has undergone refinements since its inception. The 2019 version provides more objective criteria to enhance interrater agreement but needs validation. This study compares the interrater agreement of the 2005 and 2019 Bosniak classifications for cystic renal masses. MethodsForty cystic renal masses identified on computed tomography scans were selected, distributed equally among the five classes of the 2005 Bosniak classification. Eight radiology residents participated in 2 consecutive rating sessions using the 2005 and 2019 versions, respectively, with a 1-month wash-out period in between. Interrater reliability was assessed using Fleiss' κ, and changes in cyst classes between the versions were assessed using the Wilcoxon signed-rank test. ResultsFleiss' κ values for interrater reliability were 0.354 (0.286–0.431) for 2005 and 0.373 (0.292–0.487) for 2019, indicating fair to moderate agreement. A significant decrease in cyst grades was noted using the 2019 version (Z = 3.49, r = 0.55, P < 0.001) among all cysts assessed by residents and only in complex cysts assessed by consultants (Z = 1.907, r = 0.275, P = 0.048). ConclusionInterrater agreement was similar for both classifications, ranging from fair to moderate. The 2019 version increased the proportion of masses downgraded to lower classes. Comprehensive training may enhance reliability and accuracy.

Tipping the Scales: Indiscriminate Use of Interval Scales to Rate Diverse Dysarthric Features.

Error related to incorrect use of rating scales is problematic in the assessment and treatment of dysarthria. The main purpose of this project was to determine scale fit for cardinal speech features of hypokinetic dysarthria. A secondary aim was to determine rater reliability for the two different scales explored. Forty-three speakers with Parkinson's disease (PD) and 25 neurologically healthy control talkers were recorded reading sentences from the Speech Intelligibility Test. Twenty-two healthy female listeners used both an equal appearing interval (EAI) scale and a direct magnitude estimation (DME) scale to rate five perceptual speech features (i.e., overall speech severity, articulatory imprecision, reduced loudness, short rushes of speech, and monotony) from these recordings. Regression analyses were used to determine the linearity of the relationship between the means of the EAI and DME ratings. Inter- and intrarater reliability was calculated using intraclass correlation coefficients and Spearman's correlation coefficients, respectively, for both EAI and DME ratings. There was a linear relationship between EAI and DME means for monotony, indicating it is a metathetic dimension. Curvilinear relationships were observed between the EAI and DME means for the other four features, indicating prothetic dimensions. Intra- and interrater reliability values were similar for EAI and DME ratings. Overall, results of this work suggest that DME is the best fit for scaling several hypokinetic dysarthria features, and not the conventionally used EAI scale. Prothetic dimensions best scaled by DME include overall speech severity, articulatory imprecision, reduced loudness, and short rushes of speech. Monotony was the only feature found to be a metathetic dimension and would be best scaled using EAI or DME. Findings call for rethinking the widespread use of EAI scales for rating perceptual features as part of the assessment and treatment of motor speech disorders.

Investigating Expert-Rater Agreement and Inter/Intra-Rater Reliability of Two Fundamental Movement Skills for the Locomotor Subscale of the FG-COMPASS.

The Furtado-Gallagher Children Observational Movement Pattern Assessment System (FG-COMPASS) is an observational tool using sequential decisions to assess fundamental movement skill proficiency. The current version of the test has three locomotor and five manipulative skills. Adding two more locomotor skills to the assessment tool enriches its scope, enabling a more comprehensive and nuanced evaluation of individual movement skills. We assessed expert-non-expert rater agreement and inter/intra non-expert rater reliability of two new scales for the locomotor subscale. We divided this study into two parts. In Part I, we filmed 60 children aged 5-10years old who performed gallop and vertical jump skills. A motor behavior expert then classified the videotapes using our newly created rating scales. Next, we selected eight videos for training purposes and 24 videos for testing purposes. In Part II, 30 undergraduate students underwent rater training. Rating data were analyzed using weighted kappa (Kw) and the intra-class correlation coefficient (ICC), and these indices showed 'very good' agreement between the expert and the non-expert raters for vertical jump (Kw = .96) and gallop (Kw = .89). The ICC expert to non-expert rater values for vertical jump and gallop were .98 and .94, respectively; and mean kappa values for inter-rater reliability between non-experts were considered 'very good' for vertical jump (MKw = .92) and 'good' for gallop (MKw = .78). The ICC inter-rater values were .98 and .95 (considered 'excellent') for vertical jump and gallop, respectively; and the kappa intra-rater values were .96 and .85, respectively, with intra-rater ICC values .98 and .92. Thus, the proposed rating scales were reliable for assessing vertical jump and gallop. Future studies should focus on criterion-related validity and reliability evidence from live performances.

Workflow for detecting biomedical articles with underlying open and restricted-access datasets.

To monitor the sharing of research data through repositories is increasingly of interest to institutions and funders, as well as from a meta-research perspective. Automated screening tools exist, but they are based on either narrow or vague definitions of open data. Where manual validation has been performed, it was based on a small article sample. At our biomedical research institution, we developed detailed criteria for such a screening, as well as a workflow which combines an automated and a manual step, and considers both fully open and restricted-access data. We use the results for an internal incentivization scheme, as well as for a monitoring in a dashboard. Here, we describe in detail our screening procedure and its validation, based on automated screening of 11035 biomedical research articles, of which 1381 articles with potential data sharing were subsequently screened manually. The screening results were highly reliable, as witnessed by inter-rater reliability values of ≥0.8 (Krippendorff's alpha) in two different validation samples. We also report the results of the screening, both for our institution and an independent sample from a meta-research study. In the largest of the three samples, the 2021 institutional sample, underlying data had been openly shared for 7.8% of research articles. For an additional 1.0% of articles, restricted-access data had been shared, resulting in 8.3% of articles overall having open and/or restricted-access data. The extraction workflow is then discussed with regard to its applicability in different contexts, limitations, possible variations, and future developments. In summary, we present a comprehensive, validated, semi-automated workflow for the detection of shared research data underlying biomedical article publications.

Intra- and Inter-Rater Reliability of Magnetic Resonance Imaging Measurements of Supraspinatus Muscle Thickness, Acromiohumeral Distance, and Coracohumeral Distance in Patients with Shoulder Pain

Aim: The aim of this study was to evaluate the intra- and inter-rater reliability coefficients of the supraspinatus muscle thickness (SMT ), acromiohumeral distance (AHD), and coracohumeral distance (CHD) in patients with shoulder pain. Materials and Methods: This retrospective study included 80 patients who presented with complaints of shoulder pain at a single centre between January 2023 and January 2024. The supraspinatus muscle thickness, acromiohumeral distance, and coracohumeral distance measurements were obtained one week apart by two observers. The intraclass correlation coefficient (ICC), minimum detectable change, and standard error of measurement were subsequently calculated. Results: AHD intra-rater reliability results evaluated on coronal sections were excellent (Rater 1, ICC=0.96; 95% CI, 0.94-0.97; Rater 2 ICC=0.75; 95% CI, 0.61-0.84). AHD intra-rater reliability results evaluated on sagittal sections were excellent (Rater 1, ICC=0.94; 95% CI; 0.91-0.96; Rater 2 ICC=0.77; 95% CI, 0.64-0.85). The results of CHD measured using coronal sections were good (Rater 1, ICC=0.85; 95% CI, 0.76-0.90; Rater 2 ICC=0.82; 95% CI, 0.71-0.88). SMT measurement results measured using coronal sections were excellent (Rater 1, ICC=0.98; CI, 0.98-0.99; Rater 2, ICC=0.89; 95% CI, 0.82-0.93).The inter-rater reliability values were good for AHD-Coronal (ICC= 0.75; 95% CI, 0.61-0.84) and AHD-Sagittal (ICC=0.86; 95% CI, 0.79-0.91), were fair for CHD evaluated on coronal sections (ICC=0.74; %95 CI, 0.58-0.83), and were excellent for SMT evaluated on coronal sections (ICC=0.92; 95% CI, 0.87-0.95). Conclusion: These results suggest that magnetic resonance imaging measurements of the supraspinatus muscle thickness and acromiohumeral distance can be reliable and consistent for the clinical evaluation of patients with shoulder pain. Keywords: Reliability, shoulder measurement, magnetic resonance imaging

Digital Pathology in the Detection of Infectious Microorganisms: An Evaluation of Its Strengths and Weaknesses Across a Panel of Immunohistochemical and Histochemical Stains Routinely Used in Diagnostic Surgical Pathology.

The diagnosis of some infectious diseases requires their identification in tissue specimens. As institutions adopt digital pathology for primary diagnosis, the limits of microorganism detection from digital images must be delineated. To assess the reliability of microorganism detection from digitized images of histochemical and immunohistochemical stains commonly used in pathology. Original glass slides from 620 surgical pathology cases evaluated for the presence of infectious microorganisms were digitized. Immunohistochemical stains included those for herpes simplex virus (n = 100), cytomegalovirus (n = 100), Helicobacter pylori (n = 100), and spirochetes (n = 80). Histochemical stains included mucicarmine for Cryptococcus spp (n = 20), Grocott methenamine silver for fungi (n = 100), Giemsa for H pylori (n = 100), and Ziehl-Neelsen for acid-fast bacilli (n = 20). The original diagnosis based on the glass slides was regarded as the reference standard. Six pathologists reviewed the digital images. Digital review was generally associated with high (ie, ≥90%) specificity and positive predictive value owing to a low percentage of false positive reads, whereas a high percentage of false negatives contributed to low sensitivity and negative predictive value for many stains. Fleiss κ showed substantial interobserver agreement in the interpretation of Grocott methenamine silver and immunostains for herpes simplex virus, H pylori, and cytomegalovirus; moderate agreement for spirochete, Ziehl-Neelsen, and mucicarmine; and poor agreement for Giemsa. Digital immunohistochemistry generally outperforms histochemical stains for microorganism detection. Digital interpretation of Ziehl-Neelsen and mucicarmine stains is associated with low scores for interrater reliability, accuracy, sensitivity, and negative predictive value such that it should not substitute for conventional review of glass slides.

Spine surgeon versus AI algorithm full-length radiographic measurements: a validation study of complex adult spinal deformity patients.

Spinal measurements play an integral role in surgical planning for a variety of spine procedures. Full-length imaging eliminates distortions that can occur with stitched images. However, these images take radiologists significantly longer to read than conventional radiographs. Artificial intelligence (AI) image analysis software that can make such measurements quickly and reliably would be advantageous to surgeons, radiologists, and the entire health system. Institutional Review Board approval was obtained for this study. Preoperative full-length standing anterior-posterior and lateral radiographs of patients that were previously measured by fellowship-trained spine surgeons at our institution were obtained. The measurements included lumbar lordosis (LL), greatest coronal Cobb angle (GCC), pelvic incidence (PI), coronal balance (CB), and T1-pelvic angle (T1PA). Inter-rater intra-class correlation (ICC) values were calculated based on an overlapping sample of 10 patients measured by surgeons. Full-length standing radiographs of an additional 100 patients were provided for AI software training. The AI algorithm then measured the radiographs and ICC values were calculated. ICC values for inter-rater reliability between surgeons were excellent and calculated to 0.97 for LL (95% CI 0.88-0.99), 0.78 (0.33-0.94) for GCC, 0.86 (0.55-0.96) for PI, 0.99 for CB (0.93-0.99), and 0.95 for T1PA (0.82-0.99). The algorithm computed the five selected parameters with ICC values between 0.70 and 0.94, indicating excellent reliability. Exemplary for the comparison of AI and surgeons, the ICC for LL was 0.88 (95% CI 0.83-0.92) and 0.93 for CB (0.90-0.95). GCC, PI, and T1PA could be determined with ICC values of 0.81 (0.69-0.87), 0.70 (0.60-0.78), and 0.94 (0.91-0.96) respectively. The AI algorithm presented here demonstrates excellent reliability for most of the parameters and good reliability for PI, with ICC values corresponding to measurements conducted by experienced surgeons. In future, it may facilitate the analysis of large data sets and aid physicians in diagnostics, pre-operative planning, and post-operative quality control.

Intra- and inter-rater reliability of goniometric finger range of motion using a written protocol.

Goniometric finger range of motion (ROM) is the most common outcome measure used for functional evaluation of finger joints, but its reliability is not well-evaluated. This study aimed to investigate intra- and inter-rater reliability of goniometric finger ROM using a written protocol for active, passive, and composite movements in healthy adults. The design was a single-center, cross-sectional, reliability study. Participants were 20 healthy adults (mean ± standard deviation, 36.4 ± 10.9 years). ROM for active, passive, and composite movements of the fingers was assessed by three occupational therapists with at least 5 years clinical experience in the field of physical disabilities. To standardize the measurement method used, we developed a written protocol, stabilized the wrist position, and trained the evaluators. Intraclass correlation coefficient (ICC) values were used for the reliability analysis. ICC (1,1) was used for intra-rater reliability. ICC (2,1) was used for inter-rater reliability. Hand-shaped heatmaps were used to summarize the reliability data. Most of the results (88.7%) showed moderate to good intra-rater reliability (ICC ≥ 0.50), while inter-rater reliability showed less (69.0%). Both intra- and inter-rater reliability showed no trends between dominant and non-dominant hands, type of movement, finger, or joint. Intra-rater reliability was relatively high and using a written protocol was beneficial. Inter-rater reliability tended to be lower, and differences in the physical structure of both raters and participants may have affected inter-rater reliability values.

Adaptation and reliability of tests of functional mobility and muscle strength using telehealth for older people with dementia

Objective: Adapt functional mobility and muscle strength tests for older people with dementia to be performed remotely in the home environment; determine intra-rater and inter-rater reliability of functional mobility and strength tests for older people with dementia; and correlate the performance on the physical tests executed remotely and the Timed Up and Go (TUG) test, which was validated remotely in healthy older people. Methods: We included 43 people with dementia. The Short Physical Performance Battery (SPPB), TUG, TUG Dual Task (TUG-DT), and 30-Second Sit-to-Stand Test (SST30s) were performed through videocalls. Test performance was documented to facilitate the subsequent determination of inter- and intra-rater reliability. The intra-rater reliability was determined at a 2-week interval from the real-time videocall to analysis of the recording. Results: Intra-rater reliability ranged from good to excellent for all tests performed (ICC 0.862–1.000). Inter-rater reliability values were fair for gait speed (ICC = 0.223), moderate for some of the SPPB items (ICC = 0.706–0.801), good for the SPPB two-foot balance (ICC = 0.860) and the SPPB total score (ICC = 0.831), and excellent for the rest of the tests. Conclusion: Functional mobility and muscle strength tests proved reliable and feasible for remote, at-home assessments of older people with dementia when assisted by their respective caregivers, providing an additional alternative for assessment of this patient population.

Validity and reliability of selective control of upper extremity scale (SCUES) in patients with chronic stroke

Purpose The aim of this study is to investigate the validity and reliability of the Selective Control of Upper Extremity Scale (SCUES) in patients with stroke. Materials and Methods Forty-two patients with stroke aged 18–75 years, were included in the study. Patients were video-recorded while SCUES was administered. The videos were scored to determine the intrarater and inter-rater reliability. Fugl Meyer Assessment of Upper Extremity (FMA-UE), Box and Block test (BBT) and Brunnstrom Stages of Motor Recovery were measured to evaluate validity of SCUES. Spearman correlation analysis was used to assess the validity of SCUES. Intraclass correlation coefficient (ICC), Kappa (κ) and weighted Kappa (κw) were calculated to determine intrarater and inter-rater reliability. Results There were significant positive high correlations between SCUES and FMA-UE and BBT and Brunnstrom upper extremity proximal and distal values (rho = 0.944, p = 0.01; rho = 0,875, p = 0.01; rho = 0.84, p = 0.01, rho = 0.82, p = 0.01; respectively) showing validity of SCUES. The ICC value of inter-rater reliability of SCUES was 0,99 (%95 CI: 0,989-0,997, p = 0,001) showing excellent reliability. κ and κ w values for inter-rater and intrarater reliability of individual SCUES items were above 0.7 indicating excellent reliability. ICC of SCUES and FMA-UE indicated excellent intrarater reliability (ICC = 0,99; %95 CI: 0,989–0,997, p = 0,001; ICC = 0.943; %95 CI: 0.9–0.97, p = 0,0001, consecutively). Conclusions SCUES showed similar validity and reliability with FMA-UE and SCUES can be used in the evaluation of upper extremity selective motor control in patients with stroke.

Measuring Ultrasonographic Thickness of the Achilles Tendon Insertion Is Less Reliable Than the Midportion in Healthy Tendons and Patients With Tendinopathy.

Ultrasound is the preferred imaging method in the diagnostic process of Achilles tendinopathy (AT). Ultrasound tissue characterization (UTC) is a frequently used, standardized and valid method to assess tendon geometry in AT patients. It is unknown whether UTC is reliable for measuring Achilles tendon thickness. The aim of the study was to assess intra- and inter-rater reliability of Achilles tendon thickness measurements using UTC in both asymptomatic individuals and patients with AT, and to evaluate if the reliability of thickness measurements differs between the midportion and insertional area. Exactly 50 patients with AT and 50 asymptomatic individuals were included. Using the conventional US and standardized UTC procedure maximum thickness was measured in the midportion and insertion region. To determine inter- and intra-rater reliabilities, the intraclass correlation coefficient (ICC) was used. The ICC values for inter- and intra-rater reliability were classified as "excellent," for the AT group (0.93 [95% CI: 0.88-0.96] and 0.95 [0.92-0.97]) and asymptomatic participants (0.91 [0.87-0.94] and 0.94 [0.92-0.96]). The reliability of measuring tendon thickness in the midportion region was "excellent," with both inter-rater (0.97 [0.95-0.98]) and intra-rater (0.98 [0.96-0.99]) ICC values indicating high levels of agreement. In the insertional region, ICC values for inter-rater (0.79 [0.69-0.87]) and intra-rater (0.89 [0.84-0.93]) reliability were "moderate to good." We showed excellent reliability for measuring the US thickness of the midportion and good reliability of measuring the insertional region in patients with AT. Significantly lower ICCs were observed for the reliability of thickness measurements in the insertional region when compared with the midportion.

Clinimetrics of the Lanarkshire Oximetry Index for patients with leg ulcers: A systematic review and meta-analysis.

Ankle Brachial Pressure Index (ABPI) measurement has long been considered the gold standard of vascular assessment for people with lower limb ulceration. Despite this, only around 15% of patients in the United Kingdom who require an ABPI measurement undergo the assessment. The Lanarkshire Oximetry Index (LOI) is a cheaper and arguably more accessible approach to vascular assessment and was initially proposed as an alternative to the ABPI in 2000. No synthesis of evidence related to the LOI has been performed since its introduction into the literature. Primary studies were sought to determine the clinimetric properties of the LOI and its level of agreement with ABPI assessments. Systematic searches of MEDLINE, CINAHL, Cochrane Central Register of Controlled Trials, BNI, ProQuest Health and Medicine, Science Direct, Google Scholar and the British Library (online search) were conducted. Reference lists of identified studies were also reviewed to identify additional studies. Three primary studies met the inclusion criteria, reporting data from 307 patients and 584 limbs assessed using both the LOI and ABPI. All three studies reported fair to moderate kappa values for interrater reliability (κ = 0.290-0.747) and statistically significant positive correlation coefficients (r = 0.37, p < 0.001 in two studies) between the LOI and ABPI. The combined data from the three studies indicated a sensitivity of 52% (41.78-62.1, 95% confidence interval [CI]) and specificity of 96.08% (93.4-97.9, 95% CI) for the LOI using the ABPI as a reference. Additional data are required to indicate the safety of the LOI in practice. Data are also required to determine if the LOI is more acceptable to clinicians compared to the ABPI and whether there are any barriers/enablers to its implementation in practice. Given the relatively low specificity of the LOI, it may be beneficial to combine measurement of the LOI with a subjective clinical risk assessment tool to improve the sensitivity of this alternative approach to vascular assessment.

Ultrasound measurement of subsynovial connective tissue thickness in the carpal tunnel: An intrarater/interrater reliability and agreement study

ObjectivesNon-inflammatory thickening of the subsynovial connective tissue (SSCT) in the carpal tunnel is commonly found in subjects with carpal tunnel syndrome (CTS), and quantification may shed light on CTS pathogenesis. To date, information on the reliability of ultrasound quantification of SSCT is scarce. Therefore, we investigated intrarater and interrater reliability/agreement for ultrasound quantification of SSCT thickness in subjects with and without CTS, and predictors for tissue thickness. Material and methodsTwo investigators quantified SSCT thickness and thickness ratio on ultrasound in 16 healthy subjects (age, 24–65 years; 16 left/14 right wrists) and 17 subjects with CTS (age, 37–83 years; 14 left/14 right wrists). Intra- and inter-rater reliability/agreement were assessed on intraclass correlation coefficients, standard error of measurement and minimal detectable change. A mixed-effects model was used to evaluate potential predictors for SSCT thickness. ResultsIntra- and inter-rater reliability analysis showed good to excellent intraclass correlation coefficients in both groups, ranging from 0.772 to 0.965. The maximum percentage standard error of measurement was 8%. The maximum minimal detectable change was 14% within raters, and 20% between raters. Both intra- and inter-rater reliability values for thickness ratio were poor. Presence of CTS (ß = 0.180; p = 0.015) correlated positively with SSCT thickness. ConclusionsUltrasound is a reliable method for quantification of SSCT thickness, but not for thickness ratio. Presence of CTS correlates positively with SSCT thickness.

Trust Your Fingers: Determining the Reliability and Validity of the Measurement of the Diastasis of the Rectus Abdominis Muscle by Palpation and Tape Measure

Background: Diastasis of the rectus abdominis muscle (DRAM) occurs in about 60% of pregnant women and often persists after delivery. Currently, the reference standard to measure DRAM is ultrasonography, and physiotherapy is considered first-line treatment. Most physiotherapists do not base their DRAM assessment on ultrasonography but instead on palpatory evaluation with tape measures. This method is neither standardized nor has been tested for its reliability or validity in women with interrectus distance (IRD) of 30 mm and greater. Objectives: To assess the reliability of the measurements of DRAM by palpation with tape measure and to evaluate its validity compared with ultrasonography. Study Design: Prospective observational study. Methods: Two physiotherapists assessed test-retest, intra- and interrater reliability of this method in 20 women with IRD of 30 mm and greater, using intraclass correlations (ICC) and compared the values with ultrasonography to establish its validity using Spearman ρ and Bland-Altman plots. The interval between the 2 sessions was 7 days and greater. Results: The ICC values for test-retest reliability ranged from 0.67 to 0.95 and between 0.40 and 0.85 for intrarater reliability. The ICC values for interrater reliability ranged from 0.13 to 0.29. In terms of validity, correlations were inconsistent with Spearman ρ ranging from −0.24 to 0.74. Conclusion: Single palpatory measurement with tape above the umbilicus and during partial curl-up might detect changes in IRD of 15.5 mm and greater over time in women with IRD of 30 mm and greater. It cannot replace ultrasonographic measurements in accuracy but might be the only available option for IRDs larger than the ultrasonographic probe.

Validity and Reliability of the Persian Version of Hypospadias Objective Penile Evaluation (HOPE) Questionnaire

Background and Objective: Surgical correction of hypospadias is one of the most common pediatric surgeries. Due to the several methods of hypospadias operations, the evaluation of results has always been challenging. Several questionnaires have been designed to reduce the discrepancy in the reports of hypospadias surgery, and the HOPE questionnaire is one of the most common. Based on our search, the reliability and validity of the Persian version of the HOPE (Hypospadias Objective Penile Evaluation) questionnaire have not been assessed yet. Materials and Methods: In this cross-sectional study, firstly, the questionnaire "Objective evaluation of penis in hypospadias" was translated by two urologists and an English language expert familiar with medical concepts according to the Backward-Forward translation method into Persian and then again into English, and finally, the questionnaire was sent to experts and compared with the original questionnaire. The quality of translation and content were finalized and corrected. Thereafter, in order to check the form and content validity, the questionnaire was sent to eight experts, and the content validity indices and its content validity ratio were calculated. In order to check the reliability-stability of the re-test, two questionnaires, including images after hypospadias surgery of 42 patients, were delivered to eight specialists in pediatrics, urology, and pediatric surgery to determine the score at a time interval of one week, and finally, the data were analyzed in SPSS software (version 23) using the test-retest method. The Intraclass Correlation Coefficient (ICC) index and its confidence interval were calculated by the scores obtained from twice answering the instrument for each factor and the entire questionnaire. In order to determine internal consistency and reliability, Cronbach's alpha coefficient was calculated for each factor and the entire questionnaire. Results: In our study, intraclass correlation coefficient values for inter-rater reliability in the HOPE score were calculated at 0.89, indicating the high reliability of this questionnaire in Persian. The internal consistency of the Persian version of the HOPE scale was confirmed, rendering a Cronbach's alpha coefficient of 0.98. Conclusion: The good validity and reliability of the HOPE scoring system in Persian support its use as a standard objective outcome measure of the cosmetic result after hypospadias surgery.

Reliability and agreement of the timed up and go test in children and teenagers with autism spectrum disorder

ASD patients include a variety of motor deficits; however, these issues have received less scientific attention than other ASD symptoms. Due to understanding and behavioral difficulties, it might be difficult to administer motor assessment measures to children and adolescents with ASD. To evaluate motor challenges in this population, including gait and dynamic balance issues, the timed up and go test (TUG) may be a simple, easy to apply, quick, and inexpensive tool. This test measures in seconds the time it takes for an individual to get up from a standard chair walk 3 m, turn around, walk back to the chair, and sit down again. The study purpose was to evaluate the inter- and intra-rater reliability of TUG test in children and teenagers with ASD. A total of 50 children and teenagers with ASD (43 boys and 7 girls) between 6 and 18 years were included. Reliability was verified by the intraclass correlation coefficient, standard error of measurement, and minimum detectable change. The agreement was analyzed by the Bland–Altman method. A good intra-rater reliability (ICC = 0.88; 95% CI = 0.79–0.93) and an excellent inter-rater reliability (ICC = 0,99; 95% CI = 0.98 to 0.99) were observed. Additionally, Bland–Altman plots demonstrated that there was no evidence of bias in either the replicates or between examiners. Furthermore, the limits of agreement (LOAs) between the testers and test replicates were close, indicating that there was little variation between measurements. Conclusions: The test TUG showed strong intra- and inter-rater reliability values, low proportion of measurement errors, and lack of significant bias based on by test repetition in children and teenagers with ASD. These results could be clinically useful for assessing balance and the risk of falls in children and teenagers with ASD. However, the present study is not free of limitations, such as the use of a non-probabilistic sampling.What is Known:• People with ASD have a variety of motor deficits that have a prevalence rate almost as common as intellectual disability. In our knowledge, there are no studies that provide data on the reliability of the use of scales or assessment tests in children and adolescents with ASD to measure motor difficulties, such as gait and dynamic balance, in children and teenagers with ASD.• Timed up and go test (TUG) could be a possible tool to measure this motor skills.What is New:• The reliability and agreement of the Timed up and go test in 50 children and teenagers with autism spectrum disorder showed strong intra- and inter-rater reliability values, low proportion of measurement errors, and lack of significant bias based on by test repetition.

A Comparative Evaluation of the Measurement Properties of Three Histological Indices of Mucosal Healing in Ulcerative Colitis: Geboes Score, Robarts Histopathology Index and Nancy Index.

To inform their future use in regulated clinical trials to evaluate treatment efficacy hypotheses, the measurement properties of three histological indices, Geboes Score [GS], Robarts Histopathology Index [RHI] and Nancy Index [NI], were evaluated among patients with ulcerative colitis. Analyses were conducted on data from a Phase 3 clinical trial of adalimumab [M14-033, n = 491] and focused on evaluating the measurement properties of the GS, RHI and NI. Specifically, internal consistency and inter-rater reliability, convergent, discriminant and known-group validity, and sensitivity to change were assessed at Baseline, and at Weeks 8 and 52. Internal consistency for the RHI showed lower alpha [α] values at Baseline [α = 0.62] relative to Weeks 8 [α = 0.82] and 52 [α = 0.81]. The inter-rater reliability values of RHI [0.91], NI [0.64] and GS [0.53] were excellent, good and fair, respectively. Regarding validity, Week 52 correlations were moderate to strong between full and partial Mayo scores and Mayo subscale scores and the RHI and GS, and were weak to moderate for the NI. Significant differences between mean scores of all three histological indices were observed across known-groups based on Mayo endoscopy subscores and full Mayo scores at Weeks 8 and 52 [p < 0.001]. The GS, RHI and NI are each capable of producing reliable and valid scores that are sensitive to changes in disease activity over time, in patients with moderately to severely active ulcerative colitis. While all three indices demonstrated relatively acceptable measurement properties, the GS and RHI performed better than the NI.

Unsatisfactory reproducibility of interstitial inflammation scoring in allograft kidney biopsy

Interstitial inflammation scoring is incorporated into the Banff Classification of Renal Allograft Pathology and is essential for the diagnosis of T-cell mediated rejection. However, its reproducibility, including inter-rater and intra-rater reliabilities, has not been carefully investigated. In this study, eight renal pathologists from different hospitals independently scored 45 kidney allograft biopsies with varying extents of interstitial inflammation. Inter-rater reliabilities and intra-rater reliabilities were investigated by kappa statistics and conditional agreement probabilities. Individual pathologists’ scoring patterns were examined by chi-squared tests and proportions tests. The mean pairwise kappa values for inter-rater reliability were 0.27, 0.30, and 0.26 for the Banff i score, ti score, and i-IFTA, respectively. No rater pair performed consistently better or worse than others on all three scorings. After dichotomizing the scores into two groups (none/mild and moderate/severe inflammation), the averaged conditional agreements ranged from 47.1% to 50.0%. The distributions of the scores differed, but some pathologists persistently scored higher or lower than others. Given the important role of interstitial inflammation scoring in the diagnosis of T-cell mediated rejection, transplant practitioners should be aware of the possible clinical implications of the far-from-optimal reproducibility.