Reliability Intraclass Correlation Research Articles

Measuring residual limb health in persons with upper limb amputation: Modifications of the Prosthetic Evaluation Questionnaire residual limb health scale.

Assessing the user perspective on residual limb health problems is particularly important for amputation care, given the relationship between residual limb health and prosthetic satisfaction. Only 1 measure, the Residual Limb Health scale of the Prosthetic Evaluation Questionnaire (PEQ) has been validated for use in lower limb amputation, but not examined in persons with upper limb amputation (ULA). The objective of this study was to examine the psychometric properties of a modified PEQ Residual Limb Health scale in a sample of persons with ULA. The study involved a telephone survey of 392 prosthesis users with ULA, with a 40-person retest sample. The PEQ item response scale was modified to a Likert scale. The item set and instructions were refined in cognitive and pilot testing. Descriptive analyses characterized the prevalence of residual limb issues. Factor analyses and Rasch analyses evaluated unidimensionality, monotonicity, item fit, differential item functioning, and reliability. Test-retest reliability was assessed by an intraclass correlation coefficient. Sweating and prosthesis odor were prevalent at 90.7% and 72.5%, respectively; blisters/sores (12.1%) and ingrown hairs (7.7%) were the least prevalent problems. Response categories were dichotomized for 3 items and trichotomized for 3 items to improve monotonicity. After adjusting for residual correlations, confirmatory factor analyses showed acceptable fit (comparative fit index = 0.984, Tucker-Lewis index = 0.970, and root mean square error approximation = 0.032). Person reliability was 0.65. No items had moderate-to-severe differential item functioning by age or sex. Intraclass correlation coefficient for test-retest reliability was 0.87 (95% CI, 0.76-0.93). The modified scale had excellent structural validity, fair person reliability, very good test-retest reliability, and no floor or ceiling effects. The scale is recommended for use with persons with wrist disarticulation, transradial amputation, elbow disarticulation, and above-elbow amputation.

Reliability of the 44-question Home Fall Hazard Assessment Tool and personal characteristics associated with home hazards among the Thai elderly

Background: The 44-question Thai Home Fall Hazard Assessment Tool (Thai-HFHAT) was developed to assist healthcare professionals in identifying the risk of falls among community-dwelling elderly from their home environment. However, the reliability of this tool has not been studied. This study aimed to examine the reliability of the 44-question Thai-HFHAT and determine the personal characteristics associated with home hazards. Methods: A descriptive cross-sectional study design was used to evaluate interrater reliability. The participants in this study were 51 elderly people from various types of Thai houses: a one-story elevated house, a one-story non-elevated house, and a house with two or more floors, 51 caregivers of elderly patients, and 5 village health volunteers (VHV). A prospective design was used to evaluate test-retest reliability with older people at different times in their homes. All participants answered 44 Thai-HFHAT questions to determine inter-rater and test-retest reliabilities. The reliabilities were analyzed using an intra-class correlation coefficient (ICC). Personal characteristics including sex, occupation, and education were used to identify the factors affecting home hazards, and linear regression was used to analyze. Results: The ICC of inter-rater reliability of the 44-question Thai-HFHAT was 0.74 (95% CI: 0.57-0.84) and the test-retest reliability was 0.80 (95% CI: 0.64-0.88) for the elderly, 0.80 (95% CI: 0.65-0.89) for the caregivers and 0.70 (95% CI: 0.477-0.83) for the VHV. Personal business career and education level grades 1-3 are less than 0.05, which showed these factors had a significant relationship with the 44-question Thai-HFHAT score as the dependent variable. Conclusions: The 44-question Thai-HFHAT is suitable for home hazard assessment among the elderly in Thailand. Further studies are needed to investigate changes in the house environment after using the 44-question Thai-HFHAT to determine which changes can reduce fall risk.

The Interrater and Intrarater Reliability of the Humeral Head Ossification System and the Proximal Femur Maturity Index Assessments for Patients with Adolescent Idiopathic Scoliosis.

Skeletal maturity can evaluate the growth and development potential of children and provide a guide for the management of adolescent idiopathic scoliosis (AIS). Recent studies have demonstrated the advantages of the Humeral Head Ossification System (HHOS) and the Proximal Femur Maturity Index (PFMI), based on standard scoliosis films, in the management of AIS patients. We further assessed the HHOS and the PFMI method's reliability in the interrater and intrarater. The data from 38 patients, including the humeral head and proximal femur on standard scoliosis films, were distributed to the eight raters in the form of a PowerPoint presentation. On 38 independent standard spine radiographs, raters utilized the HHOS and PFMI to assign grades. The PPT sequence was randomly changed and then reevaluated 2 weeks later. For every system, the 95% confidence interval (95% CI) and intraclass correlation coefficient (ICC) were calculated to evaluate the interrater and intrarater reliability. The HHOS was extremely reliable, with an intraobserver ICC of 0.802. In the first round, the interobserver ICC reliability for the HHOS was 0.955 (0.929-0.974), while in the second round, it was 0.939 (0.905-0.964). The PFMI was extremely reliable, with an intraobserver ICC of 0.888. In the first round, the interobserver ICC reliability for the PFMI was 0.967 (0.948-0.981), while in the second round, it was 0.973 (0.957-0.984). The HHOS and PFMI classifications had excellent reliability. These two methods are beneficial to reduce additional exposure to radiation and expense for AIS. There are advantages and disadvantages to each classification. Clinicians should choose a personalized and reasonable method to assess skeletal maturity, which will assist in the management of adolescent scoliosis patients.

Night-to-night reliability and agreement of obstructive sleep apnea pathophysiologic mechanisms estimated with phenotyping using polysomnography in cognitively normal elderly participants.

Phenotyping using polysomnography (PUP) is an algorithmic method to quantify physiologic mechanisms underlying obstructive sleep apnea (OSA): loop gain (LG1), arousal threshold (ArTH), and upper airway collapsibility (Vpassive) and muscular compensation (Vcomp). The consecutive-night test-retest reliability and agreement of PUP-derived estimates are unknown. From a cohort of elderly (age ≥55 years), largely non-sleepy, community-dwelling volunteers who underwent in-lab polysomnography (PSG) on 2 consecutive nights, we determined the test-retest reliability and agreement of PUP-estimated physiologic factors. Participants who had an apnea-hypopnea index (AHI3A) of at least 15 events per hour on the first night were included. PUP analyses were performed on each of the two PSGs from each participant. Physiologic factor estimates were derived from NREM sleep and compared across nights using intraclass correlation coefficients for reliability and smallest real differences (SRD) for agreement. Two PSGs from each of 43 participants (86 total) were analyzed. A first-night effect was evident with increased sleep time and stability and decreased OSA severity on the second night. LG1, ArTH, and Vpassive demonstrated good reliability (ICC > 0.80). Vcomp had modest reliability (ICC = 0.67). For all physiologic factors, SRD values were approximately 20% or more of the observed ranges, suggesting limited agreement of longitudinal measurements for a given individual. For NREM sleep in cognitively normal elderly individuals with OSA, PUP-estimated LG1, ArTH, and Vpassive demonstrated consistent relative ranking of individuals (good reliability) on short-term repeat measurement. For all physiologic factors, longitudinal measurements demonstrated substantial intraindividual variability across nights (limited agreement).

Reliability of the 44-question Home Fall Hazard Assessment Tool and personal characteristics associated with home hazards among the Thai elderly

Background: The 44-question Thai Home Fall Hazard Assessment Tool (Thai-HFHAT) was developed to assist healthcare professionals in identifying the risk of falls among community-dwelling elderly from their home environment. However, the reliability of this tool has not been studied. This study aimed to examine reliability of the 44-question Thai-HFHAT and determine the person characteristics associated with home hazards. Methods: A descriptive cross-sectional study design was used for this research. The participants in this study were 51 elderly people from various types of Thai houses: a one-story elevated house, a one-story non-elevated house, and a house with two or more floors, 51 caregivers of elderly patients and 5 village health volunteers (VHV). All participants answered 44 Thai-HFHAT questions to determine inter-rater and test-retest reliabilities. The reliabilities were analyzed using an intra-class correlation coefficient (ICC). Personal characteristics including sex, occupation, and education were used to identify the factors affecting home hazard and linear regression was used to analyze. Results: The ICC of inter-rater reliability of the 44-question Thai-HFHAT was 0.74 (95% CI: 0.57-0.84) and the test-retest reliability was 0.80 (95% CI: 0.64-0.88) for the elderly, 0.80 (95% CI: 0.65-0.89) for the caregivers and 0.70 (95% CI: 0.477-0.83) for the VHV. Personal business career and education level grade 1-3 are less than 0.05, which showed these factors had a significant relationship with the 44-question Thai-HFHAT score as dependent variable. Conclusions: The 44-question Thai-HFHAT is suitable for the home hazards assessment among the elderly in Thailand. Further studies are needed to investigate changes in the house environment after using the 44-question Thai-HFHAT to determine which changes can reduce the risk of fall.

Professional socialization of hospital nurses: A scale development and validation study

BackgroundTools currently available to measure professional socialization are outdated or could not reflect various properties of professional socialization of nurses. Thus, the objective of this study was to develop and validate a professional socialization measurement instrument for hospital nurses.MethodsFifty-two items were initially extracted from literature reviews and in-depth interviews with 32 nurses. After content validity testing, 48 items remained. They were used to survey 881 hospital nurses in Korea in the testing phase for construct validity and reliability.Results: Four factors (21 items) were extracted: ethical practice and reflection, perception of respect and recognition, clinical competency based on leadership, and desires and motivation for professional development. These factors demonstrated good construct validity and reliability. Correlation coefficients of professional socialization with professional value, compassion satisfaction, secondary traumatic stress, and burden were 0.58 (p < 0.001), 0.70 (p < 0.001), − 0.08 (p = 0.014), and − 0.56 (p < 0.001), respectively. Reliability had a Cronbach’s alpha of 0.95. Test-retest reliability intraclass correlation coefficient was 0.90.ConclusionsThe four professional socialization scale factors in this study reflected attributes of knowledge, skills, values, and professional roles. Professional socialization of nurses can be continuously developed by emphasizing elements of the professional socialization scale in nursing education programs. Nursing managers should help nurses go through the professional socialization process. The professional socialization scale will serve as a tool for developing careers of hospital nurses.

Eating Disorder-15: Factor Structure, Psychometric Properties, Validity, and Reliability of the Turkish Version for Clinical and Non-Clinical Samples.

Eating Disorder-15 (ED-15) is a self-report scale recommended for use to evaluate weekly progress and treatment results in eating disorders. This research aims to examine the factor structure, psychometric properties, validity, and reliability of the Turkish version of ED-15 (ED-15-TR) for clinical and non-clinical samples. Translation-back translation method was used for language equivalence of ED-15-TR. The research was conducted with a total of 1049 volunteers, with two sample groups as non-clinical (n=978) and clinical (n=71). The participants completed an information form, ED-15-TR, Eating Disorder Examination Scale (EDE-Q), and Beck Depression Inventory (BDI). Three hundred fifty-two participants from the non-clinical group and 18 from the clinical group completed ED-15-TR again within a week. Factor analysis confirmed the two-factor structure of ED-15- TR. Cronbach's alpha value was 0.911 (0.773, and 0.904 for the two subscales respectively), the intraclass correlation coefficient for testretest reliability was 0.943 in the clinical group (0.906, and 0.942 for the two subscales respectively); 0.777 (0.699, and 0.776 for the two subscales respectively) in the non-clinical group (for all p<0.001). The high level of a positive correlation between ED-15-TR and EDE-Q supported concurrent validity. This research indicates that ED-15-TR is an acceptable, valid, and reliable self-report scale for Turkish society.

Reliability of Ultrasound Findings in Patients with Lumbar Multifidus Myofascial Pain Syndrome.

Lumbar multifidus muscle provides stability to the spine. The present study aimed to evaluate the reliability of ultrasound findings in patients with lumbar multifidus myofascial pain syndrome (MPS). A total of 24 cases (7 females, 17 males, mean age: 40.13± 5.69, BMI: 26.48±4.96) with multifidus MPS were assessed. The variables were muscle thickness in rest and contraction, thickness changes, and cross-sectional area (CSA) in rest and contraction. Two examiners performed the test and retest sessions. The active trigger points of lumbar multifidus on the right and left side of the cases were 45.8 % and 54.2%, respectively. The intraclass correlation coefficient (ICC) values for muscle thickness and thickness changes showed moderate to very high reliability for both within and between intra-examiner measurements. (ICC, 1st examiner: 0.78-0.96; ICC, 2nd examiner: 0.86-0.95). In addition, the ICC values of within and between-session intra-examiner for CSA were high. (ICC, 1st examiner: 0.83-0.88; ICC, 2nd examiner: 0.84-0.89). The ICC and standard error of measurement (SEM) of inter-examiner reliability ranged between 0.75 to 0.93 and 0.19 to 0.88 for multifidus muscle thickness and thickness changes. The ICC and SEM of inter-examiner reliability ranged between 0.78 to 0.88 and 0.33 to 0.90 for CSA of the multifidus muscle. The within and between-session reliability of multifidus thickness, thickness changes, and CSA was moderate to very high in patients with lumbar MPS when taken by two examiners. Furthermore, the inter-examiner reliability of these sonographic findings was high.

The reliability and validity of joint range of motion measurement using zoom and a smartphone application.

[Purpose] This study aimed to evaluate the reliability and validity of measuring the range of motion of joints using a remote videoconferencing system (Zoom) and a smartphone application. [Participants and Methods] This study included 16 young and healthy adults. The participants were instructed to perform shoulder joint flexion exercises in a seated position, with automatic motions, and maintain that posture throughout the measurement. Two measurements were performed: 1) angle measurement using a three-dimensional (3D) motion analyzer, and 2) angle measurement using the videoconference software, Zoom, and a smartphone application. Intra- and inter-rater reliabilities were calculated using the intraclass correlation coefficients (ICC). The degree of agreement between the representative values of each measurer and the 3D motion analyzer was examined. [Results] ICC (1, 1) for intra-examiner reliability were 0.912 and 0.996. For the inter-rater reliability, the ICC (2, 1) was 0.945. The correlation coefficient between each examiner's value and the value of the 3D motion analyzer was 0.955 and 0.980, respectively. The Bland-Altman analysis results indicated no systematic error. [Conclusion] The method of remotely measuring joint range of motion using Zoom and a smartphone application demonstrated high reliability and validity.

RELIABILITY OF THE ISOMETRIC DYNAMOMETER IN CONTROL, PARAPLEGIC, AND AMPUTEE INDIVIDUALS.

To determine the Intraclass Correlation Coefficient (ICC), Standard Error of Measurement (SEM), Minimum Detectable Change (MDC), and the Minimum Clinically Important Difference (MCID) of the isometric measurements of muscle strength of trunk extension and of flexion and knee extension at maximum contraction in healthy, paraplegic, and amputee individuals, by using an isometric dynamometer with a belt for stabilization. An observational cross-sectional study was carried out to assess the reliability of a portable isometric dynamometer in the trunk extension and flexion and knee extension movements of each group. In all measurements, ICC ranged from 0.66 to 0.99, SEM from 0.11 to 3.73 kgf, and MDC from 0.30 to 10.3 kgf. The MCID of the movements ranged from 3.1 to 4.9 kgf in the amputee group and from 2.2 to 3.66 kgf in the paraplegic group. The manual dynamometer demonstrated good intra-examiner reliability, presenting moderate and excellent ICC results. Thus, this device is a reliable resource to measure muscle strength in amputees and paraplegics. Level of Evidence II, Cross-Sectional Study.

Dual-Frequency Bioelectrical Impedance Analysis is Accurate and Reliable to Determine Lean Muscle Mass in The Elderly

Background: Dual-frequency bioelectrical impedance analysis (DF-BIA) devices are more accessible and affordable than dual-energy X-ray absorptiometry (DXA); however, no studies have reported the accuracy of DF-BIA in body composition measurement, especially in the Thai elderly. The aims of this study were to (1) compare the accuracies of lean muscle masses measured by DF-BIA devices and DXA and (2) assess the reliability of the DF-BIA device. Methods: This cross-sectional study was conducted on participants older than 60 years who visited the Orthopedic Clinic of Siriraj Hospital. Whole-body and appendicular skeletal muscle masses (ASMs) were measured using DF-BIA (Tanita RD-545), with DXA (GE Lunar iDXA) as the standard reference. The test-retest reliability of the DF-BIA and the agreement between the devices were assessed using the intraclass correlation coefficient (ICC) and Bland–Altman plots. Regression analysis was used to develop an equation to estimate ASM values from BIA close to those from DXA. Results : The mean age of 88 participants was 73.8 (SD 8.0) years, with women predominating (84.1%). The agreement of BIA and DXA was very high for whole-body lean mass (ICC = 0.954) and ASM (ICC = 0.954), but the mean difference in muscle mass from DF-BIA was overestimated. The ICCs of test-retest reliability for whole-body muscle mass and ASM were 0.987 and 0.988, respectively. The equation for corrected ASM was formulated from a linear equation (R2 = 0.93). Conclusions: Although lean muscle mass from DF-BIA was minimally overestimated relative to DXA, this device had high accuracy and reliability for lean muscle mass evaluation in the elderly. DXA and DF-BIA are interchangeable for the assessment of muscle mass.

Development and validation of a new non-disease-specific survey tool to assess self-reported adherence to medication.

Background: Patients' non-adherence to medication affects both patients themselves and healthcare systems. Consequences include higher mortality, worsening of disease, patient injuries, and increased healthcare costs. Many existing survey tools for assessing adherence are linked to specific diseases and assessing medication-taking behavior or identifying barriers or beliefs. This study aimed to develop and validate a new non-disease-specific survey tool to assess self-reported medication-taking behavior, barriers, and beliefs in order to quantify the causes of non-adherence and measure adherence. Methods: The survey tool was developed after literature searches and pilot testing. Validation was conducted by assessing the psychometric properties of content, construct, reliability, and feasibility. Content validity was assessed by subject matter experts and construct validity by performing exploratory factor analysis. Reliability assessment was performed by calculating internal consistency, Cronbach's alpha and test/retest reliability, intraclass correlation coefficient (ICC), and standard error of measurement (SEm). A receiver operating characteristic (ROC) curve and the Lui method were used to calculate the statistical cut-off score for good versus poor adherence. Survey responses from Norwegian medication users over 18years recruited via social media were used for the factor analysis and Cronbach's alpha. Results: The final survey tool contains 37 causes of non-adherence connected to medication-taking behavior and barriers to adherence and beliefs associated with adherence. The overall result for all 37 items demonstrated reliable internal consistency, Cronbach's alpha = 0.91. The factor analysis identified ten latent variables for 29 items, explaining 61.7% of the variance. Seven of the latent variables showed reliable internal consistency: medication fear and lack of effect, conditional practical issues, pregnancy/breastfeeding, information issues, needlessness, lifestyle, and avoiding stigmatization (Cronbach's alpha = 0.72-0.86). Shortage showed low internal consistency (Cronbach's alpha = 0.59). Impact issues and personal practical issues showed poor internal consistency (Cronbach's alpha = 0.51 and 0.48, respectively). The test/retest reliability ICC = 0.89 and SEm = 1.11, indicating good reliability. The statistical cut-off score for good versus poor adherence was 10, but the clinical cut-off score was found to be 2. Conclusion: This survey tool, OMAS-37 (OsloMet Adherence to medication Survey tool, 37 items), demonstrated to be a valid and reliable instrument for assessing adherence. Further studies will examine the ability of the tool for measuring adherence enhancing effect following interventions.

Cultural adaptation and validation of the Malay Chronic Kidney Disease Self-management instrument (MCKD-SM)

BackgroundThere is growing evidence that self‐management behaviour can improve outcomes for patients with chronic kidney disease (CKD). However, no measures are available in Malay to effectively assess the self-management of CKD. The aim of this study was to translate, culturally adapt and validate the Malay Chronic Kidney Disease Self-Management (MCKD-SM) instrument for Malay-speaking health professionals and patients.MethodsThis study was carried out in two phases: the translation and cultural adaptation phase and the validation phase. The instrument was translated from English to Malay and then adapted and validated in a sample of 337 patients with CKD stages 3–4 attending a nephrology clinic in a tertiary hospital in Malaysia. Structural validity was evaluated by exploratory factor analysis. The instrument’s reliability was assessed by internal consistency and test–retest reliability. The correlations between the MCKD-SM and kidney disease knowledge and the MCKD-SM and self-efficacy were hypothesised a priori and investigated.ResultsThe MCKD-SM instrument has 29 items grouped into three factors: ‘Understanding and Managing My CKD’, ‘Seeking Support’ and ‘Adherence to Recommended Regimen’. The three factors accounted for 56.3% of the total variance. Each factor showed acceptable internal reliability, with Cronbach’s α from 0.885 to 0.960. The two-week intra-rater test–retest reliability intraclass correlation coefficient values for all items ranged between 0.938 and 1.000. The MCKD-SM scores significantly correlated with kidney disease knowledge (r = 0.366, p < 0.01) and self-efficacy (r = 0.212, p < 0.01).ConclusionThe MCKD-SM was found to be a valid and reliable patient‐reported outcome measure of pre-dialysis CKD self-management behaviour in the Malay-speaking population.

Psychometric evaluation of the Pain Assessment in Advanced Dementia scale in an acute general hospital setting.

People with dementia are at risk of unplanned hospital admissions and commonly have painful conditions. Identifying pain is challenging and may lead to undertreatment. The psychometric properties of the Pain Assessment in Advanced Dementia (PAINAD) scale, in medical inpatients with dementia have not been evaluated. A secondary data analysis from a longitudinal study of 230 people with dementia admitted to two acute general hospitals in London, UK. Internal consistency, inter-rater reliability, test-retest reliability, concurrent validity, construct validity and discriminant validity of PAINAD were tested at rest and in movement. This predominantly female (65.7%) sample had a mean age of 87.2 (Standard Deviation; SD=5.92) years. Inter-rater reliability showed an intra-class correlation (ICC) of 0.92 at rest and 0.98 in movement, test-retest reliability ICC was 0.54 at rest and 0.66 in movement. Internal consistency was 0.76 at rest and 0.80 in movement (Cronbach's α). Concurrent validity was weak between PAINAD and a self-rating level of pain (Kendall's Tau; τ=0.29; p>0.001). There was no correlation between PAINAD and a measure of behavioural and psychological symptoms of dementia, suggesting no evidence of convergent validity. PAINAD scores were higher during movement than rest, providing evidence of discriminant validity (z=-8.01, p<0.001). We found good inter-rater reliability and internal consistency. The test-retest reliability was modest. This study raises concerns about the validity of the PAINAD in general acute hospitals. This provides an insight into pain assessment in general acute hospitals which may inform further refinements of the PAINAD.

The reliability of the measurement of muscle volume using magnetic resonance imaging in typically developing infants by two raters

To assess intra-rater and inter-rater reliability of the manual segmentation of Magnetic Resonance Imaging (MRI) for the in vivo measurement of infant muscle volume of the knee extensor and flexor muscles by two raters. Muscles of the knee extensor and flexor muscle of ten typically developing infants (86 days ± 7 days) were scanned with MRI (Proton density sequence). Scans were then segmented using Slicer software, and volumes rendered by two raters. Intra-rater and inter-rater reliability were assessed using intra-class correlation (ICC), with mean difference (MD), standard error of the mean (SEM), and minimal detectable change (MDC) for each muscle calculated. ICCs for Intra-rater reliability of the segmentation process for the muscle volume of the muscles of the knee extensors and flexor muscles were 0.901–0.972, and 0.776–0.945 respectively, with inter-rater reliabilities between 0.914–0.954 and 0.848–0.978, for the knee extensor and flexors muscles respectively. For intra-rater reliability, MD ≤ − 0.47 cm3, MDCs for were < 1.09 cm3 and for inter-rater MD ≤ − 1.40 cm3, MDCs for were < 1.63 cm3 for all muscles. MRI segmentation for muscle volumes showed good to excellent reliability, though given the small volumes of the muscles themselves, variations between raters are amplified. Care should be taken in the reporting and interpretation of infant muscle volume.

Determining the reliable feature change in longitudinal radiomics studies: A methodological approach using the reliable change index.

Determination of reliable change of radiomics feature over time is essential and vital in delta-radiomics, but has not yet been rigorously examined. This study attempts to propose a methodological approach using reliable change index (RCI), a statistical metric to determine the reliability of quantitative biomarker changes by accounting for the baseline measurement standard error, in delta-radiomics. The use of RCI was demonstrated with the MRI data acquired from a group of prostate cancer (PCa) patients treated by 1.5 T MRI-guided radiotherapy (MRgRT). Fifty consecutive PCa patients who underwent five-fractionated MRgRT were retrospectively included, and 1023 radiomics features were extracted from the clinical target volume (CTV) and planning target volume (PTV). The two MRI datasets acquired at the first fraction (MRI11 and MRI21) were used to calculate the baseline feature reliability against image acquisition using intraclass correlation coefficient (ICC). The RCI was constructed based on the baseline feature measurement standard deviation, ICC, and feature value differences at two time points between the fifth (MRI51) and the first fraction MRI (MRI11). The reliable change of features was determined in each patient only if the calculated RCI was over 1.96 or smaller than -1.96. The feature changes between MRI51 and MRI11 were correlated to two patient-reported quality-of-life clinical endpoints of urinary domain summary score (UDSS) and bowel domain summary score (BDSS) in 35 patients using the Spearman correlation test. Only the significant correlations between a feature that was reliably changed in ≥7 patients (20%) by RCI and an endpoint were considered as true significant correlations. The 352 (34.4%) and 386 (37.7%) features among all 1023 features were determined by RCI to be reliably changed in more than five (10%) patients in the CTV and PTV, respectively. Nineteen features were found reliably changed in the CTV and 31 features in the PTV, respectively, in 10 (20%) or more patients. These features were not necessarily associated with significantly different longitudinal feature values (group p-value < 0.05). Most reliably changed features in more than 10 patients had excellent or good baseline test-retest reliability ICC, while none showed poor reliability. The RCI method ruled out the features to be reliably changed when substantial feature measurement bias was presented. After applying the RCI criterion, only four and five true significant correlations were confirmed with UDSS and BDSS in the CTV, respectively, with low true significance correlation rates of 10.8% (4/37) and 17.9% (5/28). No true significant correlations were found in the PTV. The RCI method was proposed for delta-radiomics and demonstrated using PCa MRgRT data. The RCI has advantages over some other statistical metrics commonly used in the previous delta-radiomics studies, and is useful to reliably identify the longitudinal radiomics feature change on an individual basis. This proposed RCI method should be helpful for the development of essential feature selection methodology in delta-radiomics.

Existing Bowel Preparation Quality Scales Are Reliable in the Setting of Centralized Endoscopy Reading.

Development of bowel preparation products has been based upon colon cleansing rating by a local endoscopist. It is unclear how bowel preparation scales perform when centrally evaluated. To evaluate the reliability of bowel preparation quality scales when assessed by central readers. Four central readers evaluated 52 videos in triplicate, 2weeks apart, during the entire endoscopic procedure (insertion/withdrawal of the colonoscope) and exclusively on colonoscope withdrawal using the Boston Bowel Preparation Scale (BBPS), Chicago Bowel Preparation scale, Harefield Cleansing Scale, Ottawa Bowel Preparation Quality Scale (OBPQS), Aronchick score, a visual analogue scale, and additional items proposed in a modified Research and Development/University of California Los Angeles appropriateness process. Reliability was assessed with intraclass correlation coefficients. Intraclass correlation coefficients (95% confidence interval) for inter-rater reliability of the quality scales ranged from 0.51 to 0.65 (consistent with moderate to substantial inter-rater reliability) during the entire procedure. Corresponding intraclass correlation coefficients for intra-rater reliability ranged from 0.69 to 0.77 (consistent with substantial intra-rater reliability). Reliability was highest in the right colon and lowest in the left colon. No differences were observed in reliability when assessed for the procedure overall (insertion/withdrawal) relative to assessment on withdrawal alone. All five bowel preparation quality scales had moderate to substantial inter-rater reliability. Panelists considered the Aronchick score too simplistic for clinical trials and recognized that assessment of residual fluid in the Ottawa Bowel Preparation Quality Scale was not amenable to central assessment.

Registration of Bony Landmarks and Soft Tissue Laxity during Robotic Total Knee Arthroplasty is Highly Reproducible.

There is growing interest and enthusiasm for robotic total knee arthroplasty (TKA). Many robotic systems require registration of bony landmarks as well as a dynamic soft tissue evaluation to plan femoral and tibial resections. Variability in this user-driven registration can introduce error and undermine the purported precision and accuracy offered by robotics. The purpose of this study was to evaluate inter- and intrarater reliability in robotic registration with a new robotic system (ROSA®; Zimmer-Biomet, Warsaw, IN). Two unpaired cadaveric knee specimens were exposed, and optical arrays were placed into the femur and tibia. Three separate evaluators conducted repeated trials of anatomic registration and assessment of soft tissue laxity, as well as coronal alignment, sagittal alignment, femoral size, and maximum opening in the medial and lateral compartments in both flexion and extension. Repeated trials were conducted using these specimens with and without preoperative imaging for landmarking (image-based and image-free workflows). An Intraclass Correlation Coefficient (ICC) was calculated for each observer and across observers to determine intra-and interrater reliability, respectively, in robotic registration. There was good to excellent reliability for all conditions, and all correlation coefficients were >0.767. On average, ICCs for intrarater reliability were excellent for Doctor 1 (0.952), Doctor 2 (0.975), and Doctor 3 (0.925). On average, the ICCs for interrater reliability were excellent for both the "Registration + Gap Assessment" condition (0.961) and the "Gap Assessment" condition (0.994). Our results show a high repeatability of registration of anatomic landmarks and gap assessment among observers using this robotic system for both image-based and image-free software.

Reliability and validity of the public transportation use assessment form for individuals after stroke

Purpose To examine the reliability and validity of the public transportation use assessment form (PTAF), which was developed for assessing the performance of tasks during public transportation use. Materials and methods Fifty consecutive patients admitted after a stroke to a convalescent rehabilitation hospital and received field-based practice for public transportation use were enrolled. A physical therapist (PT) and an occupational therapist (OT) independently evaluated actual participant performance using the PTAF. Its internal consistency, inter-rater reliability, and construct validity were examined against other clinical measures related to the ability to use public transportation. Results Cronbach’s coefficient alpha for the internal consistency for overall PTAF was 0.84 and 0.88 for PTs and OTs, respectively. Cohen’s weighted κ coefficient for the inter-rater reliability for each item ranged from 0.61 to 0.83. Intraclass correlation coefficients for the inter-rater reliability for the mean scores of the items comprising the PTAF were 0.90 for all 14 items, 0.76 for items required for train use only, and 0.88 for items required for bus use only. The correlation coefficients for the construct validity between PTAF and clinical measures ranged from 0.38 to 0.59 (p < 0.05). Conclusions The PTAF showed sufficient internal consistency, intra-rater reliability, and construct validity. Implications for rehabilitation This study illustrated the inter-rater reliability of the public transportation use assessment form (PTAF), indicating that the PTAF can be used for reliable assessment independent of the rater. The PTAF showed good internal consistency, indicating that each item in the PTAF consistently assessed the ability of patients with stroke to use public transportation. The PTAF correlated with assessment tools such as walking ability, balance, motor paralysis, intelligence, and activities of daily living, indicating that it reflects the functions and abilities necessary to use public transportation.

Picture-based acne lesion counts: A validation study to assess accuracy and reliability of acne lesion counts via photography.

Acne lesion counting (ALC) is widely used to evaluate efficacy of new acne treatments. Although such evaluations are precise and highly discriminative, if assessed live, it can be a time-consuming and intrusive measurement. Photographic assessment is a viable mode for ALCs and for training and/or qualifying evaluators. The purpose of this study was to validate photographic methods for performing ALCs and to provide an objective measurement tool to train and/or qualify lesion count evaluators for deployment in both small- and large-scale studies. Assess accuracy and reliability of acne lesion counting via photographic methods in 8 subjects aged 16 to 40 years, with Fitzpatrick Skin Types I to VI. Frontal and 45°angle images taken at the single in-clinic visit. Each subject underwent 3 counts per 4 evaluators: 1 set of live counts and 2 sets of photo counts. Intra-evaluator and inter-evaluator reliability measures for photo counts were evaluated using calculations of intraclass correlation coefficients (ICCs). Eight subjects (2 males and 6 females) age between 16 and 40 (min 16 years, max 25 years) diagnosed with facial acne vulgaris participated in the study. Fitzpatrick Skin Types ranged from III to V (three Type-III, four Type-IV, and one Type-V). ICC values for intra-evaluator reliability were found to be >0.95 for each evaluator, and ICC for inter-evaluator reliability was found to be 0.98. Photographic lesion count methodology is a reliable and accurate tool for objective measurement of ALCs and additionally, for training and/or qualifying evaluators.