Test-retest Reliability Intraclass Correlation Research Articles

Reliability and validity of the Turkish version of the Aging Voice Index

Purpose The Ageing Voice Index is a valid and reliable tool for assessing the impact of changes in the voice of older adults. Our aim is to adapt the Aging Voice Index with Turkish older adults and test its reliability and validity to create the Turkish Aging Voice Index. Method A total of 206 participants were included in the study. Construct validity, criterion validity, test-retest reliability, internal consistency, and confirmatory factor analysis were investigated. Finally, the sensitivity and specificity of the Turkish Aging Voice Index were calculated using receiver operating characteristics curve analysis. Result The Turkish Aging Voice Index has excellent internal consistency (Cronbach’s alpha= 0.971). A high intraclass correlation for test-retest reliability was found (ICC = 0.953, p < 0.001). Construct validity of the Turkish Aging Voice Index was found to be statistically significant (p < 0.001) by comparing the mean Turkish Aging Voice Index scores between the study and control groups. For criterion validity, a statistically positive high correlation was found between the mean scores of the Turkish Aging Voice Index and the Turkish version of the Voice Handicap Index-10 (r = 0.854, p < 0.001). The cut-off value of the Turkish Aging Voice Index was 15.50 with a sensitivity of 85.01% and a specificity of 84.8%. Conclusion The Turkish Aging Voice Index is a valid and reliable tool for elderly patients with voice disorders. A score >15.50 is an indicator of voice problems in the older population.

Validation analysis of Polish version of Neuropathic Pain Questionnaire - Short Form (NPQ-SF-PL) and assessment of quality of life in patients with chronic neuropathic pain.

The aims of this study were to translate and culturally adapt the Polish version (PL) of the Neuropathic Pain Questionnaire-Short Form (NPQ-SF), as well as to compare this questionnaire to other diagnostic tools in terms of reliability and psychometric validity. Neuropathic pain (NP) affects up to 10% of the general population. Despite a large number of studies, almost 50% of patients have a poor therapeutic outcome. Diagnostic tools are intended to distinguish between NP and non-NP (NoP) and to guide the examiner to perform further diagnostics in accordance with the guidelines. A total of 140 patients with chronic pain (ChP), 90 with NP and 50 with NoP, were enrolled into this study. NPQ-SF-PL has been developed following the guidelines for translation and cultural adaptation. Reliability of the translated version was examined using internal consistency, predictive validity, and intraclass correlation coefficient (ICC). In the study, women predominated over men, and the average age was 53.22. Cronbach's α value for the entire scale was 0.76 and ICC for test-retest reliability was 0.631. Receiver-operating characteristic curve analysis gave a sensitivity of 90.0% and a specificity of 88.0%. Area under the curve was 0.94. NPQ-SF-PL was moderately associated with self-completed Leeds Assessment of Neuropathic Symptoms and Signs (S-LANSS) and weakly associated with the Numerical Rating Scale (NRS). The NP group obtained statistically significantly lower scores than the NoP group in all domains of the 36-Item Short Form Health Survey (SF-36), thus indicating worse health status. Patients aged over 41 years presented a worse quality of life compared to younger ones. Also, more than half of the patients with NP of both genders experienced symptoms of mild or more severe depression. NPQ-SF-PL is a valid screening tool for assessing NP in Polish chronic pain patients. The obtained results showed very good psychometric properties and adequate internal consistency. The repeatability of the questionnaire indicated moderate reliability. Clinical implications/future directions. We believe this study will provide physicians with a new instrument for the evaluation of NP for clinical and research purposes.

Case detection delay in leprosy: Testing tool reliability and measurement consistency in Ethiopia, Mozambique, and Tanzania.

Case detection delay (CDD) in leprosy is defined as the period between the onset of the first signs and symptoms and the time of diagnosis. A tool, consisting of a questionnaire and a detailed guide for researchers, which includes photos of typical skin signs and notes on establishing the timing of events, was developed to determine this period of delay in months in recently diagnosed leprosy patients. The aims of the study were to determine the reliability and consistency of this CDD assessment tool. This study was conducted in Ethiopia, Mozambique and Tanzania. Two types of consistency were considered: over time (test-retest reliability) and across different researchers (interrater reliability). A CDD questionnaire was administered to 167 leprosy patients who were diagnosed within 6 months prior to their inclusion. One month later, the same or another researcher re-administered the CDD questionnaire to the same patients. Both test-retest and interrater reliability were assessed using the intraclass correlation coefficient (ICC), where a value greater than or equal to 0.7 is considered acceptable. In this study, 10 participants (6.0%) were under 15 years of age, and 56 (33.5%) were women. In the test-retest assessment, the mean CDD from the first and second interviews was 23.7 months (95% CI 14.4-34.8) and 24.0 months (95% CI 14.8-33.2), respectively. The ICC for test-retest reliability was 0.99 (95% CI 0.994-0.997). For the interrater reliability assessment, the first and second interviews revealed a mean CDD of 24.7 months (95% CI 18.2-31.1) and 24.6 months (95% CI 18.7-30.5), respectively, with an ICC of 0.90 (95% CI 0.85-0.94). A standard error of measurement of 0.46 months was found in the test-retest and 1.03 months in the interrater measurement. Most answers given by participants during the first and second interviews were matching (≥86%). Most non-matching answers were in the 0-2 month delay category (≥46%). The tool, including a questionnaire to determine the CDD of newly diagnosed leprosy patients, was validated in three African countries. The test-retest and interrater measurements demonstrated that the instrument is reliable and measures consistently. The tool can be used in routine leprosy programmes as well as in research settings. This trial is registered with The Netherlands Trial Register (NTR), now available via International Clinical Trial Registry Platform (ICTRP) with registration number NL7294 (NTR7503), as well as with The Pan African Clinical Trials Registry (PACTR) with registration number PACTR202303742093429.

Validation of the Perceived Community Support Questionnaire for Older Chinese.

Community support has a profound positive impact on older people's health and plays a crucial role in facilitating aging in place. This impact is particularly significant in the Chinese context, where community support can alleviate the pressure on traditional family caregiving. This study translated, adapted, and validated the perceived community support questionnaire (PCSQ) for use with older Chinese. Data for this validation study were collected from a cross-sectional survey of 1,064 Chinese aged 65 years and above. Following the cultural adaptation of the PCSQ-14, confirmatory factor analysis (CFA) was conducted to examine its factor structure. Criterion validity, convergent and discriminant validity, internal consistency reliability, and test-retest reliability of the scale were also assessed. Based on the CFA results, the adapted PCSQ-14 was found to have a 3-factor solution for community integration, community participation, and community organizations. The criterion-related validity was supported by its significant correlation with depression. Convergent and discriminant validity were established, with the internal consistency of the scale being 0.90. The test-retest reliability intraclass correlation coefficient for the scale was 0.78. The adapted version of the PCSQ-14 demonstrated promising psychometric properties in assessing perceived community support in older Chinese. The adapted PCSQ-14 could assist researchers in determining older Chinese adults' perceptions of community support, and could also assist practitioners and policymakers in developing targeted services for older people and allocating resources more effectively.

Translation and validation of the Chinese version of the menstrual distress questionnaire

Background The Menstrual Distress Questionnaire (MDQ) is a commonly used questionnaire that assesses various symptoms and distress associated with the menstrual cycle in women. However, the questionnaire has not been completely translated into Chinese with rigorous reliability and validity testing. Methods This study translated the Menstrual Distress Questionnaire Form Cycle (MDQC) from English into Chinese: MDQCC in two stages. First, it was translated forward and backward using Jones’ model; second, to test the validity and reliability, 210 Chinese-speaking women were recruited through online announcements and posters posted between June 2019 and May 2020. Expert validity, construct validity, convergent validity, and factorial validity were determined using content validity index (CVI), intraclass correlation coefficient (ICC), composite reliability (CR), and exploratory factor analysis, respectively. For concurrent criterion validity, MDQCC score was compared with three existing pain scales. Reliability was evaluated using internal consistency across items and two-week test-retest reliability over time. Results The CVI for content validity was .92. Item-CVI for expert validities among the 46 items ranged from .50 − 1; scale-CVI for the eight subscales, from .87 − 1; ICC, from .650 − .897; and CRs, from .303 − .881. Pearson correlation coefficients between MDQCC and short-form McGill pain questionnaire, present pain intensity, and visual analog scale scores were .640, .519, and .575, respectively. Cronbach’s α for internal consistency was satisfactory (.932). ICC for test-retest reliability was .852 for the entire MDQCC. Conclusion MDQCC was valid and reliable for Mandarin Chinese-speaking women. It can be used to evaluate female psychiatric symptoms related to the menstrual cycle in future work.

Translation and psychometric assessment of the mastectomy module of the BREAST-Q questionnaire for use in Nigeria

BackgroundThe majority of non-metastatic breast cancer patients in sub-Saharan Africa are recommended to have mastectomy. The impact of mastectomy on a predominantly young African patient population requires evaluation. The BREAST-Q is a validated patient-reported outcome measure of quality-of-life following breast surgery that has been translated into 30 languages-none in Africa. This study aimed to translate and assess the psychometric properties of the mastectomy module of the BREAST-Q for use in Nigeria.MethodsThe BREAST-Q mastectomy module was translated from English to Yoruba and its psychometric properties assessed using best practice guidelines. Translation was performed in 4 steps: forward translation (x2), back translation, back translation review, and cognitive interviews with post-mastectomy patients. The translated BREAST-Q instrument was administered to post-mastectomy patients (n = 21) alongside the EORTC-QLQ BR23 to evaluate construct validity. Test-retest reliability was evaluated using intraclass correlation coefficients (ICC); surveys were re-administered 4 weeks apart.ResultsThe translation process identified English phrases not amenable to direct translation, including “emotionally healthy” and descriptions of pain (“nagging,” “throbbing,” “sharp”). Translations were amended to reflect local context and question intent. During cognitive interviews, patients provided suggestions to simplify complex phrases, e.g. “discomfort in your breast area.”. Internal consistency within scales was over 0.70 for psychosocial wellbeing (α = 0.84–0.87), sexual wellbeing (α = 0.98–0.99), physical wellbeing in chest (α = 0.84–0.86), and satisfaction with care (α = 0.89–0.93). ICC for test-retest reliability was moderate (0.46–0.63).ConclusionsThe Yoruba version of the BREAST-Q mastectomy module presents a unique opportunity to adequately capture the experiences of Nigerian women post mastectomy. This instrument is being used in a pilot study of Nigerian patients to identify targets for intervention to improve the patient experience and compliance with breast cancer surgery.

Development and validation of the EDUcational Course Assessment TOOLkit (EDUCATOOL) – a 12-item questionnaire for evaluation of training and learning programmes

IntroductionThe instruments for evaluation of educational courses are often highly complex and specifically designed for a given type of training. Therefore, the aims of this study were to develop a simple and generic EDUcational Course Assessment TOOLkit (EDUCATOOL) and determine its measurement properties.MethodsThe development of EDUCATOOL encompassed: (1) a literature review; (2) drafting the questionnaire through open discussions between three researchers; (3) Delphi survey with five content experts; and (4) consultations with 20 end-users. A subsequent validity and reliability study involved 152 university students who participated in a short educational course. Immediately after the course and a week later, the participants completed the EDUCATOOL post-course questionnaire. Six weeks after the course and a week later, they completed the EDUCATOOL follow-up questionnaire. To establish the convergent validity of EDUCATOOL, the participants also completed the “Questionnaire for Professional Training Evaluation.”ResultsThe EDUCATOOL questionnaires include 12 items grouped into the following evaluation components: (1) reaction; (2) learning; (3) behavioural intent (post-course)/behaviour (follow-up); and (4) expected outcomes (post-course)/results (follow-up). In confirmatory factor analyses, comparative fit index (CFI = 0.99 and 1.00), root mean square error of approximation (RMSEA = 0.05 and 0.03), and standardised root mean square residual (SRMR = 0.07 and 0.03) indicated adequate goodness of fit for the proposed factor structure of the EDUCATOOL questionnaires. The intraclass correlation coefficients (ICCs) for convergent validity of the post-course and follow-up questionnaires were 0.71 (95% confidence interval [CI]: 0.61, 0.78) and 0.86 (95% CI: 0.78, 0.91), respectively. The internal consistency reliability of the evaluation components expressed using Cronbach’s alpha ranged from 0.83 (95% CI: 0.78, 0.87) to 0.88 (95% CI: 0.84, 0.92) for the post-course questionnaire and from 0.95 (95% CI: 0.93, 0.96) to 0.97 (95% CI: 0.95, 0.98) for the follow-up questionnaire. The test–retest reliability ICCs for the overall evaluation scores of the post-course and follow-up questionnaires were 0.87 (95% CI: 0.78, 0.92) and 0.91 (95% CI: 0.85, 0.94), respectively.ConclusionThe EDUCATOOL questionnaires have adequate factorial validity, convergent validity, internal consistency, and test–retest reliability and they can be used to evaluate training and learning programmes.

Cross-Cultural Adaptation of Mediterranean Diet Adherence Screener (MEDAS) Into Moroccan Arabic to Measure the Degree of Mediterranean Diet Adherence.

Background The Mediterranean diet (MD) has been recognized by several studies as beneficial for health improvement. The degree of adherence to this diet has also been evaluated using several scales, particularly time-consuming measures such as the Food Frequency Questionnaire (FFQ). This studyaims to (a) adapt into Moroccan Arabic the 14-item Mediterranean Diet Adherence Screener (MEDAS), which is a simple and brief tool that assesses the degree of diet adherence and was used in the Prevencion con Dieta Mediterranea (PREDIMED) study, and (b) determine its psychometric properties. Methods MEDAS consists of 12 questions on food frequency and two on dietary habits, with each question scoring 0 or 1. To translate and adapt the scale, Beaton et al.'s six-step cross-cultural adaptation process guidelines were followed. The screener's psychometric properties were tested on staff at the CHU Mohammed VI (Tangier), i.e., the hospital's administrative and maintenance staff, excluding medical and paramedical personnel. Internal consistency was evaluated using the Kuder-Richardson 21 (K-R 21) formula, while test-retest reliability was assessed using the intraclass correlation coefficient (ICC). Moreover, criterion validity was performed using the Spearman correlation between the MEDAS and the MedQ-Sus scores. Discrimination performance was also tested using the receiving operating characteristic (ROC) curve. Results The validation study included 160 participants who completed both questionnaires. The K-R 21 formula estimated strong internal consistency in the range of 0.851. The ICC of test-retest reliability was significant at 0.876 95% CI [0.831-0.909]. The MEDAS score correlated significantly with the comparative MedQ-Sus score (Spearman's rho = 0.494 95% CI [0.363-0.606], p < 0.001). Also, MEDAS can strongly distinguish between MD adherence and non-adherence (optimal cut-off = 7.5, sensitivity 0.81, specificity = 0.57), with an area under the curve (AUC) value of 0.743 95% CI [0.667-0.819], p < 0.001. Conclusion The results showed that MEDAS is a valid and time-saving instrument for assessing adherence to the MD in the Moroccan population.

Psychometric evaluation of the Indonesian version of the Person-centered Care Assessment Tool.

The number of Indonesian care staff working in hospitals and long-term care facilities caring for persons with dementia in Japan is increasing; however, there is no instrument available in the Indonesian language to assess their dementia care practice. This study aimed to translate the Person-centered Care Assessment Tool (P-CAT) and evaluate its psychometric properties in a sample of Indonesian care staff working in dementia care and long-term care facilities in Japan. This is a descriptive, methodological, and cross-sectional study. The P-CAT was translated into the Indonesian language. The draft was administered to Indonesian care staff (n = 218) working at long-term care facilities in Japan. Data were analysed using exploratory factor analysis (EFA), confirmatory factor analysis (CFA), known-group validity, internal consistency, and test-retest reliability. EFA showed three-factor and CFA of the three-factor indicated that the model had an acceptable fit (chi-squared statistics/degree of freedom = 1.78, comparative fit index = 0.94, root mean square error of approximation = 0.06) with a slightly different structure compared to the original P-CAT. Regarding known-group validity, the P-CAT total score was significantly higher for those who had training in dementia, who knew about person-centred care, and who showed satisfaction in the job. Internal consistency (Cronbach's α) of the total scale was 0.68 which is considered acceptable, and the test-retest reliability intraclass correlation coefficient was 0.61 which is considered moderate. The Indonesian P-CAT indicated sound validity and reliability to measure person-centred care among Indonesian care staff working in dementia care and long-term care facilities in Japan. The development of Indonesian P-CAT allows the evaluation of dementia care, promotes and further improves person-centred care for persons with dementia provided by Indonesian care staff working in long-term care facilities in Japan.

Validity and Reliability of The Turkish Version of The Pelvic Pain Impact Questionnaire

Introduction: The aim of this study was to evaluate the reliability and validity of the Turkish translation of the Pelvic Pain Impact Questionnaire(PPIQ-T).&#x0D; Material and Methods: This study was conducted with 110 female patients (mean age of 43.67±11.71years), who were being treated as inpatients or outpatients in the Obstetrics and Gynecology Department. Necessary permission for PPIQ was obtained and translation procedures were applied in terms of cultural adaptation. Test-retest and internal consistency were used for reliability. The correlation between the McGill Pain Instrument(MPQ) and the Short Form-36(SF-36) was looked at to determine the construct validity of the questionnaire. Additionally, exploratory factor analysis and confirmatory factor analysis were used to test the factorial validity of the PPIQ.&#x0D; Results: Test-retest reliability's intraclass correlation coefficient(ICC) was 0.95, while the Cronbach alpha value was 0.92. Significant correlation was determined between PPIQ and SF-36 questionnaires (r= 0.62-0.78, p

Adaptation of the Food Literacy Questionnaire for school children to Turkish: validity and reliability study.

Food literacy is the ability to understand the nature of food and its level of importance, to obtain, process, analyze, and use information about food. This study aims to translate and cross-culturally adapt the Food Literacy Questionnaire for school children (FLQ-sc) into Turkish and to study its psychometric properties of reliability and validity. The study was conducted with 303 students aged 12-14 in Kayseri, Turkey. A pilot study was conducted with 36 students, and a test-retest was conducted with 219 students, 2weeks after the first study was performed. Data were collected with the sociodemographic data form and FLQ-sc. Linguistic, content, face, and construct validity were evaluated for validity. Cronbach's alpha and intraclass correlation coefficients (ICCs) were calculated for the reliability evaluation. Model validity was tested with confirmatory factor analysis. Root mean square error of approximation (RMSEA), χ2/SD, and goodness-of-fit index (GFI) statistics were in good agreement. Comparative fit index (CFI), Tucker-Lewis index (TLI), and standardized root mean square error of approximation (SRMR) statistics were at acceptable levels (RMSEA = 0.033, χ2/SD = 1.324, GFI = 0.958, CFI = 0.944, TLI = 0.939, SRMR = 0.063). The Cronbach's alpha coefficient for the total scale score was quite good (0.795). The ICC for test-retest reliability was good (0.874) for the total scale score. Conclusion: The Turkish version of the Food Literacy Questionnaire for school children (FLQ-sc) is a valid and reliable measurement tool and can be used to evaluate food literacy levels in Turkish children aged 12-14. What is Known: • It is important to acquire knowledge and skills in food literacy from childhood because the behaviors learned during childhood and adolescence regarding food intake and preparation continue into adulthood. • In addition to the limited scales evaluating the food literacy levels of children, there is no scale evaluating the food literacy levels of Turkish children between the ages of 12 and 14. What is New: • The Turkish version of FLQ-sc is a valid and reliable scale for evaluating the food literacy levels of Turkish school children. • Scale is a suitable tool to ensure the comparison of food literacy levels in different student groups and measure abstract concepts such as education.

Development and validation of the Montreal cognitive assessment for people with hearing impairment (MoCA-H).

Hearing impairment is common among older adults and affects cognitive assessments for identification of dementia which rely on good hearing function. We developed and validated a version of the Montreal Cognitive Assessment (MoCA) for people with hearing impairment. We adapted existing MoCA 8.1 items for people with hearing impairment by presenting instructions and stimuli in written rather than spoken format. One Attention domain and two Language domain items required substitution by alternative items. Three and four candidate items respectively were constructed and field-tested along with the items adapted to written form. We used a combination of individual item analysis and item substitution to select the set of alternative items to be included in the final form of the MoCA-H in place of the excluded original items. We then evaluated the performance and reliability of the final tool, including making any required adjustments for demographic factors. One hundred and fifty-nine hearing-impaired participants, including 76 with normal cognition and 83 with dementia, completed the adapted version of the MoCA. A further 97 participants with normal hearing completed the standard MoCA as well as the novel items developed for the MoCA-H to assess score equivalence between the existing and alternative MoCA items and for independence from hearing impairment. Twenty-eight participants were retested between 2-4 weeks after initial testing. After the selection of optimal item set, the final MoCA-H had an area under the curve of 0.973 (95% CI 0.952-0.994). At a cut-point of 24 points or less sensitivity and specificity for dementia was 92.8% and 90.8%, respectively. The intraclass correlation for test-retest reliability was 0.92 (95%CI 0.78-0.97). The MoCA-H is a sensitive and reliable means of identifying dementia among adults with acquired hearing impairment.

Professional socialization of hospital nurses: A scale development and validation study

BackgroundTools currently available to measure professional socialization are outdated or could not reflect various properties of professional socialization of nurses. Thus, the objective of this study was to develop and validate a professional socialization measurement instrument for hospital nurses.MethodsFifty-two items were initially extracted from literature reviews and in-depth interviews with 32 nurses. After content validity testing, 48 items remained. They were used to survey 881 hospital nurses in Korea in the testing phase for construct validity and reliability.Results: Four factors (21 items) were extracted: ethical practice and reflection, perception of respect and recognition, clinical competency based on leadership, and desires and motivation for professional development. These factors demonstrated good construct validity and reliability. Correlation coefficients of professional socialization with professional value, compassion satisfaction, secondary traumatic stress, and burden were 0.58 (p < 0.001), 0.70 (p < 0.001), − 0.08 (p = 0.014), and − 0.56 (p < 0.001), respectively. Reliability had a Cronbach’s alpha of 0.95. Test-retest reliability intraclass correlation coefficient was 0.90.ConclusionsThe four professional socialization scale factors in this study reflected attributes of knowledge, skills, values, and professional roles. Professional socialization of nurses can be continuously developed by emphasizing elements of the professional socialization scale in nursing education programs. Nursing managers should help nurses go through the professional socialization process. The professional socialization scale will serve as a tool for developing careers of hospital nurses.

Dual-Frequency Bioelectrical Impedance Analysis is Accurate and Reliable to Determine Lean Muscle Mass in The Elderly

Background: Dual-frequency bioelectrical impedance analysis (DF-BIA) devices are more accessible and affordable than dual-energy X-ray absorptiometry (DXA); however, no studies have reported the accuracy of DF-BIA in body composition measurement, especially in the Thai elderly. The aims of this study were to (1) compare the accuracies of lean muscle masses measured by DF-BIA devices and DXA and (2) assess the reliability of the DF-BIA device. Methods: This cross-sectional study was conducted on participants older than 60 years who visited the Orthopedic Clinic of Siriraj Hospital. Whole-body and appendicular skeletal muscle masses (ASMs) were measured using DF-BIA (Tanita RD-545), with DXA (GE Lunar iDXA) as the standard reference. The test-retest reliability of the DF-BIA and the agreement between the devices were assessed using the intraclass correlation coefficient (ICC) and Bland–Altman plots. Regression analysis was used to develop an equation to estimate ASM values from BIA close to those from DXA. Results : The mean age of 88 participants was 73.8 (SD 8.0) years, with women predominating (84.1%). The agreement of BIA and DXA was very high for whole-body lean mass (ICC = 0.954) and ASM (ICC = 0.954), but the mean difference in muscle mass from DF-BIA was overestimated. The ICCs of test-retest reliability for whole-body muscle mass and ASM were 0.987 and 0.988, respectively. The equation for corrected ASM was formulated from a linear equation (R2 = 0.93). Conclusions: Although lean muscle mass from DF-BIA was minimally overestimated relative to DXA, this device had high accuracy and reliability for lean muscle mass evaluation in the elderly. DXA and DF-BIA are interchangeable for the assessment of muscle mass.

Cultural adaptation and validation of the Malay Chronic Kidney Disease Self-management instrument (MCKD-SM)

BackgroundThere is growing evidence that self‐management behaviour can improve outcomes for patients with chronic kidney disease (CKD). However, no measures are available in Malay to effectively assess the self-management of CKD. The aim of this study was to translate, culturally adapt and validate the Malay Chronic Kidney Disease Self-Management (MCKD-SM) instrument for Malay-speaking health professionals and patients.MethodsThis study was carried out in two phases: the translation and cultural adaptation phase and the validation phase. The instrument was translated from English to Malay and then adapted and validated in a sample of 337 patients with CKD stages 3–4 attending a nephrology clinic in a tertiary hospital in Malaysia. Structural validity was evaluated by exploratory factor analysis. The instrument’s reliability was assessed by internal consistency and test–retest reliability. The correlations between the MCKD-SM and kidney disease knowledge and the MCKD-SM and self-efficacy were hypothesised a priori and investigated.ResultsThe MCKD-SM instrument has 29 items grouped into three factors: ‘Understanding and Managing My CKD’, ‘Seeking Support’ and ‘Adherence to Recommended Regimen’. The three factors accounted for 56.3% of the total variance. Each factor showed acceptable internal reliability, with Cronbach’s α from 0.885 to 0.960. The two-week intra-rater test–retest reliability intraclass correlation coefficient values for all items ranged between 0.938 and 1.000. The MCKD-SM scores significantly correlated with kidney disease knowledge (r = 0.366, p < 0.01) and self-efficacy (r = 0.212, p < 0.01).ConclusionThe MCKD-SM was found to be a valid and reliable patient‐reported outcome measure of pre-dialysis CKD self-management behaviour in the Malay-speaking population.

Psychometric evaluation of the Pain Assessment in Advanced Dementia scale in an acute general hospital setting.

People with dementia are at risk of unplanned hospital admissions and commonly have painful conditions. Identifying pain is challenging and may lead to undertreatment. The psychometric properties of the Pain Assessment in Advanced Dementia (PAINAD) scale, in medical inpatients with dementia have not been evaluated. A secondary data analysis from a longitudinal study of 230 people with dementia admitted to two acute general hospitals in London, UK. Internal consistency, inter-rater reliability, test-retest reliability, concurrent validity, construct validity and discriminant validity of PAINAD were tested at rest and in movement. This predominantly female (65.7%) sample had a mean age of 87.2 (Standard Deviation; SD=5.92) years. Inter-rater reliability showed an intra-class correlation (ICC) of 0.92 at rest and 0.98 in movement, test-retest reliability ICC was 0.54 at rest and 0.66 in movement. Internal consistency was 0.76 at rest and 0.80 in movement (Cronbach's α). Concurrent validity was weak between PAINAD and a self-rating level of pain (Kendall's Tau; τ=0.29; p>0.001). There was no correlation between PAINAD and a measure of behavioural and psychological symptoms of dementia, suggesting no evidence of convergent validity. PAINAD scores were higher during movement than rest, providing evidence of discriminant validity (z=-8.01, p<0.001). We found good inter-rater reliability and internal consistency. The test-retest reliability was modest. This study raises concerns about the validity of the PAINAD in general acute hospitals. This provides an insight into pain assessment in general acute hospitals which may inform further refinements of the PAINAD.

Determining the reliable feature change in longitudinal radiomics studies: A methodological approach using the reliable change index.

Determination of reliable change of radiomics feature over time is essential and vital in delta-radiomics, but has not yet been rigorously examined. This study attempts to propose a methodological approach using reliable change index (RCI), a statistical metric to determine the reliability of quantitative biomarker changes by accounting for the baseline measurement standard error, in delta-radiomics. The use of RCI was demonstrated with the MRI data acquired from a group of prostate cancer (PCa) patients treated by 1.5 T MRI-guided radiotherapy (MRgRT). Fifty consecutive PCa patients who underwent five-fractionated MRgRT were retrospectively included, and 1023 radiomics features were extracted from the clinical target volume (CTV) and planning target volume (PTV). The two MRI datasets acquired at the first fraction (MRI11 and MRI21) were used to calculate the baseline feature reliability against image acquisition using intraclass correlation coefficient (ICC). The RCI was constructed based on the baseline feature measurement standard deviation, ICC, and feature value differences at two time points between the fifth (MRI51) and the first fraction MRI (MRI11). The reliable change of features was determined in each patient only if the calculated RCI was over 1.96 or smaller than -1.96. The feature changes between MRI51 and MRI11 were correlated to two patient-reported quality-of-life clinical endpoints of urinary domain summary score (UDSS) and bowel domain summary score (BDSS) in 35 patients using the Spearman correlation test. Only the significant correlations between a feature that was reliably changed in ≥7 patients (20%) by RCI and an endpoint were considered as true significant correlations. The 352 (34.4%) and 386 (37.7%) features among all 1023 features were determined by RCI to be reliably changed in more than five (10%) patients in the CTV and PTV, respectively. Nineteen features were found reliably changed in the CTV and 31 features in the PTV, respectively, in 10 (20%) or more patients. These features were not necessarily associated with significantly different longitudinal feature values (group p-value < 0.05). Most reliably changed features in more than 10 patients had excellent or good baseline test-retest reliability ICC, while none showed poor reliability. The RCI method ruled out the features to be reliably changed when substantial feature measurement bias was presented. After applying the RCI criterion, only four and five true significant correlations were confirmed with UDSS and BDSS in the CTV, respectively, with low true significance correlation rates of 10.8% (4/37) and 17.9% (5/28). No true significant correlations were found in the PTV. The RCI method was proposed for delta-radiomics and demonstrated using PCa MRgRT data. The RCI has advantages over some other statistical metrics commonly used in the previous delta-radiomics studies, and is useful to reliably identify the longitudinal radiomics feature change on an individual basis. This proposed RCI method should be helpful for the development of essential feature selection methodology in delta-radiomics.

Impaired ankle inversion proprioception during walking is associated with fear of falling in older adults.

BackgroundAnkle proprioception plays a critical role in lower limb movement control. However, the relationship between ankle proprioception and fear of falling (FOF) in older people is still unclear.Objective(1) This study aims to develop a new device for measuring ankle inversion proprioceptive discrimination sensitivity during walking, i.e., the Ankle Inversion Discrimination Apparatus–Walking (AIDAW), and assess the test–retest reliability of the AIDAW in both young and older adults; (2) to evaluate the discriminant validity of the measure by comparing ankle proprioception during walking between the two groups; and (3) to explore convergent validity by determining to what extent the AIDAW proprioceptive scores correlate with Fall Efficacy Scale-International (FES-I) scores.Materials and methodsThe AIDAW was purpose-built to test ankle inversion proprioceptive discrimination sensitivity during walking. The area under the receiver operating curve (AUC) was calculated as the proprioceptive discrimination score. In total, 54 adults volunteered. Test–retest reliability was evaluated in 12 young and 12 older adults, and another 15 young and 15 older adults completed the comparison study. FOF was assessed by using the FES-I.ResultsThe test–retest reliability intraclass correlation coefficient ICC (3,1) value for the whole group was 0.76 (95% CI: 0.52–0.89). The ICC values of the young and older groups were 0.81 (95% CI: 0.46–0.94) and 0.71 (95% CI: 0.26–0.91), respectively. The Minimal Detectable Change with 90% confidence (MDC90) values for the young and older groups were 0.03 and 0.11, respectively. There was a significant difference between the AIDAW proprioceptive sensitivity scores for the young and older groups (0.78 ± 0.04 vs. 0.72 ± 0.08, F = 5.06, p = 0.033). Spearman’s correlation analysis showed that the FES-I scores were significantly and negatively correlated with the AIDAW scores (rho = −0.61, p = 0.015), with higher FOF associated with worse ankle proprioception.ConclusionThe AIDAW is a reliable and valid device for measuring ankle proprioception during walking in both young and older adults. Ankle inversion proprioceptive discrimination sensitivity during walking was found to be impaired in the elderly compared to young adults. This impairment was found to be strongly associated with FOF, suggesting that assessment and intervention for ankle proprioception in this population are needed to reduce the risk of falls.

Korean Version of the Short Falls Efficacy Scale-International (FES-I): Study of Validity and Reliability

Purpose: The purpose of this study was to develop and test the validity and reliability of the Korean version of the short Falls Efficacy Scale-International (FES-I).Methods: The Korean version of the short FES-I was developed through the FES-I translation protocol. Participants for the psychometric tests included 300 older adults (100 visiting a senior welfare center, 100 registered as frail elderly in a public health center, and 100 visiting an orthopedic department at a university hospital after hip-fracture surgery). The psychometric tests included content, construct, criterion validity, internal consistency, and test-retest reliability.Results: One factor of the seven items was validated and explained by 79.4% of the total variance. Confirmatory factor analysis supported the model fit and convergent validity. Mean scores according to fall history were also significantly different. Correlation analysis confirmed criterion validity with a single item of fear of falling (r=.76, p&lt;.001). There were reliable internal consistencies with Cronbach’s α coefficients of .95 and, .93, and the ICC (Intra-class Correlation Coefficient) for test-retest reliability was .95.Conclusion: This scale showed excellent validity and reliability in Korea. It is useful to measure fear of falling for older adults in clinical or community settings.

147 Development and validation of a caregiver-reported numeric rating scale for measuring pruritus in children aged 6 months to

Pruritus is the most burdensome symptom of atopic dermatitis (AD). A novel 11-point caregiver-reported worst scratch/itch numeric rating scale (WSI NRS; from 0 [no itching] to 10 [worst itching possible]) to assess pruritus in young patients with moderate-to-severe AD was developed and evaluated. Qualitative interviews were conducted with 24 caregivers of children with AD aged 6 months to <6 years to evaluate content validity. Caregivers understood the WSI NRS and were able to select a response without difficulty. Caregivers endorsed “scratching/itching” as optimal phrasing for their observation of behaviors and representation of their child’s itch severity. Psychometric evaluations of the instrument were performed using data from a Phase 3 study of dupilumab in 161 children (aged 6 months to <6 years) with moderate-to-severe AD (NCT03346434). The test-retest reliability intraclass correlation coefficient (95% CI) was 0.94 (0.89, 0.96), above the recommended 0.70 threshold. The WSI NRS showed moderate to strong correlations with assessed caregiver/patient/clinician-reported clinical outcome assessments (COAs), supporting the convergent and divergent validity of the instrument. The discriminating ability of the WSI NRS was shown by significant differences in WSI NRS scores between patients grouped into COA-based bands. Anchor-based methods supported the use of at least a 2 to 4–point change in WSI NRS as clinically meaningful. These results indicate that the caregiver-reported WSI NRS is a valid, reliable and responsive instrument to assess pruritus in young children with moderate-to-severe AD.