Assessment Of Test-retest Reliability Research Articles

Assessment of the psychometric properties of the Spanish version of EORTC QLQ-MY20 and evaluation of health-related quality of Life outcomes in patients with relapsed and/or refractory multiple myeloma in the real-world setting in Spain: results from the CharisMMa study

We evaluated the psychometric properties of the Spanish version of the European Organization for Research and Treatment of Multiple Myeloma (MM) specific quality-of-life (QoL) questionnaire module (QLQ-MY20) in relapsed/refractory MM (RRMM) patients. This was an observational, cross-sectional, multicenter study using EORTC QLQ-C30 and QLQ-MY20 in RRMM patients (ClinicalTrials.gov ID NCT03188536). We assessed the non-response rate, ceiling/floor effects, internal consistency, test-retest reliability, and validity. The study included 276 patients (53.3% males, mean [SD] age of 67.4 [10.5] years). The EORTC QLQ-MY20 showed a low non-response rate, very low ceiling and floor effects, and good internal consistency. The test-retest reliability assessment revealed good temporary stability, the construct validity analysis stated four main factors similar to the ones of the original version, and the criterion validity assessment showed no differences between groups. In conclusion, the Spanish version of EORTC QLQ-MY20 is a reliable and valid tool for assessing QoL in RRMM patients.

Test-Retest Reliability of Virtual Acoustic Space Identification Test in School-Going Children.

The virtual acoustic space identification (VASI) test was designed to assess spatial-hearing acuity by simulating sound location perception in a closed field (under headphones). The utility of this tool in children can be asserted only if the test results are consistent across measurement sessions, which is evaluated in this study using test-retest reliability assessments. The VASI test assessed the spatial abilities of 40 typically developing school-aged children aged 7-13 years (M age = 10.47 ± 1.83 years, 22 boys, 18 girls). The test consisted of eight virtual location percepts (with 45° separation) produced under headphones (Sennheiser HD 569). Each spatial percept was presented randomly 7 times at 65 dB SPL. Each participant completed the assessment in three measurement sessions (baseline, intrasession, and intersession). The accuracy scores at each location and overall accuracy scores were compared across the sessions. The Shapiro-Wilk test indicated that the VASI data were not normally distributed. Intraclass correlation coefficient analysis revealed excellent test-retest reliability of the overall accuracy scores and moderate-to-high reliability of location-specific scores. This was complimented by the low response variability of the overall and location-specific accuracy scores. The Bland-Altman analysis also indicated minimal bias in VASI accuracy scores across the three sessions. It can be concluded from the results that VASI is a reliable tool for assessing spatial-hearing acuity in school-aged children. The high test-retest reliability and ease of portability make the test highly relevant for classroom setups where early diagnosis and intervention of spatial deficits can play a critical role in determining the academic success of school-going children.

Psychometric properties of the arabic version of the maslach burnout inventory-human services survey (MBI-HSS) among lebanese dentists

BackgroundDentists are at risk of burnout syndrome, which can have negative impacts on their work environment and productivity. Assessing burnout is crucial for maintaining the well-being and effectiveness of dentists in their profession. The present study aims to evaluate the psychometric properties of the Arabic version of the Maslach Burnout Inventory Human Services Survey (MBI-HSS) among dentists.MethodsThe original English version of the MBI-HSS was translated into Arabic, and then back-translated into English by experienced bilingual professionals. Lebanese dentists were asked to participate in the study between February and June 2019. Data collected included demographic information and items from the Arabic version of the MBI-HSS.ResultsA total of 441 people participated in the study, of whom 58.3% were men. The mean age of the sample was 39.6 years (SD = 12.8), with a range of 23 to 68 years old. Approximately 60% of dentists were specialists. Cronbach’s alphas were as follows: emotional exhaustion (alpha = 0.855), depersonalization (alpha = 0.823), and personal achievement (alpha = 0.667). The results of the test-retest reliability assessment demonstrated the strong reproducibility of the MBI-HSS [EE, ICC = 0.927 (0.845, 0.966), p-value < 0.0001; PA, ICC = 0.963 (0.921–0.983), p-value < 0.001; DP, ICC = 0.764 (0.497–0.889), p-value < 0.0001]. The exploratory factor analysis of the MBI-HSS yielded three psychometrically robust sub-domains representing dimensions of “emotional exhaustion,” “depersonalization,” and “personal achievement,” which explained 57.8% of the scale’s total variance. The confirmatory factor analysis revealed that the 15-item model (excluding items 4, 5, 12, 13, 16, 20, and 22) was the most fitting for the data.ConclusionsThe Arabic version of the MBI-HSS scale demonstrated good psychometric properties in Lebanese dentists. However, it would be important to conduct further research to confirm its reliability and validity in other Arab countries.

Adaptation and validation of the Spanish version of the thyroid-cancer-specific Thyca-QoL scale: A cross-sectional study

Introduction. Thyca-QoL is a specific instrument to assess QoL in thyroid cancer patients, but it is not validated in Spanish language. The aim was to assess the psychometric properties of the Thyca-QoL. Methods. This is a prospective cross-sectional study. The Thyca-QoL was translated and adapted to Spanish language. A psychometric validation using an exploratory principal axis factor analysis and confirmatory analysis, concurrent validation compared with EORTC QLQ-C30 and a test-retest reliability assessment was done. Results. A total of 296 patients were included. Exploratory factor analysis showed a seven-factor solution with good diagnostic tests results. Cronbach´s alpha for the global scale was 0.86. The comparison between the ThycaQoL and the EORTC QLQ-C30 demonstrated a high correlation (rho= 0.75) and coefficient for test-retest was 0.87. Discussion. The validation process followed all the methodological steps necessary to guarantee the performance of the instrument. The measurements of the internal validity, reliability and reproducibility reached similar results as the original validation. The factor analysis showed a solution with seven factors that resembles the original results. Reproducibility was high for voice, sympathetic, sex, and chilliness domains and moderate for the others and the instrument had the ability to discriminate between clinical conditions. Conclusion. Thyca-QoL is a reliable and objective instrument to be used in clinical practice and for research objectives in Spanish speaking patients.

Content Validity and Psychometric Properties of the German Version of the Holm and Cordoba Urinary Tract Infection Score for Uncomplicated Urinary Tract Infections in Women: Protocol for a Validation Study.

Uncomplicated urinary tract infections (UTIs) in women are among the most common bacterial infections in primary care. Given the health threats related to the overuse of antibiotics, alternative options are of increasing importance. Patient-reported outcome measures are valuable tools for including the patients' perspective when evaluating the efficacy of these strategies. Aiming to identify a suitable instrument to measure the severity and bothersomeness of UTI symptoms in women, we performed a systematic review of the literature and identified the Holm and Cordoba Urinary Tract Infection Score (HCUTI), which measures the severity, bothersomeness, and impact of uncomplicated UTIs on daily activities. This instrument showed sufficient content validity but needs translation and further validation before it can be used in German research. For use in the German setting, we aim (1) to perform translation and linguistic validation of the HCUTI and (2) to evaluate content validity and psychometric properties of the German version of the HCUTI in a population of women with uncomplicated UTIs. The HCUTI will be translated and linguistically validated using the dual-panel method. This process involves a bilingual translation panel and a lay panel to check the comprehensibility of the translation. Content validity of the translated questionnaire will be assessed using cognitive interviews according to the criteria for good content validity as recommended by the COSMIN (Consensus-based Standards for the selection of health Measurement Instruments) group involving women with uncomplicated UTIs and health care professionals. Subsequent psychometric validation of the German version of the HCUTI in a population of women with uncomplicated UTIs will include the assessment of structural validity, internal consistency, test-retest reliability, construct validity, responsiveness, and interpretability. Results of the translation and linguistic validation process and the results of the content validity study were obtained in September 2023 and will be published separately. Data on the psychometric properties of the German version of the HCUTI are anticipated in mid-2024. We expect that data from the content validity study will provide important suggestions for potential modifications of the HCUTI for use in the German setting. The final version of the questionnaire will be used for the assessment of its psychometric properties in a large population of women with uncomplicated UTIs. PRR1-10.2196/49903.

DYMUS-Hr self-assessment questionnaire (Croatian version) for dysphagia in multiple sclerosis-validity, reliability, and cross-cultural adaptation.

The prevalence of dysphagia in the early phases of multiple sclerosis is 30-40%, with an estimated of 30% of cases going undiagnosed cases. Such complications can lead to malnutrition, dehydration, and aspiration pneumonia and have a great impact on the quality of life and psychosocial status of a person with MS. The aim of this study was the validation of dysphagia in multiple sclerosis self-assessment questionnaire (DYMUS) in the Croatian language. The cross-cultural adaptation process included a back-forward translation technique of the English language version of DYMUS to the Croatian language, with pilot testing on 30 participants. The validity and reliability of the Croatian version of DYMUS (DYMUS-Hr) was applied to 106 MS patients, with comparison to the Eating Assessment Tool (EAT10), the Water Swallowing Test (WST), and a dichotomous self-assessment question. In the assessment of test-retest reliability, 99 MS patients were included. Internal consistency of DYMUS-Hr was very good (Cronbach's alpha-0.837); Cronbach's alpha was 0.819 for the "dysphagia for solids", and 0.562 for "dysphagia for liquids" subscale. A significant correlation (p < 0.001) was found between DYMUS-Hr and EAT10 (Spearman's rho-0.787), and WST (Spearman's rho-0.483). Construct validity was assessed with the self-assessment question and interpreted with the Mann-Whitney U test. Test-retest reliability showed moderate to substantial Cohen's Kappa reliability for each item. DYMUS-Hr is a valid and reliable screening assessment tool for patients with MS. There is a general lack of awareness about dysphagia symptoms among patients with MS; consequently, this disorder receives inadequate attention and often goes untreated.

Aging effect and test-retest reliability of the sinusoidal harmonic acceleration test and velocity step test using nanotorque rotatory chair

IntroductionRotatory chair testing has been used to evaluate horizontal canal function. Frequently used tests include sinusoidal harmonic acceleration test (SHAT) and velocity step test (VST). ObjectivesAssessment of age effect on the SHAT and VST and assessment of test-retest reliability of the parameters of those two tests. MethodsA prospective study was performed on 100 subjects with no ear or vestibular complaints and normal vestibular evaluation. They were divided into two groups; Group A: below 50 years of age and Group B: 50 years of age or above. SHAT was presented at frequencies 0.02, 0.04, 0.08, 0.16, 0.32, 0.64 Hz with a peak velocity of 60°/s. VST was performed using a maximum velocity of 100°/s with acceleration and deceleration of 200°/s2. Thirty subjects were tested twice to assess reliability. ResultsStudy participants ranged in age from 20 to 67 years. Regarding group A, the mean age was 30.92 ± 7.31 and 55.36 ± 4.61 for group B. No significant differences were found in SHAT parameters between the two groups. As well, there was no significant difference in VST per-rotatory time constant, however, post-rotatory time constant was significantly longer for Group B (P value < 0.05). Intraclass correlation coefficient (ICC) values showed moderate to good reliability (ICC 0.580–0.818) for SHAT parameters for the lower frequencies and indicated moderate reliability for VST time constant (ICC 0.509–0.652). ConclusionsAge has no significant effect on the parameters of SHAT and VST. Test-retest reliability is generally good for both tests.

The amyotrophic lateral sclerosis-health index (ALS-HI): development and evaluation of a novel outcome measure

Objective: The identification of effective therapeutics for ALS necessitates valid and responsive outcome measures to track disease progression and therapeutic gain in clinical trial settings. The Amyotrophic Lateral Sclerosis-Health Index (ALS-HI) is a multifaceted, disease-specific patient-reported outcome measure (PRO) designed to measure ALS symptomatic disease burden in adults with ALS. Methods: Through a national cross-sectional study of individuals with ALS, we identified the most important symptoms in ALS. These symptoms were incorporated into the ALS-HI, a measure that quantifies the multifaceted disease burden in ALS. We performed factor analysis, qualitative patient interviews, test-retest reliability assessment, and known groups analysis to evaluate and validate the ALS-HI. Results: The cross-sectional study included 497 participants with ALS who identified the most important symptoms to include in the ALS-HI. Fifteen participants beta tested the ALS-HI and found it to be clear, easy to use, and relevant. Twenty-one participants engaged in a test-retest reliability study, which indicated the reliability of the instrument (intraclass correlation coefficient = 0.952 for full instrument). The final ALS-HI and its subscales demonstrated a high internal consistency (Cronbach’s α = 0.981 for full instrument) and an ability to differentiate between groups with dissimilar disease severity. Conclusions: This research supports use of the ALS-HI as a valid, sensitive, reliable, and relevant PRO to assess the multifactorial disease burden faced by adults with ALS. The ALS-HI has potential as a mechanism to track disease progression and treatment efficacy during therapeutic trials.

Binocular video head impulse test: Normative data study.

The video head impulse test (vHIT) evaluates the vestibulo-ocular reflex (VOR). It's usually recorded from only one eye. Newer vHIT devices allow a binocular quantification of the VOR. To investigate the advantages of simultaneously recorded binocular vHIT (bvHIT) to detect the differences between the VOR gains of the adducting and the abducting eye, to define the most precise VOR measure, and to assess gaze dys/conjugacy. We aimed to establish normative values for bvHIT adducting/abducting eye VOR gains and to introduce the VOR dysconjugacy ratio (vorDR) between adducting and abducting eyes for bvHIT. We enrolled 44 healthy adult participants in a cross-sectional, prospective study using a repeated-measures design to assess test-retest reliability. A binocular EyeSeeCam Sci 2 device was used to simultaneously record bvHIT from both eyes during impulsive head stimulation in the horizontal plane. Pooled bvHIT retest gains of the adducting eye significantly exceeded those of the abducting eye (mean (SD): 1.08 (SD = 0.06), 0.95 (SD = 0.06), respectively). Both adduction and abduction gains showed similar variability, suggesting comparable precision and therefore equal suitability for VOR asymmetry assessment. The pooled vorDR here introduced to bvHIT was 1.13 (SD = 0.05). The test-retest repeatability coefficient was 0.06. Our study provides normative values reflecting the conjugacy of eye movement responses to horizontal bvHIT in healthy participants. The results were similar to a previous study using the gold-standard scleral search coil, which also reported greater VOR gains in the adducting than in the abducting eye. In analogy to the analysis of saccade conjugacy, we propose the use of a novel bvHIT dysconjugacy ratio to assess dys/conjugacy of VOR-induced eye movements. In addition, to accurately assess VOR asymmetry, and to avoid directional gain preponderance between adduction and abduction VOR-induced eye movements leading to monocular vHIT bias, we recommend using a binocular ductional VOR asymmetry index that compares the VOR gains of only the abduction or only the adduction movements of both eyes.

Anterior Cruciate Ligament-Return to Sport After Injury Scale: Reliability and Validity of the Persian Version.

The Anterior Cruciate Ligament-Return to Sport after Injury scale (ACL-RSI) is used to measure athletes' psychological readiness in terms of their emotions, confidence in performance, and risk appraisal with respect to return to sport after ACL reconstruction. To translate and cross-culturally adapt the ACL-RSI to the Persian version and evaluate the reliability and validity of this scale in patients with ACL reconstruction. Clinical measurement study (psychometric analysis). To assess test-retest reliability, 100 participants were asked to complete the Persian version of the ACL-RSI 2 times with a 7- to 10-day interval. In the first assessment, the patients also filled the Injury-Psychological Readiness to Return to Sport Questionnaire, Tampa Scale of Kinesiophobia, International Knee Documentation Committee Subjective Knee Form, and Knee Injury and Osteoarthritis Outcome Score. Internal consistency (Cronbach alpha, α), test-retest reliability (intraclass correlation coefficients), measurement error (standard error of measurement and minimum detectable change), and construct validity (Pearson r) were determined. Our results showed good internal consistency (Cronbach alpha = .94) and excellent test-retest reliability (intraclass correlation coefficients = .90 (.85-.93)]. Standard error of measurement and minimum detectable change were 4.64 and 12.85, respectively. No significant bias was observed between test and retest. In addition, based on the results of correlation analysis, all hypotheses of this study were confirmed. The Persian version of the ACL-RSI had a strong correlation with Injury-Psychological Readiness to Return to Sport (I-PPR) (P < .001, r = .76) and Tampa scale of Kinesiophobia (TKS) (P < .001, r = -.68). Furthermore, a moderate correlation was observed between the Persian version of the ACL-RSI and the International Knee Documentation Committee Subjective Knee Form (P < .001, r = .44) and between this version of the ACL-RSI and the subscales of Knee Injury and Osteoarthritis Outcome Score (P < .001, r = .30-.55). Given its acceptable reliability and validity, the Persian version of the ACL-RSI seems to be a suitable tool for evaluating psychological readiness to return to sport after ACL reconstruction.

Adolescents' Emotion Regulation Strategies Questionnaire-Extended: Further Development and Associations With Mental Health Problems in Adolescence.

Emotion regulation (ER) is implicated in a range of psychopathologies and behavioral problems that are prevalent or have their initial onset in adolescence. In this study, we aim to evaluate the psychometric properties (factor structure, internal consistency, and construct validity) of the Adolescents' Emotion Regulation Strategies Questionnaire-Extended (AERSQ-E), a modified and extended version of an ER instrument developed by Zhou et al. Across six sub-studies using data from different Swedish adolescent community samples (1,104 students in total), we generated and validated a 23-item version containing six subscales: rumination/negative thinking, positive reorientation, creative expression, aggressive outlet, social support, and distraction. Assessing test-retest reliability, internal consistency, measurement invariance as well as convergent and discriminant validity, we could establish, with some limitations, the general reliability and validity of the AERSQ-E as a valid measure of ER strategies for use in adolescence.

Validation of the 'Pelvic Pain Map': a new self-assessment tool for chronicpelvicpain localisation.

To develop and validate the Pelvic Pain Map to fill a gap in the need for a localised body map of the pelvic region. The Pelvic Pain Mapincorporated input from 12 chronic pelvic pain experts across the United States, as well as patient feedback to assess face validity. Finalised diagrams are single, front-facing images of the male and female pelvis that incorporate both abdominal and perineal views. Assessment of test-retest reliability and construct (convergent and discriminant) validity was carried out on a retrospective cohort of patients with chronic pelvic pain syndrome (CPPS) who completed the maps from January 2022 to May 2022. Other measures usedinthe validation process consisted of the male and female forms of the Genitourinary Pain Index (GUPI) and the short form (six item) of the Pain Catastrophising Scale (PCS-6). Test-retest for individual map zones demonstrated moderate to excellent reliability (Cohen's kappa coefficients ranging from 0.28 to 0.64) and for total map zones demonstrated excellent reliability (intraclass correlation coefficient = 0.90). Convergent validity for individual map zones with location descriptors from the GUPI was strong (phi coefficients ranging from 0.26 to 0.79) and for total map zones was moderate (Spearman's correlation coefficient = 0.56). Discriminant validity for total map zones with separate, but related constructs from the GUPI and PCS-6 was weakly positive (Spearman's correlation coefficients ranging from 0.27 to 0.32). This study suggests that the Pelvic Pain Map is a valid and reliable tool for assessing location of pain in patients with CPPS. Our findings highlight the potential utility of the PelvicPainMap in guiding treatment selection and monitoring therapeutic response in patients with chronic pelvic pain.

Validity and reliability of the University of California and Los Angeles Loneliness Scale in individuals with chronic obstructive pulmonary disease

BACKGROUND The psychometric properties of loneliness measures have not been reported in individuals with chronic obstructive pulmonary disease (COPD). This study aimed to assess the validity and reliability of the University of California and Los Angeles Loneliness Scale (UCLA-LS) version 3 for use in this population. METHODS The UCLA-LS was administered at baseline and again after 1 to 2 weeks for test-retest reliability assessment. Intraclass Correlation Coefficient (ICC) was used to assess reliability and estimate minimal detectable change (MDC). Construct validity was established by assessing known groups, and convergent and divergent validity. RESULTS Of the 47 individuals included in this study, 40 persons (87%) reported moderate to high loneliness levels. The UCLA-LS discriminated (p < 0.03) between groups based on marital status, with higher loneliness levels for single (mean difference [MD] = 8 points) and widowed (MD = 7 points) compared to married individuals. The scale had moderate to strong associations with measures of depression (ρ = 0.69-0.72; p < 0.001), anxiety (ρ = 0.46-0.52; p < 0.03), and quality of life (Chronic respiratory questionnaire [CRQ]-Fatigue: ρ = −0.51-−0.53; CRQ-Emotional function: ρ = −0.59-−0.57; CRQ-Mastery: ρ = −0.43-−0.46; p < 0.003). The UCLA-LS showed excellent test-retest reliability with ICC values of 0.96. To detect a change in version 3 UCLA-LS, the MDC score should equal or exceed 7.8 points. CONCLUSION UCLA-LS demonstrated excellent known groups, convergent and divergent validity, and test-retest reliability. These findings may help improve the interpretability of loneliness levels in individuals with COPD.

Adapting an evidence-based physical activity questionnaire for people with physical disabilities: A methodological process

BackgroundPractitioners and researchers often adapt tools, practices, and programs to meet the needs of culturally diverse population groups, but do not consider populations with disability. While there is some research on guidelines for adapting evidence-based programs, there is no systematic process for adapting survey instruments. Rather than creating separate instruments for people with physical disabilities (PWD), it is critical that instruments are designed to capture data on people with and without disabilities for comparison purposes. Given the disproportionately high rates of physical inactivity and obesity in PWD, we developed a methodology to adapt an evidence-based physical activity instrument. ObjectiveTo create a methodology to adapt surveys to be inclusive of PWD and use the methodology to adapt an evidence-based physical activity survey. MethodsA framework was developed to adapt a physical activity survey instrument (International Physical Activity Questionnaire, IPAQ) to be inclusive of PWD. The framework, referred to as SAVe-IT, includes five steps: Step 1) Select survey instrument to adapt; Step 2) Adapt the survey instrument; Step 3) Verify adaptations with experts; Step 4) Implement pilot test; Step 5) Test the tool to confirm reliability. ResultsThe adapted IPAQ passed review by the expert panels and the pilot test (n = 20). Assessment of test-retest reliability (n = 30) yielded strong intraclass correlation coefficients of 0.950 for the total score for the whole sample, 0.950 for PWD (n = 15) and 0.952 for people without disability (n = 15). ConclusionsThe SAVe-IT framework resulted in the successful adaptation of the IPAQ and can be used in populations with and without physical disabilities.

Assessment of the 4-meter walk test test-retest reliability and concurrent validity and its correlation with the five sit-to-stand test in chronic ambulatory stroke survivors

BackgroundThe 4-meter walk test (4-MWT) is a widely used measure to assess gait speed in the elderly but has not been validated for stroke survivors to date. ObjectivesTo assess the test-retest reliability and concurrent validity of the 4-MWT compared to the 10-meter walk test (10-MWT) as a measure of gait speed in chronic post-stroke. Secondary outcome measure: to assess the correlation of both gait measures with the 5 times sit-to-stand test (5TSTS). MethodsA cross-sectional observational study was conducted. Reliability was assessed by intraclass correlation coefficient (ICC2,1), standard error of measurement (SEM) and minimal detectable change (MDC-95%). Bland & Altman analysis was used to quantify agreement between the 4-MWT and the 10-MWT. Two consecutive walking trials of the 4-MWT and 10-MWT followed by 5TSTS were performed all on the same day. A single researcher made all measurements. ResultsThirty-six chronic ambulatory post-stroke (average age 58.56 ± 11.28 years) were analyzed at their self-selected walking speed with a dynamic start. The 4-MWT showed excellent concurrent validity and test-retest reliability: ICC2.1 = 0.991 (95% CI: 0.983, 0.996); SEM= 0.032 and MDC- 95% = 0.090 m/second) with a strong positive correlation with the 10-MWT (r = 0.957, p < 0.001). The Bland & Altman analysis showed a concordance of −0.05 m/second bias (p = 0.039) (95% limits of agreement: 0.20 to −0.29 m/second). The paired t-test showed no statistically significant difference in the mean of both walking tests (p < 0.091). However, there was only moderate correlation between the two gait assessments and the 5TSTS. ConclusionsThis study indicates excellent test-retest reliability concurrent validity and strong correlation between 4-MWT and 10-MWT with a dynamic start at comfortable speed. The 4-MWT could be used as a measure of gait speed in both outpatients and home settings in chronic ambulatory stroke survivors.

Test-retest reliability of human threat conditioning and generalization across a 1-to-2-week interval.

Given the increasing use of threat conditioning and generalizationfor clinical-translational research efforts, establishing test-retest reliability of these paradigms is necessary. Specifically, it is an empirical question whether the same participant evinces a similar generalization gradient of conditioned responses across two sessions with the identical contingencies and stimuli. Here, 46 human volunteers participated in an identical auditory threat acquisition and generalization protocol at two sessions separated by 1-to-2 weeks. Skin conductance responses (SCR) and trial-by-trial shock risk ratings served as primary measures. We used linear mixed effects modeling to test differential threat responses and generalization gradients, and Generalizability (G) theory coefficients as our primary formal assessment of test-retest reliability of intraindividual stability and change across time. Results showed largely invariant differential conditioning and generalization gradients across time. G coefficients indicated fair reliability for acquisition and generalization SCR. In contrast, risk rating reliabilities were mixed, and reliability was particularly low for acquisition risk ratings. Our findings generally support reliability of the threat conditioning and generalization paradigm for shorter test-retest intervals and highlight their utility for assessments of behavioral interventions in mental health research, but challenges remain and further work is needed. Threat conditioning and generalization tasks are increasingly used for translational efforts to improve behavioral interventions, and thus test-retest reliability for these tasks needs to be established. Our results support the test-retest reliability of threat conditioning and generalization over a relatively short (1-to-2week) interval, but this depends on the measure used (physiological vs. self-report). Overall, these tasks could be appropriate for repeated testing over the course of a short-duration intervention study, but more research is needed, particularly in regard to longer-duration studies.

The Cross-Cultural Adaptation and Validation of the Persian Version of Dental Discomfort Questionnaire (P-DDQ).

It seems essential to detect toothache in children through a validated instrument. Dental Discomfort Questionnaire (DDQ) could specifically detect the behaviors that indicate toothache through parental reports. Current study aimed to conduct a cross-cultural adaptation process and test the validity and reliability of the Persian version of DDQ (P-DDQ). In this cross sectional study, 60 children aged 25 to 60 months and their parents who referred to the Pediatric Department of Shiraz Dental School were selected. Parents filled out the DDQ and one examiner recorded the dmft index. To adapt the DDQ questionnaire, conceptual and item equivalence, semantic equivalence and operational equivalence were performed. The dimensions of P-DDQ were evaluated using exploratory factor analysis (EFA). Test-retest reliability and internal consistency assessments were respectively carried out using weighted kappa coefficient (kw) and Cronbach's alpha. Moreover, the construct validity was evaluated through Mann-Whitney U test and Spearman's correlation coefficient. Kruskal-Wallis H and Dunn's post-hoc tests were applied for discriminant validity. The cross-cultural adaptation of P-DDQ was conducted and minor necessary modifications were applied. Test-retest reliability showed moderate and high levels of agreement for DDQ items except for two items. An acceptable internal consistency was observed between DDQ items (Cronbach's alpha= 0.769). EFA showed that almost all 12 items of the questionnaire were included in three factors. Both construct and discriminant validities were established for P-DDQ. P-DDQ was cross-culturally well-adapted, validated, and reliable questionnaire applied with the purpose of detecting toothache among children in Iran.

A digital biomarker for remote self-assessment of Alzheimer's Diseases: development and validation.

Online data-collection provide an opportunity for Alzheimer's Disease research to collect large datasets crucial for understanding important public health concerns. However, the reliability of online tasks as compared to those administered in the lab is poorly examined. Our goal is to validate an online version of the short-term memory-binding task (STMBT), a potential digital biomarker sensitive to Alzheimer's Disease (Parra et al., 2010), to understand if data collected online in two environments, at-home and in the lab, is comparable. We created an online version of the STMBT task using Psytoolkit (Stoet 2010; Stoet 2017). Development involved piloting, group and user discussions to explore how such a novel tool could be best presented for self-assessment. Useful insights led to refinement of the online tool (i.e., instruction videos, images, and text). The validation stage involves test-retest reliability assessment of cognitively fit participants (aged >40 years) who complete the two conditions of this paradigm (i.e., shape only and binding). Task Environment (home and in the lab) and conditions (shape and binding) were fully counterbalanced. Measures of general cognitive abilities, anxiety and at-home environment were also taken. Recruitment is on-going, but preliminary data (n=10) has already proved informative. A repeated measures ANOVA looking at task-accuracy with factors of Environment (home vs. lab) and Condition (shape vs. binding) revealed no significant effects of Environment: F(1, 9) = 0.308, p = .591; Condition: F(1, 9) = 2.202, p = .172); or Interaction: F(1, 9) = 0.308, p = .591). For the shape condition, all participants performed near ceiling regardless of testing environment. In the binding condition, we observed good-to-excellent test-retest reliability between environments using single measures interclass correlation (ICC = 0.954, CI 0.83-0.99, (F(9, 9) = 39.62, p <.001). These preliminary results indicate the STMBT can provide reliable data when self-administered using an online version of the task which has important implications for public health researchers. For our fully powered sample, we will provide summary of other measures.

Assessment of the modified O'Connor Tweezer Dexterity and Purdue Pegboard test for use among dental students.

The current study aimed to assess criteria validity and test-retest reliability of the modified O'Connor Tweezer Dexterity (O'Connor) and the Purdue Pegboard test (PPT) for use among dental students. Occupational therapists were asked to assess dentist-related skills due to the high percentage of students who failed the dental school exams that year. The O'Connor and the PPT are suitable for these purposes, they aim to evaluate fine motor skills requirements. The original tests were modified for use under indirect visualization conditions (through a mirror) to mimic the typical dentists' work environment. A total of 110 dentists were included in the present study (50 dentists for the O'Connor test and 60 for the PPT). Both tests were conducted twice. Initially, the original version of the tests was followed by the modified versions (through a mirror). For the test-retest reliability assessment, 21 participants (10 participants from the O'Connor group and 11 participants from the PPT group) repeated the evaluation within a 1-week interval using the same settings (original followed by modified versions). Both versions of the O'Connor tests were significantly correlated (r=0.54, p<0.01), as were the two PPT versions (r=0.640, p<0.01). Significantly test-retest reliability was found for both tests. The interclass correlation ranged between 0.883 and 0.997, p<0.000. The results confirmed our hypothesis, demonstrating a criteria validity and test-retest reliability assessment of the modified O'Connor and the modified PPT for assessing dentists.

Test–retest reliability and measurement error of the WHO-5 Well-being Index and the Problem Areas in Diabetes questionnaire (PAID) used in telehealth among patients with type 1 diabetes

BackgroundPatient-reported outcome (PRO) measures may be used in telehealth for the clinical assessment of mental health and diabetes distress, which are important aspects in diabetes care, but valid and reliable instruments on these topics are necessary. We aimed to evaluate the test–retest reliability and measurement error of the Danish versions of the WHO-Five Well-being Index (WHO-5) and Problem Areas in Diabetes (PAID) questionnaires used in a PRO-based telehealth intervention among patients with type 1 diabetes. A further aim was to evaluate the test–retest reliability of single items concerning patients’ symptom burden and general health status.MethodsOutpatients with type 1 diabetes from the Steno Diabetes Center Aarhus, Aarhus University Hospital, Denmark, were enrolled from April 2019 to June 2020. Patients aged ≥ 18 who had type 1 diabetes for > 1 year, internet access, and the ability to understand, read, and write Danish were included. Intraclass correlation coefficients (ICC) and weighted Kappa values were used to assess test–retest reliability, and measurement error was assessed by estimating the minimal detectable change (MDC).ResultsA total of 146/255 (57%) patients completed the web questionnaire twice. The median response time between the two-time points was five days. The ICC of the WHO-5 scale was 0.87 (95% CI 0.82–0.90), and MDC was 18.56 points (95% CI 16.65–20.99). The ICC of the PAID scale was 0.89 (95% CI 0.84–0.92), and MDC was 11.86 points (95% CI 10.46–13.70). Overall, test–retest reliability of single symptoms and general health status items was substantial.ConclusionsThe WHO-5 and PAID questionnaires, and single symptoms and general health status items showed substantial test–retest reliability among patients with type 1 diabetes. Measurement error of the PAID questionnaire was considered acceptable; however, a larger measurement error of the WHO-5 questionnaire was observed. Further research is recommended to explore these findings.