Evidence Of Test-retest Reliability Research Articles

Test-Retest Reliability of Common Behavioral Decision-Making Tasks: A Multi-Sample, Repeated Measures Study.

Decision-making is responsible for the best and worst of human nature. The field of decision science has done much to elucidate the psychological process of decision-making, variables that affect decision-making, and outcomes of disadvantageous decision-making. However, understanding any psychological process requires creation of reliable measures. Few studies focus on the test-retest reliability of behavioral decision-making tasks despite their utility in repeated assessment batteries. The present study examined the extent to which common behavioral decision-making tasks are reliable across time. Across two samples and two time points, participants completed multiple decision-making assessments. Results revealed moderate at best evidence of test-retest reliability across a 10-week interval in any of the tasks assessed. These findings raise large questions for the field of behavioral decision-making and the utility for tasks to track changes in decision-making across time in clinical populations.

Psychometric Validation and Meaningful Change Threshold Determination of EORTC QLQ-C30 Physical Functioning and Promis SF v1.0-Fatigue 7a Functional Domain in Patients with High-Risk Myelodysplastic Syndromes Treated with Venetoclax and Azacitidine

Background : Patients with myelodysplastic syndromes (MDS) can experience fatigue, infection, anemia, bruising, and bleeding. Fatigue and physical functioning (PF) are often the most adversely impacted areas of patient health-related quality of life. The objective of this study was to generate quantitative evidence to determine whether the PF score from the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire Core 30 (EORTC QLQ-C30) and the Fatigue score from the Patient-Reported Outcome Measurement Information System - Fatigue Short Form 7a (PROMIS SF 7a) measures are suitable candidates for developing patient-reported endpoints for clinical trials in treatment-naïve patients with higher-risk MDS (HR-MDS). We also aimed to derive definitions for meaningful change for both PF and Fatigue scores to aid in interpretation of efficacy analyses using these scores. Methods : This analysis used aggregate data from the Phase 3 M15-954 study (NCT04401748), which is an ongoing, randomized, double-blind, placebo-controlled study evaluating the safety and efficacy of venetoclax in combination with azacitidine in treatment-naïve adult patients with HR-MDS. The EORTC QLQ-C30 and the PROMIS SF 7a questionnaires were administered on the first day of each 28-day cycle for the first 7 cycles and every 3 cycles thereafter, and at the treatment-completion visit. For both measures, the analyses evaluated item characteristics at baseline, whether the hypothesized structure was consistent with the scoring algorithms implemented in the trial, and the reliability and validity of scores; subsequently, definitions for meaningful improvement or deterioration were determined. Anchor-based analyses were used to generate definitions for meaningful deterioration or improvement from baseline to Cycle 4 Day 1 for EORTC QLQ-C30 PF domain, and Cycle 7 Day 1 for PROMIS SF 7a. Construct-aligned anchors were used for these analyses, with a change in Patient Global Impression of Severity (PGIS) - Physical Activities and in Patient Global Impression of Change (PGIC) - Physical Activities used as the anchor for the analyses of the EORTC QLQ-C30 PF scores and PGIS-Fatigue and PGIC-Fatigue used for the analyses of the PROMIS SF 7a scores. Results : Approximately 500 treatment-naïve higher-risk patients with MDS enrolled in the study were included in this analysis. Both EORTC QLQ-C30 PF and PROMIS SF 7a measures demonstrated adequate reliability and validity; both measures exceeded the cut-off for acceptable internal consistency reliability, test re-test reliability, and convergent validity with co-validators ( Table 1). The definition for deterioration for the EORTC QLQ-C30 PF domain was −13.33 (rounded to the nearest possible incremental change score), which was corroborated with the PGIC-Physical Activities ( Table 2). The correlation between the EORTC QLQ-C30 PF domain and PGIS-Physical Activities scores was −0.43, and the correlation between the EORTC QLQ-C30 PF domain and PGIC-Physical Activities scores was −0.34, indicating that these measures were sufficient to be used as anchors. For PROMIS SF 7a, the definition for deterioration and improvement was 3.90 and −3.50, respectively. Both results were also corroborated with the PGIC-Fatigue. The correlation between the PROMIS SF 7a and PGIS-Fatigue scores was 0.58, and the correlation between the PROMIS SF 7a and PGIC-Fatigue scores was 0.38, indicating that these measures were sufficient to be used as anchors. Conclusions : The psychometric evaluation of EORTC QLQ-C30 PF and PROMIS SF 7a Fatigue scores from M15-954 study's blinded data provides sufficient evidence of test re-test reliability, construct validity, responsiveness, and score interpretability and supports their use as endpoints for clinical trials in treatment-naïve HR-MDS patients for regulatory decision-making.

Psychometric properties of the controlling coach behaviors scale for Japanese athletes

Two studies examined the validity and reliability of the Japanese version of the Controlling Coach Behaviors Scale (CCBS). The CCBS is a multidimensional self-report measure designed to evaluate sports coaches’ controlling interpersonal style from the perspective of self-determination theory (SDT). It comprises 15 items measuring the controlling use of rewards, negative conditional regard, intimidation, and excessive personal control on a seven-point Likert scale. The study 1 sample comprised 526 university student-athletes (Mage = 19.59 years, SD = ±0.94, 364 females) who completed the Japanese CCBS, which was developed through back-translation. Confirmatory factor analyses provided support for the tenability of the hypothesized factor structure of the Japanese CCBS (CFI=.927; NNFI=.909; RMSEA=.079). Moreover, the results supported the invariance of the scale across sex, sport types, and competitive levels. The subscale internal consistency and discriminant validity scores were all acceptable. Test-retest reliability evidence was obtained in Study 2 (N=108), suggesting a positive and significant intraclass correlation between the pre-test and the post-test CCBS (ICC range: .65–.87). These findings support the Japanese CCBS as a valid and reliable measure for use in research which will enhance our understanding of coaches’ controlling interpersonal styles in sports.

Three tasks for the exploration of verbal fluency: evidence of test-retest reliability in Argentine adults

The phonological and semantic verbal fluency tasks are frequently used in neuropsychological assessment due to their easy application and good sensitivity to dementia. In Argentina, the psychometric evidence for these tasks is limited, with a special lack of knowledge of the temporal stability of its measurements. The psychometric production is even lower for the action fluency variant (emission of verbs in the infinitive in one minute). In effect, this research analyzes the test-retest reliability of three verbal fluency tasks in Argentine adults. The sample was made up of 85 Argentine (average age, 63.7 years), 75,3% women and with a medium-high educational level. A prospective longitudinal design was carried out, administering phonological, semantic and action fluency tasks at two different times with an interval of up to four months. The intraclass correlation coefficient (ICC), a statistical method suggested for test-retest reliability studies, was analyzed. For the interpretation of the ICC, the Fleiss criteria were adopted. The phonological and semantic fluency tasks showed good reliability, with ICCs of 0.77 and 0.79. The fluidity of action variant yielded ICC of 0.90, indicating excellent reliability. All fluency tasks have appropriate temporal stability, and their use is recommended when prospective neuropsychological research is planned (with language evaluation at different times) or as a method of monitoring the evolution of aphasic patients undergoing neurorehabilitation. Based on its excellent reliability, it is recommended to use the action variant more frequently.

Interactive Assessments of CT (IACT): Digital Interactive Logic Puzzles to Assess Computational Thinking in Grades 3–8

Background and Context: The Inclusive Assessment of Computational Thinking (CT) designed for accessibility and learner variability was studied in over 50 classes in US schools (grades 3-8).
 Objective: The validation studies of IACT sampled thousands of students to establish IACT’s construct and concurrent validity as well as test-retest reliability.
 Method: IACT items for each CT practice were correlated to examine construct validity. The CT pre-measures were correlated with post-measures to examine test-retest reliability. The CT post-measures were correlated with external measures to examine concurrent validity.
 Findings: IACT studies showed moderate evidence of test-retest reliability and concurrent validity and low to moderate evidence of construct validity for an aggregated measure of CT, but weaker validity and reliability evidence for individual CT practices. These findings were similar for students with and without IEPs or 504s.
 Implications: IACT is the first CT tool for grades 3-8 that has been validated in a large-scale study among students with and without IEPs or 504s. While improvements are needed for stronger validity, it is a promising start.

Validation of the brief version of the Spence Children's Anxiety Scale for Spanish children (SCAS-C-8).

This study aimed to validate the self-reported brief version of the Spence Children's Anxiety Scale-Children (SCAS-C-8) in pre-adolescent Spanish children. Participants were 824 children aged 8-12 from a community sample. The results revealed a good fit to the one-factor structure, adequate internal consistency (α = 0.75), and evidence of test-retest reliability (α = 0.77). The strong relationship between the SCAS-C-8 and emotional problems provided evidence of convergent validity. Also, the results showed factorial gender invariance. The SCAS-C-8 is a suitable instrument for pre-adolescent Spanish children. The brevity and simplicity of this scale may facilitate early detection and help to narrow the existent gap between the presence of anxiety problems and psychological assistance-seeking.

Test–retest reliability of touchscreen DriveSafe DriveAware

This prospective study examines the test-retest reliability of touchscreen DriveSafe DriveAware (DSDA). In a future study, the authors intend assessing the usefulness of DSDA to measure progress of patients undergoing treatment for neurological conditions. Evidence of test-retest reliability is required first. Australian adults with current driver's licences (N=39) aged 20 to 91years (Mage =58) recruited from a convenience sample were assessed with DSDA. The assessment was repeated 6weeks, 6months, and 12months later to match planned assessments of patients undergoing neurosurgical treatment in future research. DSDA classification, DriveSafe subtest score, and DriveAware subtest scores were analysed as a whole sample, and in three age groups. DSDA classification and DriveAware scores were consistent over repeated tests. DriveSafe scores increased between test 1 and 2 (p=.006), and thereafter no significant change from test 2 to 4. DriveSafe scores of older participants (70+ years) increased between test 1 and 2 more notably than younger participants' scores. No DriveSafe scores decreased over time. DSDA classification and DriveAware scores demonstrated test-retest reliability for all age groups. DriveSafe scores did not demonstrate test-retest reliability between test 1 and 2 for participants 70+ years. However, DriveSafe scores demonstrated test-retest reliability after test 2, possibly indicating an initial learning effect for the DriveSafe score only. The authors posit that this result may have been influenced by older adults' reduced familiarity with iPad technology at first assessment. Further longitudinal research is required to confirm whether these results are consistent in a sample population with diagnosed cognitive impairment. Future research will assess whether repeated assessment of DSDA may be useful for monitoring and screening cognitive fitness to drive in patients who have undergone neurosurgical treatment and whether declining scores may indicate cognitive changes in ability to drive.

The Romanian version of the Intuitive Eating Scale-2: Assessment of its psychometric properties and gender invariance in Romanian adults

The construct of intuitive eating is most often measured using the 23-item Intuitive Eating Scale-2 (IES-2). Here, we examined the psychometrics of a Romanian translation of the IES-2. Eight-hundred-and-thirty Romanian adults completed the IES-2 along with measures of positive body image, symptoms of disordered eating, and psychological well-being. Exploratory factor analyses (EFAs) with a split-half subsample (n = 420) indicated that IES-2 scores reduced to three factors in women and four in men, both of which diverged from the parent model. Confirmatory factor analysis with a second split-half sample (n = 410) indicated that the parent model had poor fit indices, whereas fit of the EFA-derived models were acceptable but not uniformly ideal. Scores on the 3-factor model – which had comparatively better fit of the models tested – had adequate internal consistency and evidenced scalar invariance across gender. However, evidence of test-retest reliability after four weeks (n = 205) was poor and evidence of construct validity, assessed through correlations with additional measures included in the survey, was weak at best. Based on these results, we question the degree to which the construct of intuitive eating can be applied to nations undergoing nutrition transitions.

Development and validation of the disease-specific QOL-CD quality of life questionnaire for patients with Cushing's disease.

Cushing's disease (CD) patients experience a range of debilitating symptoms that impair quality of life (QOL) as assessed using generic measures. These generic measures are inadequate to capture the disease-specific burden of illness. The development of the CD-specific QOL-CD measure of QOL using items generated by CD patients and healthcare professionals will provide a holistic assessment of patient outcomes and efficacy of novel therapies. A total of 96 CD patients participated. A list of 177 items (version 1.0) was generated by treated CD patients (n = 9), caregivers (n = 2), healthcare providers (n = 7), and results of a MEDLINE search. Item reduction was performed through content analysis and dual scaling. Patients' rating of importance was incorporated to reduce to a final version of 56 items (version 3.0). Evidence for test-retest reliability was sought through administering the QOL-CD 1 week apart and Cronbach's α of each subscale. Construct validity was assessed through extreme group analysis and comparison with the normal Canadian population. Concurrent validity was sought through comparison with the SF-36, Functional Assessment of Cancer Therapy-Brain (FACT-Br), and Karnofsky Performance Status (KPS). Perioperative testing was conducted on CD patients (n = 25) against nonfunctioning pituitary adenoma controls (n = 25) through pre- and postoperative testing. A total of 96 CD patients (86 females and 10 males; mean age 45.23 ± 14.16 years) participated. The QOL-CD was feasible (mean completion time 15 minutes, with 70% believing accurate capture of QOL), reliable (CD 1 week apart: r = 0.86; control 1 week apart: r = 0.83; Cronbach's α: general health = 0.73, emotional health = 0.85, physical health = 0.78, mental status = 0.82, social well-being = 0.63, medical treatment = 0.54), and valid (extreme group testing p < 0.001; SF-36 and QOL-CD general health: r = 0.56, social well-being: r = 0.21, emotional health: r = 0.61, total score: r = 0.58; FACT-Br and QOL-CD physical health: r = 0.47, social well-being: r = 0.21, emotional health: r = 0.34, total score: r = 0.68; KPS and QOL-CD general health: r = 0.32, total score: r = 0.14). Perioperative testing of CD patients (n = 25) demonstrated improvement in all subscales postoperatively, with a significant difference in emotional health (p < 0.001) and physical health (p < 0.001). The QOL-CD questionnaire has been developed for patients with CD and has demonstrated evidence for validity and reliability.

Reliability and Validity of a Culturally Adaptive Version of the International Physical Activity Questionnaire in Indian Subcontinent: A Cross-sectional Study.

Background:Physical activity (PA) is one of the prime public health problems occurring globally. Regular PA is associated with a decrease in all-causes of mortality irrespective of gender. The study was conducted to investigate the validity and an aspect of reliability of a modified version of the International Physical Activity Questionnaire (IPAQ) in the Indian subcontinent (InS).Methods:Cross-sectional study, to evaluate the validity and reliability of the InS IPAQ-LF compared with a range of biological variables. In total, 198 participants (50% women) with a mean age of 35.6 (SD = 10.3) years selected from neighborhoods with variable socioeconomic status and PA.Results:The InS IPAQ-LF demonstrated good test-retest reliability for total PA (Intraclass correlation coefficient [ICC] =0.79, 95% CI 0.65 to 0.82), occupational PA (ICC = 0.77, 95% CI 0.68 to 0.82), active transportation (ICC = 0.82, 95% CI 0.75 to 0.87), and vigorous-intensity activities (ICC = 0.82, 95% CI 0.76 to 0.87). Reliability was substantially higher for total PA (ICC = 0.80), occupational PA (ICC = 0.78), leisure-time PA (ICC = 0.75), and active transportation (ICC = 0.80) in men than in women, but domestic PA (ICC = 0.38) and sitting time (ICC = 0.71) demonstrated more substantial reliability coefficients in women than in men.Conclusions:The InS IPAQ-LF demonstrated considerate evidence of test-retest reliability and may be valid for evaluating context specific PA mannerisms of adults in InS.

Construct Validity and Test-Retest Reliability of the Coping Inventory (CI) for Children With Developmental Disabilities.

A reliable, valid, and readily usable method of measuring coping is essential for occupational therapy practitioners and researchers working with children with developmental disabilities. The aim of this study was to examine evidence for the construct validity and internal and test-retest reliability of the Coping Inventory (CI), a 48-item survey designed for use with children. School staff (N = 39) completed CIs for 79 students with developmental disabilities age 5-13 yr (mean = 8.0, standard deviation = 2.0) who were primarily boys (n = 52; 68%) with autism spectrum disorder (n = 40 of 47 diagnoses provided). We used Rasch analysis to examine construct validity, internal reliability, and possible redundancy of items and intraclass correlations, Pearson correlations, Bland-Altman plots, and t tests were used to examine test-retest reliability. Rasch analysis provided evidence of construct validity: All items correlated positively with the overall measure; data from 94% of items conformed with Rasch expectations, and the items form a logical hierarchy. Intraclass correlations revealed an average coefficient of .96, providing evidence of test-retest reliability. The CI demonstrated good evidence for construct validity and internal and test-retest reliability. Redundancy of items suggests that some items could be eliminated after further research.

Validity and reliability of the Setswana translation of the Short Form-8 health-related quality of life health survey in adults.

BackgroundThe absence of culturally relevant measures in indigenous languages could pose a challenge to epidemiological studies on health-related quality of life (HRQoL) in developing nations.AimTo explore the feasibility and determine the validity and reliability of the Setswana translation of the HRQoL Short Form-8 (SF-8) among Setswana-speaking adults.SettingPotchefstroom in the North West province.MethodsSixty healthy men (n = 26) and women (n = 34), aged 45.5 ± 9.3 years, completed a Setswana translation of the SF-8 questionnaire and the original English version twice, with a 4-week interval between completions.ResultsThe Setswana SF-8 presented good concurrent validity with the Spearman’s correlation coefficients (ρ) of 0.72 for role physical to 0.91 for social functioning. The Cronbach’s alpha coefficients for the first and second measurements were 0.87 and 0.87, respectively, for the Setswana-translated SF-8 and 0.86 and 0.89 for the original English SF-8. The reliability coefficients were moderate for the mental health (ρ = 0.60), social functioning (ρ = 0.56) and role emotional (ρ = 0.50) domains, as well as the mental component summary (ρ = 0.50) and physical component summary (ρ = 0.45), but fair for the role physical (ρ = 0.43), body pain (ρ = 0.43), general health (ρ = 0.42), physical functioning (ρ = 0.41) and vitality (ρ = 0.38) domains on the translated Setswana version of the SF-8.ConclusionThe Setswana SF-8 version was feasible, acceptable and had acceptable concurrent validity and fair to moderate evidence of test–retest reliability for assessing HRQoL among adult Setswana-speaking community dwellers.

Test-retest reliability and four-week changes in cardiopulmonary fitness in stroke patients: evaluation using a robotics-assisted tilt table.

BackgroundExercise testing devices for evaluating cardiopulmonary fitness in patients with severe disability after stroke are lacking, but we have adapted a robotics-assisted tilt table (RATT) for cardiopulmonary exercise testing (CPET). Using the RATT in a sample of patients after stroke, this study aimed to investigate test-retest reliability and repeatability of CPET and to prospectively investigate changes in cardiopulmonary outcomes over a period of four weeks.MethodsStroke patients with all degrees of disability underwent 3 separate CPET sessions: 2 tests at baseline (TB1 and TB2) and 1 test at follow up (TF). TB1 and TB2 were at least 24 h apart. TB2 and TF were 4 weeks apart. A RATT equipped with force sensors in the thigh cuffs, a work rate estimation algorithm and a real-time visual feedback system was used to guide the patients’ exercise work rate during CPET. Test-retest reliability and repeatability of CPET variables were analysed using paired t-tests, the intraclass correlation coefficient (ICC), the coefficient of variation (CoV), and Bland and Altman limits of agreement. Changes in cardiopulmonary fitness during four weeks were analysed using paired t-tests.ResultsSeventeen sub-acute and chronic stroke patients (age 62.7 ± 10.4 years [mean ± SD]; 8 females) completed the test sessions. The median time post stroke was 350 days. There were 4 severely disabled, 1 moderately disabled and 12 mildly disabled patients. For test-retest, there were no statistically significant differences between TB1 and TB2 for most CPET variables. Peak oxygen uptake, peak heart rate, peak work rate and oxygen uptake at the ventilatory anaerobic threshold (VAT) and respiratory compensation point (RCP) showed good to excellent test-retest reliability (ICC 0.65–0.94). For all CPET variables, CoV was 4.1–14.5 %. The mean difference was close to zero in most of the CPET variables. There were no significant changes in most cardiopulmonary performance parameters during the 4-week period (TB2 vs TF).ConclusionsThese findings provide the first evidence of test-retest reliability and repeatability of the principal CPET variables using the novel RATT system and testing methodology, and high success rates in identification of VAT and RCP: good to excellent test-retest reliability and repeatability were found for all submaximal and maximal CPET variables. Reliability and repeatability of the main CPET parameters in stroke patients on the RATT were comparable to previous findings in stroke patients using standard exercise testing devices. The RATT has potential to be used as an alternative exercise testing device in patients who have limitations for use of standard exercise testing devices.

PIH27 - Review of Adherence Measures for use in Phase Iv Studies and Recommendations for a new Standardized Generic Measure

This study reviews adherence metrics for Phase IV studies. We conducted a review of adherence metrics in the public domain. We critically appraised these metrics for use in Phase IV studies. We identified 70 unique self-report measures of adherence. One quarter (26%) were generic and the remaining were disease specific. Instrument length ranged from one to 78 items. One third (34%) only measured adherence behaviors, 37% only measured beliefs and attitudes, and 29% measured both. Just over one quarter (29%) were developed using a conceptual framework. One-fifth (21%) involved qualitative patient input during item generation or pretesting. Just over one-half (57%) had evidence of internal-consistency reliability, and far fewer had evidence of test-retest reliability (23%). One half (50%) had evidence of validity vis á vis other self-report measures, 23% vis á vis other adherence metrics, and 19% vis á vis clinical criteria. Few had evidence of predictive (24%) or postdictive (13%) validity. Few adherence measures have been developed with true patient-centerednesss. There has been no standardization of the content of adherence behaviors or beliefs. Instrument validation has been inconsistent in its breadth and depth. Because of the importance of medication adherence to payers, providers, pharmacies, and pharmaceutical companies, the time seems opportune to conceptualize, develop, and validate a generic adherence measure that can be used in Phase IV studies across different disease and patient groups. Standardization of content would allow for the assessment of adherence behaviors and beliefs between and across existing and novel therapies. There should be a minimum set of adherence concepts that apply across therapeutic areas. The new measure should be developed with patient input (concept elicitation) and verified as to its comprehension and relevance using cognitive debriefing. The scientific basis of medication adherence would be advanced through the development and validation of a standardized generic measure that assesses adherence behaviors and beliefs.

Measures of circadian preference in childhood and adolescence: A review

PurposeTo review the psychometric properties of the questionnaires commonly filled in by children and adolescents to measure circadian preference. MethodsWe examined the Morningness-Eveningness Questionnaire for Children and Adolescents (MEQ-CA), the Morningness-Eveningness Scale for Children (MESC) and the Composite Scale of Morningness (CSM). We critically analyzed the reliability, in term of internal consistency (through the Cronbach's alpha) and test-retest reliability (through the correlation coefficient), and the type of validation against external criteria (objective assessment of the sleep/wake cycle, body temperature, hormones and other questionnaires). Fifty studies that reported these data were included in the review: 7 studies used the MEQ-CA, 28 used the MESC and 15 used the CSM. ResultsThe percentage of studies reporting at least acceptable levels of internal consistency was high and similar between the three questionnaires. Evidence for test-retest reliability was scant, since only 3 studies were available; it was at least acceptable for the MESC (two studies with a time interval of 1 month), not acceptable for the MEQ-CA (one study with a time interval of 6 months), while no information was available for the CSM. As regards the validation evidence, the MEQ-CA has been validated by the highest number of external criteria (actigraphy, oral body temperature and other questionnaires), followed by the CSM (cortisol sampling and other questionnaires). The MESC has been validated only against self-report measures. ConclusionsThe present state of the art would suggest the use of the MEQ-CA to assess circadian preference in children and adolescents.

Patient Reported Outcome (PRO) assessment in epilepsy: a review of epilepsy-specific PROs according to the Food and Drug Administration (FDA) regulatory requirements.

Despite collection of patient reported outcome (PRO) data in clinical trials of antiepileptic drugs (AEDs), PRO results are not being routinely reported on European Medicines Agency (EMA) and Food and Drug Administration (FDA) product labels. This review aimed to evaluate epilepsy-specific PRO instruments against FDA regulatory standards for supporting label claims. Structured literature searches were conducted in Embase and Medline databases to identify epilepsy-specific PRO instruments. Only instruments that could potentially be impacted by pharmacological treatment, were completed by adults and had evidence of some validation work were selected for review. A total of 26 PROs were reviewed based on criteria developed from the FDA regulatory standards. The ability to meet these criteria was classified as either full, partial or no evidence, whereby partial reflected some evidence but not enough to comprehensively address the FDA regulatory standards. Most instruments provided partial evidence of content validity. Input from clinicians and literature was common although few involved patients in both item generation and cognitive debriefing. Construct validity was predominantly compromised by no evidence of a-priori hypotheses of expected relationships. Evidence for test-retest reliability and internal consistency was available for most PROs although few included complete results regarding all subscales and some failed to reach recommended thresholds. The ability to detect change and interpretation of change were not investigated in most instruments and no PROs had published evidence of a conceptual framework. The study concludes that none of the 26 have the full evidence required by the FDA to support a label claim, and all require further research to support their use as an endpoint. The Subjective Handicap of Epilepsy (SHE) and the Neurological Disorders Depression Inventory for Epilepsy (NDDI-E) have the fewest gaps that would need to be addressed through additional research prior to any FDA regulatory submission, although the NDDI-E was designed as a screening tool and is therefore unlikely to be suitable as an instrument for capturing change in a clinical trial and the SHE lacks the conceptual focus on signs and symptoms favoured by the FDA.

A systematic review of the psychometric properties of Quality of Life measures for school aged children with cerebral palsy

BackgroundThis systematic review aimed to evaluate the psychometric properties and clinical utility of all condition specific outcome measures used to assess quality of life (QOL) in school aged children with cerebral palsy (CP).MethodsRelevant outcome measures were identified by searching 8 electronic databases, supplemented by citation tracking. Two independent reviewers completed data extraction and analysis of the measures using a modified version of the CanChild Outcome Measures Rating Form.ResultsFrom the 776 papers identified 5 outcome measures met the inclusion criteria: the Care and Comfort Hypertonicity Questionnaire (C&CHQ), the Caregiver Priorities and Child Health Index of Life with Disabilities (CPCHILD), CP QOL-Child, DISABKIDS and PedsQL 3.0 CP Module. There was evidence of construct validity for all five measures. Content validity was reported for all measures except PedsQL 3.0. The CPCHILD and CP QOL-Child were the only outcome measures to have reported data on concurrent validity. All measures, with the exception of one (C&CHQ) provided evidence of internal reliability. The CPCHILD and the CP-QOL-Child had evidence of test-retest reliability and DISABKIDS had evidence of inter-rater reliability. There were no published data on the responsiveness of these outcome measures.ConclusionsThe CPCHILD and the CP QOL-Child demonstrated the strongest psychometric properties and clinical utility. Further work is needed, for all measures, on data for sensitivity to change.

Validation of the Revised Child Version of the Assessment of Computer Task Performance

Objective. The purpose of this study was to examine test-retest reliability, internal consistency, and construct validity of the revised child version of the Assessment of Computer Task Performance. The subjects were 155 children of 5 to 11 years of age who did not have any visual or motor impairment. Children 5 through 9 years of age were administered the revised test, which included some additional tasks. Children 10 and 11 years of age were administered selected tasks from the adult version. A subgroup of 52 children were administered the test for the second time to examine test-retest reliability. Intra-class correlations for the mean time to complete two trails indicated moderate to good test-retest reliability (0.66–0.91). The alpha coefficient for tasks administered to children 5 through 9 years of age (0.85) supports internal consistency. Removal of one task increased the alpha coefficient to 0.79 for tasks administered to children 10 and 11 years of age. Three factors explained 84% of the total variance in scores of children 5–9 years of age and 75% of the variance in scores of children 10 and 11 years of age. The mean time to complete keyboard tasks decreased with age and the mean time to mouse tasks decreased between 5 and 9 years. Conclusion. The results provide evidence of test-retest reliability, internal consistency, and construct validity of the revised Assessment of Computer task Performance.

Testing of the short self-efficacy and outcome expectations

The purpose of this study was to test the reliability and validity of the short outcome expectations for exercise (SOEE) and short self-efficacy expectations for exercise (SSEE) scales in a sample of adults recruited into two exercise intervention studies for patients post stroke. A total of 157 individuals, 90 males (56%) and 67 females (43%) with an average age of 63.7 (SD=12.3) years participated in the study. There was evidence of internal consistency for both scales based on alpha coefficients and Rasch Model testing estimates of person and item separability, evidence of test re-test reliability with no change in scores over a 6-week period, and some support of reliability based on R2 estimates. There was evidence of validity of the measures based on confirmatory factor analysis using structural equation modeling and Rasch measurement model testing, and convergent validity testing. There was some evidence of convergent validity based on a statistically significant relationship between selfefficacy and outcome expectations, and both of these measures with physical health status. The study provided some preliminary evidence for the reliability and validity of the SSEE and SOEE when used with adult stroke patients, and suggested revisions for subsequent use of these measures are provided.

Preliminary Evidence of the Technical Adequacy of the Preschool Numeracy Indicators

Given the potential long-term outcomes of poorly developed mathematical skills, there is a need to understand the emergence and development of these skills in the context of improving educational experiences and ensuring better outcomes for preschoolers. The purpose of this article is to describe preliminary reliability and validity evidence supporting the Preschool Numeracy Indicators (PNIs), which are tasks for the assessment of number skills during the preschool years. Results from a sample of 3- to 6-year-old children (N = 163) attending preschool and Head Start programs revealed (a) evidence of test-retest reliability, (b) evidence that the four PNIs measure the same construct, (c) evidence of age-related differences in PNIs scores, and (d) evidence that the PNIs demonstrate external relations with scores from three test batteries measuring mathematics and number skills and other preacademic skills. Implications focus on the use of the PNIs for screening purposes, and future research is described.