Short-term Test-retest Reliability Research Articles

Evaluating the Stroop Test With Older Adults: Construct Validity, Short Term Test-Retest Reliability, and Sensitivity to Mental Fatigue.

We conducted two studies to evaluate the construct validity, short term test-retest reliability, and sensitivity to mental fatigue of the Stroop task when used with older adults. In Study 1, 40 participants visited our lab on two separate days. On the first visit, they took five screening scales, and we measured their height and body mass. On the second visit, they completed the Stroop task twice with a 30-minute interval between assessments. In Study 2, 15 different participants took a 30-minute Flanker/Reverse Flanker task during the interval between the two administrations of the Stroop tasks and they gave subjective ratings of their mental fatigue on the Visual Analogue Scale (VAS) prior to taking either of the Stroop tasks. In Study 1, participants showed a ceiling effect on the Stroop accuracy measure, there was strong concurrent validity for the Stroop with significant score differences between the Stroop's congruent and incongruent conditions (p < .001), and there was excellent response time reliability (ICC = 0.926) on day two when participants took the Stroop twice within a 30-minute inter-test interval. However, there were significant test-retest performance differences with respect to cognitive inhibition (p < .001). In Study 2, mental fatigue from the Flanker/Reverse Flanker test resulted in a significantly worse second Stroop performance (p = .045). We concluded that the Stroop task demonstrated strong concurrent validity and response time reliability among older adults, but it showed sensitivity to mental fatigue, and repeated administrations within the short 30-minute test-retest interval revealed that the most important Stroop measure (cognitive inhibition) was unreliable. We discuss the implications of these findings.

Implicit Assessment of Non-Suicidal Self-Injury: Group Differences in Temporal Stability of the Self-Injury Implicit Association Test (SI-IAT)

Objective We examine differences on the Self-Injury Implicit Association Test (SI-IAT) by history of non-suicidal self-injury (NSSI), in a test-retest design, to examine short-term temporal stability of SI-IAT scores. Method Treatment-seeking participants (N = 113; 58% female; 89% White; Mage = 30.57) completed the SI-IAT and self-report measures at two time points (M Timeframe = 3.8 days). Results Data suggested NSSI (51% of the sample endorsed lifetime NSSI) was related to Time 1 (T1) identity and attitude, and affected stability of scores. T1 and T2 SI-IAT identity and attitude were more strongly related for participants with NSSI history. NSSI characteristics (recency; number of methods) affected stability. Conclusions The short-term test-retest reliability of the SI-IAT is strong among those with NSSI history from T1 to T2. However, the SI-IATs use with participants without a history of NSSI was not supported beyond its established ability to differentiate between groups by NSSI history. This test may provide clinically-relevant assessment among those with a history of NSSI.

Psychometric properties of the Parma Scale for the treatment evaluation of prisoners with mental disorder: a new instrument for routine outcome monitoring in different forensic psychiatric settings

IntroductionThe clinical relevance of Routine Outcome Monitoring (ROM) to formulate longitudinal evaluations of treatment appropriateness/efficacy and to assist decision making aimed at improving the quality of person-centered interventions has been poorly implemented in forensic psychiatry, also in Italy. Indeed, very few assessment instruments have been developed in this crucial field.ObjectivesAs reliable ROM instruments are lacking, the aim of the current investigation was to examine psychometric properties (i.e. reliability, concurrent validity and sensitivity to measure scores’ longitudinal changes) of the Parma Scale (Pr-Scale) (a new instrument fro the evaluation of offenders with mental disorder) in an Italian sample of forensic psychiatric patients.MethodsParticipants were male adult offenders with mental disorder recruited within the Parma REMS (“Residence for the Execution of Security Measure”) or the Parma Penitentiary Institute (PPI). Exclusion criteria were known moderate/severe intellectual disability or any other medical condition inducing inability to express a valid consent for participating in the research. The Pr-Scale includes 20 items divided into 3 main domains: “Historical”, “Clinical” (observational) and “Treatment Plannining". To test psychometric properties of the Pr-Scale, we examined interrater reliability, short-term (1-week) test-retest reliability and internal consistency. As measure of concurrent validity, a correlation analysis of Pr-Scale item scores with corresponding HKT-R (the “Historisch, Klinische en Toekomstige – Revisie” instrument) item subscores was performed. Finally, we examined the Pr-Scale sensitivity to measure scores’ longitudinal changes over a 3-month treatment follow-up period.Results60 male adult patients were recruited in this study. Our findings showed good to excellent interrater and test-retest reliability, concurrent validity and internal consistency for the Pr-Scale. Pr-Scale scores also display a moderate to large changeability over time (Intra-Class Correlation coefficient = 0.963, coefficient of stability = 0.997, Cronbach’s ɑ = 0.736). Statistically significant correlations of Pr-Scale item scores with the corresponding HKT-R scores were found. Across the 3-month follow-up period, we observed statistically significant sensitivity values in measuring longitudinal changes for the Pr-Scale total score and Pr-Scale domain and item subscores.ConclusionsOur results support the clinical use of the Pr-Scale in different forensic psychiatric settings (i.e. prison, REMS) as reliable ROM instrument.Disclosure of InterestNone Declared

How many days are needed? Measurement reliability of wearable device data to assess physical activity.

Physical activity studies often utilize wearable devices to measure participants' habitual activity levels by averaging values across several valid observation days. These studies face competing demands-available resources and the burden to study participants must be balanced with the goal to obtain reliable measurements of a person's longer-term average. Information about the number of valid observation days required to reliably measure targeted metrics of habitual activity is required to inform study design. To date, the number of days required to achieve a desired level of aggregate long-term reliability (typically 0.80) has often been estimated by applying the Spearman-Brown Prophecy formula to short-term test-retest reliability data from studies with single, relatively brief observation windows. Our work, in contrast, utilizes a resampling-based approach to quantify the long-term test-retest reliability of aggregate measures of activity in a cohort of 79 participants who were asked to wear a FitBit Flex every day for approximately one year. The conventional approach can produce reliability estimates that substantially overestimate the actual test-retest reliability. Six or more valid days of observation for each participant appear necessary to obtain 0.80 reliability for the average amount of time spent in light physical activity; 8 and 10 valid days are needed for sedentary time and moderate/vigorous activity respectively. Protocols that result in 7-10 valid observation days for each participant may be needed to obtain reliable measurements of key physical activity metrics.

EEG microstates: Functional significance and short-term test-retest reliability

EEG microstates, reflecting discrete topographical organization of the EEG signal power, may have clinical relevance; however, their functional significance and test-retest reliability remain unclear. To investigate the functional significance of the canonical EEG microstate classes and their pairwise transitions, and to establish their within-session test-retest reliability, we recorded 36-channel EEGs in 20 healthy volunteers during three eyes-closed conditions: mind-wandering, verbalization (silently repeating the word ‘square’ every 2 s), and visualization (visualizing a square every 2 s). Each condition lasted 3 min and the sequence of three conditions was repeated four times (two runs of two sequence repetitions). The participants' alertness and their sense of effort during the experiment were rated using visual-analogue scales. The EEG data were 2–20 Hz bandpass-filtered and analysed into the four canonical microstate classes: A, B, C, and D. EEG microstate classes C and D were persistently more dominant than classes A and B in all conditions. Of the first-order microstate parameters, average microstate duration was most reliable. The duration of class D microstate was longer during mind-wandering (106.8 ms) than verbalization (102.2 ms) or visualization (99.8 ms), with a concomitantly higher coverage (36.4% vs. 34.7% and 35.2%), but otherwise there was no clear association of the four microstate classes to particular mental states. The test-retest reliability was higher at the beginning of each run, together with higher average alpha power and subjective ratings of alertness. Only the transitions between classes C and D (from C to D in particular) were significantly higher than what would be expected from the respective microstates' occurrences. The transition probabilities, however, did not distinguish between conditions, and their test-retest reliability was overall lower than that of the first-order parameters such as duration and coverage. Further studies are needed to establish the functional significance of the canonical EEG microstate classes. This might be more fruitfully achieved by looking at their complex syntax beyond pairwise transitions. To ensure greater test-retest reliability of microstate parameters, study designs should allow for shorter experimental runs with regular breaks, particularly when using EEG microstates as clinical biomarkers.

Test-retest reliability of mismatch negativity and gamma-band auditory steady-state response in patients with schizophrenia

Patients with schizophrenia show widespread impairments in clinical, cognitive and psychosocial functioning. Mismatch negativity (MMN) and gamma-band auditory steady-state response (ASSR) are two neurophysiological biomarkers widely used to inform diagnosis, guide treatments and track response to interventions in schizophrenia. However, evidence for the test–retest reliability of these indices across multiple sessions in schizophrenia patients remains scarce. In the present study, we included 34 schizophrenia patients (17 females) and obtained duration MMN (dMMN), frequency MMN (fMMN) and 40-Hz ASSR data across three sessions with intervals of 2 days. Event-related spectrum perturbation (ERSP) and inter-trial coherence (ITC) were calculated following Morlet wavelet time–frequency decomposition of ASSR data. The intra-class correlation coefficient (ICC) was used to quantify the reliability of MMN and ASSR measures among the three sessions. We found fair to good reliability for dMMN amplitudes but poor reliability for fMMN amplitudes. For the ASSR measures, ERSP showed good to excellent test–retest reliability while ITC had poor to fair test–retest reliability. In addition, the average of dMMN amplitudes was significantly correlated with that of ERSP across the three sessions. In summary, we established for the first time the short-term test–retest reliability of MMN and ASSR measures in schizophrenia patients. These findings demonstrate that dMMN amplitudes and ERSP of ASSR are reliable indices which may be used in longitudinal observational studies.

Effect sizes and test-retest reliability of the fMRI-based neurologic pain signature

Identifying biomarkers that predict mental states with large effect sizes and high test-retest reliability is a growing priority for fMRI research. We examined a well-established multivariate brain measure that tracks pain induced by nociceptive input, the Neurologic Pain Signature (NPS). In N = 295 participants across eight studies, NPS responses showed a very large effect size in predicting within-person single-trial pain reports (d = 1.45) and medium effect size in predicting individual differences in pain reports (d = 0.49). The NPS showed excellent short-term (within-day) test-retest reliability (ICC = 0.84, with average 69.5 trials/person). Reliability scaled with the number of trials within-person, with ≥60 trials required for excellent test-retest reliability. Reliability was tested in two additional studies across 5-day (N = 29, ICC = 0.74, 30 trials/person) and 1-month (N = 40, ICC = 0.46, 5 trials/person) test-retest intervals. The combination of strong within-person correlations and only modest between-person correlations between the NPS and pain reports indicate that the two measures have different sources of between-person variance. The NPS is not a surrogate for individual differences in pain reports but can serve as a reliable measure of pain-related physiology and mechanistic target for interventions.

A Dutch version of a dual-task paradigm for measuring listening effort: a pilot study regarding its short-term test-retest reliability

A Dutch version of a dual-task paradigm for measuring listening effort: a pilot study regarding its short-term test-retest reliability

Reliability assessment of hyperspectral imaging with the HyperView™ system for lower extremity superficial tissue oxygenation in young healthy volunteers

Purpose: Hyperspectral imaging (HSI) is a noninvasive spectroscopy technique for determining superficial tissue oxygenation. The HyperView™ system is a hand-held camera that enables perfusion image acquisition. The evaluation of superficial tissue oxygenation is warranted in the evaluation of patients with peripheral arterial disease. The aim was to determine the reliability of repeated HSI measurements. Methods: In this prospective cohort study, HSI was performed on 50 healthy volunteers with a mean age of 26.4 ± 2.5 years, at the lower extremity. Two independent observers performed HSI during two subsequent measurement sessions. Short term test–retest reliability and intra- and inter-observer reliability were determined, and generalizability and decision studies were performed. Transcutaneous oxygen pressure (TcPo2) measurements were also performed. Results: The short term test–retest reliability was good for the HSI values determined at the lower extremity, ranging from 0.72 to 0.90. Intra- and inter-observer reliability determined at different days were poor to moderate for both HSI (0.24 to 0.71 and 0.30 to 0.58, respectively) and TcPo2 (0.54 and 0.56, and 0.51 and 0.31, respectively). Reliability can be increased to >0.75 by averaging two measurements on different days. Conclusion: This study showed good short term test–retest reliability for HSI measurements, however low intra- and inter-observer reliability was observed for tissue oxygenation measurements with both HSI and TcPo2 performed at separate days in young healthy volunteers. Reliability of HSI can be improved when determined as a mean of two measurements taken on different days.

Short-Term Test-Retest Reliability of Contralateral Suppression of Click-Evoked Otoacoustic Emissions in Normal-Hearing Subjects.

Purpose The objective of the current study was to investigate the short-term test-retest reliability of contralateral suppression (CS) of click-evoked otoacoustic emissions (CEOAEs) using commercially available otoacoustic emission equipment. Method Twenty-three young normal-hearing subjects were tested. An otoscopic evaluation, admittance measures, pure-tone audiometry, measurements of CEOAEs without and with contralateral acoustic stimulation (CAS) to determine CS were performed at baseline (n = 23), an immediate retest without and with refitting of the probe (only CS of CEOAEs; n = 11), and a retest after 1 week (n = 23) were performed. Test-retest reliability parameters were determined on CEOAE response amplitudes without and with CAS, and on raw and normalized CS indices between baseline and the other test moments. Results Repeated-measures analysis of variance indicated no random or systematic changes in CEOAE response amplitudes without and with CAS, and in raw and normalized CS indices between the test moments. Moderate-to-high intraclass correlation coefficients with mostly high significant between-subjects variability between baseline and each consecutive test moment were found for CEOAE response amplitude without and with CAS, and for the raw and normalized CS indices. Other reliability parameters deteriorated between CEOAE response amplitudes with CAS as compared to without CAS, between baseline and retest with probe refitting, and after 1 week, as well as for frequency-specific raw and normalized CS indices as compared to global CS indices. Conclusions There was considerable variability in raw and normalized CS indices as measured using CEOAEs with CAS using commercially available otoacoustic emission equipment. More research is needed to optimize the measurement of CS of CEOAEs and to reduce influencing factors, as well as to make generalization of test-retest reliability data possible.

Psychometric properties of a color-shape version of the switch task

The current study aims to examine the psychometric properties of a color-shape version of the switch task. In Study 1, 128 participants completed a battery of standardized measures of executive functions (EFs) as well as the switch task to determine the construct validity of three traditionally computed costs (global, switch, and mixing) and primary variables (accuracy [ACC], reaction time [RT], and inverse efficiency score [IES] of the heterogeneous condition). In Study 2, 48 participants completed the task twice, seven days apart, to evaluate its short-term test-retest reliability. Results do not support the construct validity and the test-retest reliability of switch and mixing costs. The overall higher psychometric properties of the global costs (RT and IES), and primary variables (Hetero RT and IES) suggest that they may be useful measures for clinicians to assess EFs. The latter variables show evidence of convergent validity with standardized measures of EFs and good test-rest reliability (ICC ≥ .68).

Cross-cultural adaptation and validation of the Italian Aachener Aphasie Bedside Test (I-AABT), a tool for Aphasia assessment in the acute phase

ABSTRACT Background: Early recognition of post stroke aphasia is thought to be crucial to plan effective rehabilitation. The Aachener Aphasie Bedside Test (AABT) is a widely-used tool for aphasia assessment in acute phase. The AABT was translated into Italian (I-AABT) in 2011, but its psychometric properties had not yet been studied. Aims: The aims of the study were to assess the I-AABT 1) short-term test-retest and inter-rater reliability, 2) concurrent and construct validity, 3) responsiveness and 4) to develop preliminary Italian normative scores to stage aphasia severity.Methods & Procedures: Participants were recruited from three Italian hospitals and divided into four groups: 1) patients with acute aphasia (PwAA; n=116), 2) patients with post-acute aphasia (PwPA; n=54), 3) patients with right-hemisphere damage (PwRHD; n=48) and 4) patients without neurological disorders (PwND; n=30). The I-AABT was administered to all participants. The Aachner Aphasie Test (AAT) was administered to assess concurrent validity. Spearman’s correlations and Intraclass Correlation Coefficient (ICC) were used to calculate reliability. Concurrent and construct validity were assessed through Spearman’s correlations between I-AABT and AAT subscales and Mann-Whitney test, respectively. Wilcoxon signed test was used to assess responsiveness. Both normalized z and T scores were calculated to produce Italian normative scores. Finally, ROC curves were drawn to determine the diagnostic accuracy of the I-AABT Comprehension and Production subtests. Outcomes & Results. Test-retest and inter-rater ICCs were highly significant and strong (ICC > .837, ICC > .698, p<.001, respectively). Correlations between I-AABT and AAT Comprehension and Production subtests were significant and strong (rs>.611, p <.001). Mann-Whitney test confirmed statistically significant difference between PwAA, and both PwRHD and PwND for I-AABT Spontaneous Language, Comprehension and Production subtests. A significant improvement in the I-AABT items Semantic, Phonemic and Syntactic Spontaneous Language, Oral praxis, Object identification, Automatic Language and Naming (p <.05) was detected after intensive language therapy. Preliminary conversion tables were devised to classify comprehension and production impairment levels. I-AABT’s AUC-ROC values for Comprehension and Production parts were significant to detect patients with aphasia with a cut value of 139.5 (sensitivity = 72.9%, specificity = 79.5%9) and 94.5 (sensitivity = 75.2%, specificity = 74.4%.), respectively.Conclusions: The I-AABT proved to be a reliable, valid and responsive tool for the assessment of aphasia in acute stroke patients; its use is recommended in everyday clinical practice.

Psychometric validation of an adaptation of the Penn Alcohol Craving Scale to assess aggregated drug craving

PurposeClinicians need a broad spectrum measurement of psychoactive substance craving (i.e., alcohol and/or drug) to assess collective treatment effects, especially in the context of polysubstance use. In three separate studies, we investigated the psychometric properties of an adapted version of the Penn Alcohol Craving Scale (PACS), designed to measure broad range substance craving. DesignIn Study One, we examined the latent factor structure for craving, as well as concurrent validity with measures of frequency and severity of substance use. In Study Two, we examined the short-term test-retest reliability. In Study Three, we examined the long-term sensitivity to treatment effects at 12 month postdischarge. SettingAn inpatient SUD program in Guelph, Ontario, Canada. ParticipantsAdult patients receiving treatment for SUD: Study One, n = 971; Study Two, n = 35; Study Three, n = 191. MeasurementsWe used an adapted version of the PACS, termed the Aggregated Drug Craving Scale (ADCS), and measures of substance use frequency, severity, and abstinence. FindingsIn Study One, confirmatory factor analysis supported the unidimensional structure of the craving scale (CFI: 0.994, RMSEA: 0.071, SRMR: 0.010). In addition, statistically significant, medium effect size associations provided evidence of concurrent validity with measures of substance use frequency and severity (CFI = 0.992; RMSEA = 0.054; SRMR = 0.015). In Study Two, the ADCS demonstrated good agreement over two time points (ICC = 0.82), exhibiting acceptable short-term retest reliability. In Study 3, the mean craving score decreased significantly from 19.6 at baseline to 7.5 at 12-month follow-up (t = −18.48, p < 0.001), demonstrating an ability to detect long-term sensitivity to treatment effects (Cohen's d = −1.54). ConclusionsTogether, these findings provide initial support for a concise, broad-spectrum measure of aggregated drug cravings among an SUD treatment population.

Reliability of the Sport Concussion Assessment Tool 5 baseline testing: A 2-week test–retest study

ObjectivesTo examine short-term test-retest reliability of the Sport Concussion Assessment Tool 5 (SCAT5). DesignLongitudinal study. MethodsSixty-two professional male ice hockey players (mean age=22.5, SD=3.2) completed a preseason baseline test twice over a two-week interval. Half of the players were tested by the same assessor on both testing sessions. Spearman’s correlations (rs) were used to determine linear agreements, and Wilcoxon signed rank tests (sig r) were used to determine mean differences, between testing sessions. ResultsSymptoms had high test–retest reliability (Score: rs=0.85, p<0.001, sig r p<0.001; Severity: rs=0.84, p<0.001, sig r p<0.001). The reliability coefficients for the SAC (rs=0.58, p<0.001, sig r: p=0.412), and mBESS (rs=0.40, p=0.001, sig r: p=0.607) were considerably lower than symptoms. More than half (52%) of the athletes reported at least one baseline symptom (Md=1, M=2.2, SD=3.3). The most commonly reported symptoms were fatigue or low energy and neck pain. The broad ranges of SAC total scores (range=28−45, Md=35, M=35.4, SD=4.2) and SAC test–retest change scores (range −7 to +11) were mostly due to variability on the memory performance, tested using 10-item word lists. The number of mBESS single leg stance errors (Md=1, Md 3.2, SD=4.0) was greater than Tandem stance errors (Md=0, Md=2.0, SD=3.6). ConclusionsThe two-week test–retest reliability of the SCAT5 baseline scores varied from moderate to high. However, there was considerable individual variability on the SAC and mBESS scores and most players have notable short-term fluctuation on performance even if uninjured. Recommendations for interpreting change on the SCAT5 are provided.

Cerebrospinal fluid and plasma biomarkers in individuals at risk for genetic prion disease

BackgroundPrion disease is neurodegenerative disease that is typically fatal within months of first symptoms. Clinical trials in this rapidly declining symptomatic patient population have proven challenging. Individuals at high lifetime risk for genetic prion disease can be identified decades before symptom onset and provide an opportunity for early therapeutic intervention. However, randomizing pre-symptomatic carriers to a clinical endpoint is not numerically feasible. We therefore launched a cohort study in pre-symptomatic genetic prion disease mutation carriers and controls with the goal of evaluating biomarker endpoints that may enable informative trials in this population.MethodsWe collected cerebrospinal fluid (CSF) and blood from pre-symptomatic individuals with prion protein gene (PRNP) mutations (N = 27) and matched controls (N = 16), in a cohort study at Massachusetts General Hospital. We quantified total prion protein (PrP) and real-time quaking-induced conversion (RT-QuIC) prion seeding activity in CSF and neuronal damage markers total tau (T-tau) and neurofilament light chain (NfL) in CSF and plasma. We compared these markers cross-sectionally, evaluated short-term test-retest reliability over 2–4 months, and conducted a pilot longitudinal study over 10–20 months.ResultsCSF PrP levels were stable on test-retest with a mean coefficient of variation of 7% for both over 2–4 months in N = 29 participants and over 10–20 months in N = 10 participants. RT-QuIC was negative in 22/23 mutation carriers. The sole individual with positive RT-QuIC seeding activity at two study visits had steady CSF PrP levels and slightly increased tau and NfL concentrations compared with the others, though still within the normal range, and remained asymptomatic 1 year later. T-tau and NfL showed no significant differences between mutation carriers and controls in either CSF or plasma.ConclusionsCSF PrP will be interpretable as a pharmacodynamic readout for PrP-lowering therapeutics in pre-symptomatic individuals and may serve as an informative surrogate biomarker in this population. In contrast, markers of prion seeding activity and neuronal damage do not reliably cross-sectionally distinguish mutation carriers from controls. Thus, as PrP-lowering therapeutics for prion disease advance, “secondary prevention” based on prodromal pathology may prove challenging; instead, “primary prevention” trials appear to offer a tractable paradigm for trials in pre-symptomatic individuals.

Consideration of future consequences (CFC): Validation and proposition of an ultra-short scale

Consideration of future consequences (CFC) assesses the extent to which individuals evaluate future outcomes of their current behaviour. This personality trait has been traditionally used as a unidimensional construct, but recent research has highlighted the theoretical and empirical relevance in differentiating between consideration of immediate and future consequences. The present research shows psychometric evidence for the CFC scale in Brazil, and proposes an ultra-short version of the measure. Results from exploratory and confirmatory factor analysis, convergent validity, and short-term test-retest reliability in Study 1 supported the two-factor structure of the CFC scale. In Study 2, we used item response theory to evaluate the discrimination and difficulty levels of the CFC scale and to test an ultra-short form with samples from Brazil and New Zealand. Correlations with personality, values, and attitudes and intentions to exercise and to eat healthy show that the ultra-short form (6 items) works similarly to the full form of the CFC scale (14 items).

Short-Term Test-Retest Reliability of Electrically Evoked Cortical Auditory Potentials in Adult Cochlear Implant Recipients.

Background: Late latency auditory evoked potentials (LLAEPs) provide objective evidence of an individual's central auditory processing abilities. Electrically evoked cortical auditory evoked potentials (eCAEPs) are a type of LLAEP that provides an objective measure of aided speech perception and auditory processing abilities in cochlear implant (CI) recipients.Aim: To determine the short-term test-retest reliability of eCAEPs in adult CI recipients.Design: An explorative, within-subject repeated measures research design was employed.Study Sample: The study sample included 12 post-lingually deafened, unilaterally implanted adult CI recipients with at least 9 months of CI experience.Method: eCAEPs representing basal, medial and apical cochlear regions were recorded in the implanted ears of each participant. Measurements were repeated 7 days after the initial assessment.Results: No significant differences between either median latencies or amplitudes at test and retest sessions (p > 0.05) were found when results for apical, medial and basal electrodes were averaged together. Mean intraclass correlation coefficient (ICC) scores averaged across basal, medial and apical cochlear stimulus regions indicated that both consistency and agreement were statistically significant and ranged from moderate to good (ICC = 0.58–0.86, p < 0.05). ICC confidence intervals did demonstrate considerable individual variability in both latency and amplitudes.Conclusion: eCAEP latencies and amplitudes demonstrated moderate to good short-term test-retest reliability. However, confidence intervals indicated individual variability in measurement consistency which is likely linked to attention and listening effort required from the CI recipients.

Right-handed one day, right-handed the next day?

ABSTRACT Although a population bias toward right-hand preference is observed at the early stage of grasping, hand preference fluctuates in infancy. Given these fluctuations, one can wonder whether testing a young infant on a single occasion gives reliable results of its handedness. Very few studies have evaluated short-term test-retest reliability. This was the goal of this study in which 21 infants aged 9–15 months were tested for handedness every day for a total of 5 sessions. The infants were given a classical handedness baby test. Their handedness index (HI) and their category of handedness were compared across sessions. The results show that at the group level the distribution of handedness does not differ significantly across the five sessions. At the individual level, only 19% of infants were categorized as right-handed at all five sessions while 52.4% were consistent in using more one hand than the other across the five sessions (right hand: 47.6%). Most of the fluctuations across sessions occurred between being lateralized and non-lateralized rather than between being right-handed and left-handed. These figures indicate that testing handedness at that age gives fairly reliable results in terms of direction of hand preference, but less so in terms of degree.

Relatively short term test re-test reliability of Neck Disability Index by long term test re-retest reliability method of Oswestry Disability Index in healthy office workers.

Assessment of local condition specific outcome measures in combination to obtain an idea about the disability status of the whole spine is a conventional method. Oswestry Disability Index (ODI) and Neck Disability Index (NDI) are two outcome measures used together. Test re-test reliability of ODI in healthy subjects has clinical importance and the test re-test reliability of NDI may have clinical significance. The purpose of this study is to investigate the test re-test reliability of the NDI by using long-term test re-test reliability method of ODI on healthy office workers. Participants who have no chronic neck pain history were included in the study. Subjects were assessed by the Turkish-NDI (e-forms) on 1st, 2nd, 4th, 8th, 15th, 30th days. 49 (20 female, 29 male) of 106 participants (57 female, 49 male) completed the study. Kolmogorov-Smirnov and Friedman tests were used. The difference between median score of each day (χ= 9.275, p > 0.05) was neither statistically nor clinically significant. NDI has test re-test reliability in healthy subjects over a 1-month time interval and the test re-test reliability is also valid in cases where both questionnaires are used in combination in this time interval.

Markers of Novelty Processing in Older Adults Are Stable and Reliable.

Exploratory behavior and responsiveness to novelty play an important role in maintaining cognitive function in older adults. Inferences about age- or disease-related differences in neural and behavioral responses to novelty are most often based on results from single experimental testing sessions. There has been very limited research on whether such findings represent stable characteristics of populations studied, which is essential if investigators are to determine the result of interventions aimed at promoting exploratory behaviors or draw appropriate conclusions about differences in the processing of novelty across diverse clinical groups. The goal of the current study was to investigate the short-term test-retest reliability of event-related potential (ERP) and behavioral responses to novel stimuli in cognitively normal older adults. ERPs and viewing durations were recorded in 70 healthy older adults participating in a subject-controlled visual novelty oddball task during two sessions occurring 7 weeks apart. Mean midline P3 amplitude and latency, mean midline amplitude during successive 50 ms intervals, temporospatial factors derived from principal component analysis (PCA), and viewing duration in response to novel stimuli were measured during each session. Analysis of variance (ANOVA) revealed no reliable differences in the value of any measurements between Time 1 and 2. Intraclass correlation coefficients (ICCs) between Time 1 and 2 were excellent for mean P3 amplitude (ICC = 0.86), the two temporospatial factors consistent with the P3 components (ICC of 0.88 and 0.76) and viewing duration of novel stimuli (ICC = 0.81). Reliability was only fair for P3 peak latency (ICC = 0.56). Successive 50 ms mean amplitude measures from 100 to 1,000 ms yielded fair to excellent reliabilities, and all but one of the 12 temporospatial factors identified demonstrated ICCs in the good to excellent range. We conclude that older adults demonstrate substantial stability in ERP and behavioral responses to novel visual stimuli over a 7-week period. These results suggest that older adults may have a characteristic way of processing novelty that appears resistant to transient changes in their environment or internal states, which can be indexed during a single testing session. The establishment of reliable measures of novelty processing will allow investigators to determine whether proposed interventions have an impact on this important aspect of behavior.