Multivariate Base Rates Research Articles

Multivariate base rates of potentially problematic scores on the NIH Toolbox Emotion Battery.

To examine the normal frequency of obtaining one or more scores considered potentially problematic based on normative comparisons when completing the NIH Toolbox Emotion Battery (NIHTB-EB). Participants (N = 753; ages 18-85, 62.4% women, 66.4% non-Hispanic White) from the NIHTB norming study completed 17 scales of emotional functioning fitting into three subdomains (i.e., Negative Affect, Psychological Well-being, Social Satisfaction). Scores were considered potentially problematic if they were 1 SD above/below the mean, depending on the orientation of the scale, and cutoffs for 1.5 and 2 SD were also included for reference. Multivariate base rates quantified the rate at which participants obtained one or more potentially problematic scale or subdomain scores. The portion of participants obtaining one or more potentially problematic scores on the NIHTB-EB scales and subdomains was 61.2 and 23.2%, respectively. Participants who were younger (i.e., 18-49) or had less education had higher rates of potentially problematic scores within specific subdomains. There were no significant differences by sex or race/ethnicity. Elevated scores on the NIHTB-EB were common in the normative sample and related to education/age. The multivariate base rates provided indicate obtaining one or more potentially problematic scores on the NIHTB-EB is broadly normal among adults, which may guard against overinterpreting a single score as clinically significant. These base rates should be considered in the context of other assessment findings, such as interviews, medical history or informant reports, to ensure that true emotional problems are not dismissed, and normal variation in emotional functioning is not pathologized.

H - 42 Multivariate Base Rates for the NIH Toolbox Emotion Battery in the Spanish-Speaking Normative Sample.

This study involved the calculation of multivariate base rates for the NIH Toolbox Emotion Battery (NIHTB-EB) for the Spanish-speaking normative sample, stratifying by sociocultural variables. Participants were 224 Spanish-speaking adults from the NIHTB norming study (M = 42.2years-old, SD = 16.3; 40.2% Male; 100% Hispanic/Latinx). Frequencies of obtaining one or more "potentially problematic" emotion scores (i.e., either T60, depending on scale orientation) were calculated with stratifications by gender, education, country of birth and education, bilingualism, and household income. The NIHTB-EB includes 17 scales measuring negative affect, social satisfaction, and psychological well-being. When interpreting all 17 scales, 59.8% of participants had one or more potentially problematic score(s). Only education was related to problematic score frequencies (p < 0.014, phi = 0.19). Adults with less than high school education (68.4%) had the highest frequency scores compared to adults with a high school diploma (42.3%) or greater education (54.5%). Although non-significant, bilingual adults (66.7%) tended to have more potentially problematic scores than monolingual adults (56.8%; p = 0.16, phi = 0.09) and higher income (49.0%) was related to more potentially problematic scores than lower income (63.8%; p = 0.07, phi = 0.14). Most Spanish-speaking adults obtained one or more potentially problematic NIHTB-EB scores, with more emotional difficulties associated with less education and modestly associated with lower socioeconomic status and bilingualism. Future research may explore how these variables interact with emotional health among Spanish-speaking Hispanic/Latinx adults.

Recent Advances in Neuropsychological Test Interpretation for Clinical Practice.

Much attention in the field of clinical neuropsychology has focused on adapting to the modern healthcare environment by advancing telehealth and promoting technological innovation in assessment. Perhaps as important (but less discussed) are advances in the development and interpretation of normative neuropsychological test data. These techniques can yield improvement in diagnostic decision-making and treatment planning with little additional cost. Brooks and colleagues (Can Psychol 50: 196-209, 2009) eloquently summarized best practices in normative data creation and interpretation, providing a practical overview of norm development, measurement error, the base rates of low scores, and methods for assessing change. Since the publication of this seminal work, there have been several important advances in research on development and interpretation of normative neuropsychological test data, which may be less familiar to the practicing clinician. Specifically, we provide a review of the literature on regression-based normed scores, item response theory, multivariate base rates, summary/factor scores, cognitive intraindividual variability, and measuring change over time. For each topic, we include (1) an overview of the method, (2) a rapid review of the recent literature, (3) a relevant case example, and (4) a discussion of limitations and controversies. Our goal was to provide a primer for use of normative neuropsychological test data in neuropsychological practice.

Base rates of low neuropsychological test scores in older adults with subjective cognitive impairment: Findings from a tertiary memory clinic

Base rates of low scores are typically determined from normative samples, which differ from clinical samples. We examined base rates of spuriously low scores for 93 older adults with subjective cognitive impairment presenting to a memory clinic. Crawford’s Monte Carlo simulation algorithm was used to estimate multivariate base rates by calculating the percentage of cognitively intact memory clinic patients who produced normed scores at or below the 5th percentile. Neuropsychological tests included: Weschler Adult Intelligence Scale block design, digit span backwards, coding, Weschler Memory Scale logical memory immediate/delayed; California Verbal Learning Test immediate/delayed memory; Brief Visuospatial Memory Test immediate/delayed; and Delis-Kaplan Executive Functioning category switching, letter number sequencing, and inhibition/switching. An estimated 33.58% of the cognitively intact memory clinic population would have one or more low scores, 14.7% two or more, 6.55% three or more, 2.94% four or more, and 1.31% 5 or more due to chance. Base rates were then applied to a subset of clinical data: all with dementia and most with MCI had low scores that exceeded the base rates. Determining base rates of spuriously low scores on a neuropsychological battery in clinical samples could reduce false positives by using empirical adjustments for expected low scores.

Multivariate Base Rates of Low Score on Neuropsychological Tests of Individuals with Coca Paste Use Disorder.

The aim of this study was to determine the prevalence of low scores on eight commonly used neuropsychological tests to evaluate learning and memory, language, and executive functions in individuals with coca paste use disorders (CPUD) and to identify the differences with respect to a group of healthy nonconsuming subjects (HCs). 162 Colombian adults with CPUD and a group of 162 Colombian adult HCs participated in this comparative study. Eight tests (eighteen test scores) were grouped into three categories: learning and memory, language, and executive functions. Each participant was categorized based on the number of low scoring tests in specific percentile cut-off groups (25th, 16th, 10th, 5th, and 2nd). In the learning and memory domain, 89.5% of individuals with CPUD and 55.6% of HCs scored below the 25th percentile on at least one of the five test scores, in the language domain, 80.7% of individuals with CPUD and 58% of HCs and in the executive function domain, 92% of individuals with CPUD and 67.3% of HCs. Having two or more scores below the 10th percentile or 10 or more at the 5th percentile shows an optimal cut-off for determining the sensitivity and specificity for discriminating between the two groups. The individuals with CPUD had a higher percentage of low scores than the HCs in the domains of learning and memory, language, and executive function. It is important for clinicians to be aware of low scores in individuals with CPUD to avoid false-positive diagnoses of cognitive impairment.

Sexual and Gender Minority Victimization: Base Rates of Assault in College Students Across Sexual and Gender Identities.

Past findings have indicated that sexual and gender minority (SGM) individuals experience disproportionate rates of emotional, physical, and sexual assault compared to their heterosexual/cisgender counterparts. While these findings are robust, many studies report homogenous groupings of SGM participants. This practice likely masks important between-group differences. We sought to address this issue by examining reported base rates of emotional, physical, and sexual assault within 12 months of data collection, split across specific sexual (heterosexual, gay/lesbian, bisexual, questioning, queer, pansexual, asexual, and demisexual) and gender (cisgender men, cisgender women, gender nonconforming female assigned at birth [FAB], and gender nonconforming male assigned at birth) identity groups. Our data came from 2020 to 2021 Healthy Minds Study, a large survey of college students living in the United States (N = 119,181). Results indicated most forms of assault were higher in SGM groups compared to heterosexual and cisgender individuals, both on univariate and multivariate (e.g., one or more type of assault) levels. Demisexual individuals reported the highest base rates for emotional assault (45.7%), whereas pansexual individuals reported highest rates of physical assault (12.5%) and sexual assault (17.3%). Demisexual individuals reported the highest multivariate base rate of experiencing at least one form of assault (49.5%), and pansexual individuals reported the highest multivariate base rate of experiencing all three forms of assault (4.7%) within the past 12 months. Gender nonconforming FAB individuals reported the highest univariate and multivariate base rates across assault types compared to all other gender identity groups. With few exceptions, compared to heterosexual and cisgender men (referents), all other sexual and gender identity groups reported significantly higher adjusted odds of experiencing each assault type. These data suggest SGM individuals experience disproportionate levels of assault.

A-221 Multivariate Base Rates for the NIH Toolbox Emotion Battery

Abstract Objective: Neuropsychologists commonly administer multiple measures of emotional functioning; however, no prior research has examined whether examinees will normally obtain one or more clinically significant emotional scores if multiple questionnaires are administered and interpreted. This study prepared multivariate base rates for the NIH Toolbox Emotion Battery (NIHTB-EB), examining the frequency at which participants in the normative sample obtained ‘abnormal’ scores on the 17 individual scales (e.g., sadness, loneliness, life satisfaction) and 3 summary scores (i.e., negative affect, social satisfaction, and psychological well-being). Method: Participants were 2,879 English-speaking community members recruited for the NIHTB norming study (M=46.26 years-old, SD = 17.14; 46.7% men; 80.6% White). The frequency at which participants obtained one or more ‘abnormal’ emotion scores (i.e., either T60 depending on the scale) was calculated. Results: When interpreting all 17 individual NIHTB-EB scores, 66.3% of participants were elevated on one or more individual scales. When interpreting the 3 NIHTB-CB summary scores, 26.0% of participants were elevated on one or more of the summary scores. Conclusions: Similar to findings on performance-based neuropsychological tests, these base rates indicate that obtaining one or more abnormal scores is normal on questionnaires of emotional functioning. When administering multiple questionnaires, one or more low or elevated score(s) may correspond to normal variation in emotional functioning rather than significant distress or a disorder.

Multivariate Base Rates of Low Neuropsychological Test Scores in Cognitively Intact Older Adults with Subjective Cognitive Decline from a Specialist Memory Clinic.

To avoid misdiagnosing mild cognitive impairment (MCI), knowledge of the multivariate base rates (MVBRs) of low scores on neuropsychological tests is crucial. Base rates have typically been determined from normative population samples, which may differ from clinically referred samples. The current study addresses this limitation by calculating the MVBR of low or high cognitive scores in older adults who presented to a memory clinic experiencing subjective cognitive decline but were not diagnosed with MCI. We determined the MVBRs on the Kaplan-Baycrest Neurocognitive Assessment for 107 cognitively healthy older adults (M age = 75.81), by calculating the frequency of patients producing n scores below or above different cut-off values (i.e., 1, 1.5, 2.0, 2.5 SD from the mean), stratifying by education and gender. Performing below or above cut-off was common, with more stringent cut-offs leading to lower base rates (≥1 low scores occurred in 84.1% of older adults at -1 SD, 55.1% at -1.5 SD, and 39.3% at -2 SD below the mean; ≥1 high scores occurred in 80.4% of older adults at +1 SD, 35.5% at +1.5 SD, and 16.8% at +2 SD above the mean). Higher education was associated with varying base rates. Overall, the MVBR of obtaining a low cognitive test score was higher in this clinic sample, compared with prior studies of normative samples. MVBRs for clinically referred older adults experiencing memory complaints provide a diagnostic benefit, helping to prevent attributing normal variability to cognitive impairment and limiting false positive diagnoses.

Multivariate base rates of score elevations on the BRIEF2 in children with ADHD, autism spectrum disorder, or specific learning disorder with impairment in reading

ABSTRACT There is a paucity of research examining multivariate base rates (MBRs) of elevated scores in pediatric rating scales of cognition. We present novel MBR information on the Behavior Rating Inventory of Executive Function, Second Edition (BRIEF2) for several clinical groups: Attention-Deficit/Hyperactivity Disorder Combined Presentation (ADHD-C); ADHD Inattentive Presentation (ADHD-I); Autism Spectrum Disorder (ASD); and Specific Learning Disorder with impairment in Reading (SLD-R). Participants included children diagnosed as having ADHD-C (n = 350), ADHD-I (n = 343), ASD (n = 390), or SLD-R (n = 240). Cumulative MBRs (e.g., the % of a sample having one or more elevated scores) were examined for each BRIEF2 form (Parent, Teacher, and Self-Report) and at three T-score cutoffs (T ≥ 60, T ≥ 65, and T ≥ 70). The MBR of obtaining at least one elevated score was common across clinical groups and forms at T ≥ 60 (ADHD-C = 90.5–98.1%; ADHD-I = 83.9–98.7%; ASD = 90.3–96.9%, SLD-R = 60.0–78.4%), T ≥ 65 (ADHD-C = 66.7–97.2%; ADHD-I = 77.5–94.9%; ASD = 77.3–92.7%; SLD-R = 38.5–64.0%), and T ≥ 70 (ADHD-C = 52.4–89.4%; ADHD-I = 64.8–84.2%; ASD = 54.5–83.2%; SLD-R = 26.9–44.1%). MBRs appeared to differ as a function of group (ADHD-C > ADHD-I > ASD > SLD-R) and form (Parent > Teacher > Self-Report) though future research with well-defined samples is needed to investigate this. We provide novel MBR information to enhance clinical interpretation of BRIEF2 data.

The Frequency of Low Scores on ImPACT in Adolescent Student-Athletes: Stratification by Race and Socioeconomic Status Using Multivariate Base Rates

ABSTRACT This study examined the associations between the frequency of low scores on the Immediate Post-Concussion Assessment and Cognitive Test (ImPACT) by race and socioeconomic status (SES), using the proxy of Title I school status, among adolescent student-athletes and calculated multivariate base rates. There were 753 participants assigned to groups based on race (White: n = 430, 59.8%; Black: n = 289, 40.2%) and SES. Black student-athletes obtained more low neurocognitive test scores, which was associated with lower SES. The current study offers a resource to clinicians involved in concussion management who may wish to consider race and SES when interpreting ImPACT test performances.

Internalizing and externalizing comorbidity and symptom burden in a VA ADHD specialty evaluation clinic

The purpose of this study was to evaluate psychiatric diagnosis and symptom comorbidity in veterans diagnosed with attention-deficit/hyperactivity disorder (ADHD). Study design was retrospective chart review from an ADHD evaluation clinic at a Veterans Affairs hospital. Participants were 227 military veterans who completed a standardized ADHD assessment and produced valid Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) profiles. There were no differences in rates of internalizing or externalizing psychiatric conditions diagnosed in inattentive compared to combined ADHD presentations. However, compared to a subsample with no psychiatric diagnoses, individuals diagnosed with ADHD endorsed significantly more internalizing symptom burden, with combined ADHD veterans also endorsing significantly greater levels of negative emotions and neuroticism. Base rates of comorbid classes of psychiatric diagnoses were not increased in individuals with ADHD, though higher rates of trauma disorders were seen in the combined group compared to the inattentive group. Multivariate base rates of MMPI-2-RF Restructured Clinical scales across various subgroups are presented. There was evidence for differential phenotypes of psychiatric symptoms across ADHD presentations in clinically referred veterans, predominantly related to higher rates of internalizing symptoms.

Assessing Cognitive Decline in High-Functioning Spanish-Speaking Patients: High Score Base Rates on the Spanish-Language NIH Toolbox Cognition Battery.

Prior research has focused on the normal frequency of obtaining low scores on a neuropsychological test battery, but few studies have examined the normal frequency of obtaining high scores. This study involved the preparation of high score multivariate base rates for the Spanish-language National Institutes of Health (NIH) Toolbox Cognition Battery (NIHTB-CB). Participants included 250 healthy Latinx adults (age range: 19-80) from the Spanish-language NIHTB-CB normative sample who completed the full battery (two crystallized and four fluid cognition tests). Multivariate base rates, stratified by education, crystallized ability, and sociocultural characteristics, quantified the frequency at which participants obtained one or more "high" fluid test scores (i.e., ≥50th, ≥63rd, ≥75th, ≥84th, ≥91st, ≥95th, and ≥ 98th percentile). It was common for participants to obtain one or more high scores (i.e., 50.8% obtained one or more scores ≥84th percentile) and uncommon for participants to obtain "no" high scores, especially when using non-conventional thresholds for defining a high score (i.e., 10.8% obtained no scores ≥50th percentile). High scores were more commonly obtained by participants with greater education and higher crystallized ability, who were bilingual, born and educated within the United States, and from higher income households. This study demonstrated that participants administered multiple neuropsychological tests commonly obtain high scores, and that the frequency of high scores varies by education, crystallized ability, and sociocultural characteristics. The absence of high scores may be indicative of cognitive impairment among examinees who are higher functioning, have greater education, and have specific sociocultural characteristics (e.g., bilingualism, higher socioeconomic status).

Enhanced interpretation of the BRIEF2: multivariate base rates of elevated scores in the standardization samples

ABSTRACT The Behavior Rating Inventory of Executive Function, Second Edition (BRIEF2) is a standardized rating (self, parent, and teacher) scale of executive functioning in children and adolescents. Here, we provide multivariate base rate (MBR) information (for the Self, Parent, and Teacher forms), which is not included in the BRIEF2 Professional Manual. Participants were children and adolescents for the BRIEF2 Self-Report (ages = 11–18; N = 803), Parent-Report (ages = 5–18; N = 1,400), and Teacher-Report (ages = 5–18; N = 1,400) standardization samples. We focused on cumulative (e.g., % of sample with oneor more elevated scores) MBRs across scales, which were examined at three elevation levels on each form: T≥ 60, ≥65, and ≥70. Across forms, MBRs predictably decreased with increasing number of elevated scores and at higher cutoffs. The cumulative MBR of having at least one score at T≥ 60 was common (37.5–42.2%), but less frequent at T≥ 70 (15.4–17.4%). The probability of having elevated scores on all scales was very low, irrespective of form, age, or elevation threshold (T≥ 60 = 2.4–4.4%; T≥ 65 = 1.0–1.4%; T≥ 70 = 0.0–0.7%). There was no clinically meaningful relation between demographic factors (age, gender, race, and parental education) and MBRs. These data provide clinicians and researchers with an enhanced way of concurrently interpreting multiple BRIEF2 scales.

Univariate and Multivariate Base Rates of Score Elevations, Reliable Change, and Inter-Rater Discrepancies in the BRIEF-A Standardization Samples.

The Behavior Rating Inventory of Executive Function-Adult Version (BRIEF-A) is a standardized rating scale of subjective executive functioning. We provide univariate and multivariate base rates (BRs) for scale/index scores in the clinical range (T scores ≥65), reliable change, and inter-rater information not included in the Professional Manual. Participants were adults (ages = 18-90 years) from the BRIEF-A self-report (N = 1,050) and informant report (N = 1,200) standardization samples, as well as test-retest (n = 50 for self, n = 44 for informant) and inter-rater (n = 180) samples. Univariate BRs of elevated T scores were low (self-report = 3.3%-15.4%, informant report = 4.5%-16.3%). Multivariate BRs revealed the common occurrence of obtaining at least one elevated T-score across scales (self-report = 26.5%-37.3%, informant report = 22.7%-30.3%), whereas virtually none had elevated scores on all scales. Test-retest scores were highly correlated (self = .82-.94; informant = .91-.96). Inter-rater correlations ranged from .44 to .68. Significant (p < .05) test-retest T-score differences ranged from 7 to 12 for self-report, from 6 to 8 for informant report, and from 16 to 21 points for inter-rater T-score differences. Applications of these findings are discussed.

Cognitive Impairment in Late-Life Depression: A Comparative Study of Healthy Older People, Late-Life Depression, and Mild Alzheimer's Disease Using Multivariate Base Rates of Low Scores.

Late-Life Depression (LLD) is often associated with cognitive impairment. However, distinction between cognitive impairment due to LLD and those due to normal aging or mild Alzheimer's Disease (AD) remain difficult. The aim of this study was to present and compare the multivariate base rates of low scores in LLD, mild AD, and healthy control groups on a battery of neuropsychological tests. Participants (ages 60–89) were 352 older healthy adults, 390 patients with LLD, and 234 patients with mild AD (i.e., MMSE ≥ 20). Multivariate base rates of low scores (i.e., ≤ 5th percentile) were calculated for each participant group within different cognitive domains (verbal episodic memory, executive skills, mental processing speed, constructional praxis, and language/semantic memory). Obtaining at least one low score was relatively common in healthy older people controls (from 9.4 to 17.6%), and may thus result in a large number of false positives. By contrast, having at least two low scores was unusual (from 0.3 to 4.6%) and seems to be a more reliable criterion for identifying cognitive impairment in LLD. Having at least three low memory scores was poorly associated with LLD (5.9%) compared to mild AD (76.1%) and may provide a useful way to differentiate between these two conditions [ = 329.8, p < 0.001; Odds Ratio = 50.7, 95% CI = 38.2–77.5]. The multivariate base rate information about low scores in healthy older people and mild AD may help clinicians to identify cognitive impairments in LLD patients, improve the clinical decision-making, and target those who require regular cognitive and clinical follow-up.

A-10 High Score Multivariate Base Rates for the Spanish-Language NIH Toolbox Cognition Battery: Potential Resource for Assessing High-Functioning Spanish-Speaking Patients

Abstract Objective This study involved the preparation of high score multivariate base rates for the Spanish-language NIH Toolbox Cognition Battery (NIHTB-CB) to inform neuropsychological practice with high-functioning Spanish-speaking patients. Method Participants included 250 healthy adults from the Spanish-language NIHTB-CB normative sample (M = 38.8 ± 13.7 years-old; 72.0% women; 100% Latinx) who completed the full battery (2 crystallized and 5 fluid cognition tests). Multivariate base rates quantified the frequency at which participants obtained 1+ fluid test scores ≥50th, ≥63rd, ≥75th, ≥84th, ≥91st, ≥95th, and ≥ 98th percentile based on age-adjusted and demographic-adjusted normed scores, with stratifications based on education, crystallized ability, and sociocultural characteristics. Results It was common for participants in the normative sample to obtain 1+ high scores (50.8% obtained 1+ scores ≥84th percentile) and uncommon for participants to obtain no high scores, especially when using lower, non-conventional thresholds for defining a high score (10.8% obtained no scores ≥50th percentile). The frequency of participants obtaining no high scores varied by education (36.8% with &amp;lt;12 years obtained no scores ≥63rd percentile vs. 2.1% with ≥16 years), crystallized ability (47.8% with below average ability obtained no scores ≥75th percentile vs. 21.9% with above average ability), and sociocultural characteristics (37.1% from households below national median income obtained no scores ≥75th vs. 6.9% from households above). Conclusion(s) The frequency of high scores varied by education, crystallized ability, and sociocultural characteristics, which was not fully accounted for by use of demographic-adjusted norms. In high-functioning patients and patients of higher socioeconomic status, the absence of high scores is uncommon and may indicate cognitive decline.

A Multivariate Interpretation of the Spanish-Language NIH Toolbox Cognition Battery: The Normal Frequency of Low Scores.

The current study involved the preparation of multivariate base rates for the Spanish-language NIH Toolbox Cognition Battery (NIHTB-CB) based on the U.S. normative sample, quantifying the normal frequency of low scores among healthy adults. Participants included 250 healthy Latinx adults (M = 38.8 ± 13.7years old, range: 19-80; 72.0% women; education: M = 11.5 ± 3.9years) who completed the full Spanish-language NIHTB-CB, including two tests of crystallized cognition and five tests of fluid cognition. Multivariate base rates quantified the frequency at which participants obtained 1 or more fluid scores ≤25th, ≤16th, ≤9th, ≤5th, and ≤2nd percentile, per age-adjusted or demographically adjusted (age, gender, education) normed scores. A substantial minority of participants had 1 or more low scores (e.g., 40.4% had 1 or more age-adjusted score ≤16th percentile). The frequencies of low scores increased with fewer years of education and lower crystallized cognitive ability. Higher frequencies of low scores were observed among participants who were born and educated abroad, versus within the USA; monolingual Spanish speakers, versus bilingual Spanish/English speakers; and from households below the national median income, versus households above the national median. Low scores were common and related to crystallized ability, education, and sociocultural variables. Although using demographically adjusted scores reduced group differences related to sociocultural variables, group differences were not eliminated, indicating that age, gender, and education score adjustments do not fully explain the associations between sociocultural variables and test performances. These stratified base rates may be useful when working with Spanish-speaking patients with diverse sociocultural characteristics.

Multivariate Base Rates and Concussion Detection: A Comparative Study.

Recent research has yielded multivariate base rates (MBRs) of low scores in healthy populations using a widely adopted concussion screening measure, Immediate Postconcussion and Cognitive Testing (ImPACT). However, the extent to which individuals with concussion obtain reliable changes at divergent frequencies relative to healthy individuals is largely unknown. The present study examined whether MBRs of reliable change accurately discriminated between those with and without concussion. This archival review consisted of 129 healthy individuals and 81 individuals with concussion. MBRs of reliable change scores were examined at varying cutoffs and frequencies between those with and without concussion. Composites showed small to medium effect sizes in differentiating between those with and without concussion. MBRs of reliable change scores on ImPACT provided limited discriminative utility in isolation. Computations of posttest probabilities using Bayes' Theorem yielded evidence for incremental gains when utilizing MBRs of reliable change under certain constraints.

Multivariate Base Rates of Low Scores on Tests of Executive Functions in a Multi-Country Latin American Sample

ABSTRACT The objective of the study was to determine the prevalence of low scores in a diverse Latin American population for two neuropsychological commonly used tests to evaluate executive functions and to compare the number of low scores obtained using normative data from a Spanish-speaking population from Latin America versus an English-speaking population from U.S.A. Healthy adults (N = 5402) were administered the Modified Wisconsin Card Sorting Test and Stroop Color-Word. Low scores on measures of executive functioning are common. Clinicians working with Spanish-speaking adults should take into account the higher probability of low scores on these measures to reduce false-positive diagnoses of cognitive deficits in an individual.

Influence of Special Education, ADHD, Autism, and Learning Disorders on ImPACT Validity Scores in High School Athletes

AbstractObjective:The Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) is commonly used to assist with post-concussion return-to-play decisions for athletes. Additional investigation is needed to determine whether embedded indicators used to determine the validity of scores are influenced by the presence of neurodevelopmental disorders (NDs).Method:This study examined standard and novel ImPACT validity indicators in a large sample of high school athletes (n = 33,772) with or without self-reported ND.Results:Overall, 7.1% of athletes’ baselines were judged invalid based on standard ImPACT validity criteria. When analyzed by group (healthy, ND), there were significantly more invalid ImPACT baselines for athletes with an ND diagnosis or special education history (between 9.7% and 54.3% for standard and novel embedded validity criteria) when compared to athletes without NDs. ND history was a significant predictor of invalid baseline performance above and beyond other demographic characteristics (i.e., age, sex, and sport), although it accounted for only a small percentage of variance. Multivariate base rates are presented stratified for age, sex, and ND.Conclusions:These data provide evidence of higher than normal rates of invalid baselines in athletes who report ND (based on both the standard and novel embedded validity indicators). Although ND accounted for a small percentage of variance in the prediction of invalid performance, negative consequences (e.g., extended time out of sports) of incorrect decision-making should be considered for those with neurodevelopmental conditions. Also, reasons for the overall increase noted here, such as decreased motivation, “sandbagging”, or disability-related cognitive deficit, require additional investigation.