A-219 Cross-validation of a Delis-Kaplan Executive Function System Color Word Interference Test embedded performance validity test

Abstract

Abstract Objective Eglit and colleagues (2019) found that the sum of the four age-corrected scaled scores from the Color Word Interference Test (CWIT) of the Delis-Kaplan Executive Function System (D-KEFS) could act as a useful embedded performance validity test (PVT). As such, we attempted to cross-validate their findings. Method Patients included 312 individuals who completed neuropsychological evaluations. Individuals were excluded if they were not administered CWIT, were not administered at least 4 criterion PVTs, had diagnoses of dementia or intellectual disability, or had indeterminate validity results (i.e., failure of one PVT). Valid performers (n = 231) were those who passed all criterion PVTs while invalid performers (n = 81) failed two or more criterion PVTs. A receiver operating characteristic curve was conducted for the CWIT embedded PVT. Results Area under the curve (AUC) was .804. At a cutoff of < 26, specificity was 90% and sensitivity was 48%. At a cutoff of < 20 (the first cutoff at which 90% specificity was found by Eglit et al.), specificity was 95% and sensitivity was 32%. At an even more conservative cutoff of < 18 (the cutoff recommended by Eglit et al.), specificity was 96% and sensitivity was 22%. Conclusions These results cross-validate Eglit et al.’s findings, indicating that the sum of age-corrected scaled scores across the four CWIT trials can effectively serve as an embedded PVT. A more liberal cutoff was able to be applied in our sample but, even at conservative cutoffs documented in Eglit et al., sensitivity rates were adequate enough to warrant use of the index as an embedded PVT.