A-72 Cross Validation of the Automated Neuropsychological Assessment Metrics (ANAM) Performance Validity Measure in Active Duty Service Members

Abstract

Abstract Objective The Automated Neuropsychological Assessment Metrics (ANAM) is the currently mandated Neurocognitive Assessment Tool (NCAT) for the Department of Defense for pre-deployment baseline testing and is the recommended tool for post-concussion evaluation and return to duty decision making. An ANAM performance validity measure has undergone initial validation (Roebuck-Spencer, Vincent, Gilliland, Johnson and Cooper, 2013). However, cross validation in other samples is warranted, particularly in order to establish cut-points for utilization in the evaluation of mTBI/concussion. The current study retrospectively examined the operating characteristics of the ANAM PVI relative to a more established performance validity test (PVT) in a sample of active duty Service Members referred for neurocognitive screening postconcussion in an Army brain injury clinic. Method Retrospective review of 172 US Service Members referred for neurocognitive screen for possible mild traumatic brain injury/concussion on average 3.8 years post injury (range = 8 days to 27 years) and administered the ANAM, Word Memory Test (WMT), and Neuropsychological Assessment Battery Screening Module (NAB-S). Results Utilizing the WMT as the criterion measure, ROC analysis was significant with AUC = 0.894 (p < 0.001). At 90.09% specificity (95% CI = 83.0% - 94.9%), the optimal cut-point was ANAM PVM ≥ 6, and resulted in 67.21% sensitivity (95% CI = 54.0% - 78.7%). Conclusions The standard ANAM PVI clinical report utilizes a cut-point of 14; however, the current data indicate a cut-point of ≥ 6 may be better suited for patients with mTBI/concussion.