Validation of lay‐administered mental health assessments in a large Army National Guard cohort

Abstract

To report the reliability and validity of key mental health assessments in an ongoing study of the Ohio Army National Guard (OHARNG). The 2616 OHARNG soldiers received hour-long structured telephone surveys including the post-traumatic stress disorder (PTSD) checklist (PCV-C) and Patient Health Questionnaire - 9 (PHQ-9). A subset (N = 500) participated in two hour clinical reappraisals, using the Clinician-Administered PTSD Scale (CAPS) and the Structured Clinical Interview for DSM (SCID). The telephone survey assessment for PTSD and for any depressive disorder were both highly specific [92% (standard error, SE 0.01), 83% (SE 0.02)] with moderate sensitivity [54% (SE 0.09), 51% (SE 0.05)]. Other psychopathologies assessed included alcohol abuse [sensitivity 40%, (SE 0.04) and specificity 80% (SE 0.02)] and alcohol dependence [sensitivity, 60% (SE 0.05) and specificity 81% (SE 0.02)].The baseline prevalence estimates from the telephone study suggest alcohol abuse and dependence may be higher in this sample than the general population. Validity and reliability statistics suggest specific, but moderately sensitive instruments.