Using standardized methods to assess suicidal behavior: the need is even greater than it looks.

Abstract

Submitted: October 7, 2014; accepted October 8, 2014. Corresponding author: Eric A.Youngstrom, PhD, Department of Psychology, University of North Carolina at Chapel Hill, CB #3270, Davie Hall, Chapel Hill, NC 27599-3270 (eay@unc.edu). J Clin Psychiatry 2015;76(10):e1331–e1332 dx.doi.org/10.4088/JCP.14com09573 © Copyright 2015 Physicians Postgraduate Press, Inc. T article by Brown et al1 addresses the crucial issue of detection of suicidal behavior and nonsuicidal selfinjury in clinical practice. The research includes numerous strengths in terms of research design and statistical analysis. The article compared the results of a structured interview to clinical diagnoses and found that although the agreement was high (κ ~ 0.76), the structured interview detected or reclassified 18% of the cases (n = 23) as having a history of a suicide attempt. Of these, slightly more than half were reclassifications of what the clinician had recorded as nonsuicidal self-injury (n = 4) or some other behavior (n = 8), and 11 were cases for which there was no documentation of any concern about suicidal behavior in the clinical record. Reassuringly, the cases detected only via the structured interview tended to be milder cases; the clinicians did an excellent job of detecting and documenting the recent and severe events. Brown and coauthors1 do a good job of conveying the clinical importance of even these less severe events, which they note have important prognostic value for future suicidal behavior and thus warrant careful clinical documentation and management. It would be a mistake to conclude that these results mean that the status quo of clinical assessment is sufficient. The kappa (κ) value reported here was exceptionally high. Agreement between clinical diagnoses and diagnoses based on semistructured clinical interviews tends to be poor.2,3 A recent comparison of billing diagnoses versus diagnoses based on semistructured interview found a median κ value of 0.37,4 and even that was better than the median κ value of 0.29 for externalizing problems and 0.28 for internalizing problems based on a meta-analysis of 38 articles and almost 16,000 probands.5 In the retest reliability for the DSM-5 Field Trials, nonsuicidal self-injury obtained a κ value of 0.03 at the 1 site that was able to evaluate it.6 Compared to the literature, the results of Brown et al1 are an outlier, most likely resulting from a combination of factors including reliance on clinicians at academic institutions with a culture of excellence in research and evaluation of suicidal ideation and behavior. In the larger context, those findings represent a “best-case scenario” owing to the strengths of design. These results underscore the gap between more typical clinical practice and the results that would be possible using a more structured approach. It is sobering that agreement is so poor, across both common and contentious diagnoses, and the evidence underscores the value of more structured approaches for clinical issues such as nonsuicidal self-injury behavior. The DSM-5 Field Trials also amplify the conclusion from Brown et al1 that there is great need for tools that support consistency in nomenclature when describing the range of self-injurious behaviors.7,8 With DSM-5, clinicians were not given structured interview tools, but they were all aware that they were participating in the field trial and had prior knowledge of what diagnoses were under consideration, showing that cognizance of the diagnoses by itself was not enough to produce agreement. The potential value of checklists and structured assessments is not limited to psychiatry. Structured methods have demonstrated value in surgery and flight control and arguably could improve performance in most areas requiring processing of complex information.9 Mental health, however, appears more reluctant than other medical disciplines to embrace structured methods. Practitioners feel that structured approaches compromise their professional autonomy and fear that such approaches would compromise rapport with patients.10 Data directly contradict these concerns: patients report high levels of rapport after structured evaluations and prefer them to unstructured interviews, perceiving structured evaluations as more thorough and providing a better understanding of their situation and needs.11 Brown et al1 found that structured approaches did not require inordinate amounts of time, and they significantly increased sensitivity to clinically meaningful levels of selfharm behaviors. There are a variety of tools available that have demonstrated good reliability and validity for the assessment of suicidal ideation and behavior, and several are relatively brief, particularly when administration uses screening questions and skip-outs.12–14 Adoption of these methods in clinical settings, especially those where the risk of suicidal behavior is elevated, would improve the accuracy of clinical assessment and the ensuing decision making, even more than the results from Brown and colleagues1 might appear to suggest.