Natural Language Processing — A Surveillance Stepping Stone to Identify Child Abuse

Abstract

ObjectiveWe aimed to refine a natural language processing (NLP) algorithm that identified injuries associated with child abuse and identify areas in which integration into a real-time clinical decision support (CDS) tool may improve clinical care. MethodsWe applied an NLP algorithm in “silent mode” to all emergency department (ED) provider notes between July 2021 and December 2022 (n = 353) at 1 pediatric and 8 general EDs. We refined triggers for the NLP, assessed adherence to clinical guidelines, and evaluated disparities in degree of evaluation by examining associations between demographic variables and abuse evaluation or reporting to child protective services. ResultsSeventy-three cases falsely triggered the NLP, often due to errors in interpreting linguistic context. We identified common false-positive scenarios and refined the algorithm to improve NLP specificity. Adherence to recommended evaluation standards for injuries defined by nationally accepted clinical guidelines was 63%. There were significant demographic differences in evaluation and reporting based on presenting ED type, insurance status, and race and ethnicity. ConclusionsAnalysis of an NLP algorithm in “silent mode” allowed for refinement of the algorithm and highlighted areas in which real-time CDS may help ED providers identify and pursue appropriate evaluation of injuries associated with child physical abuse.