423 Evaluation of Electronic Medical Record Artificial Intelligence Screening Tools for Undiagnosed OSA

Abstract

Abstract Introduction The STOP-Bang is a concise, simple and widely adopted obstructive sleep apnea (OSA) screening tool. However, it has limited predictive ability and is susceptible to subjective reporting bias. Artificial Intelligence (AI) methodologies can be utilized together with existing data in electronic medical records (EMRs) to create new screening tools to increase diagnostic sensitivity and facilitate discovery of preclinical OSA phenotypes. Methods The study comprised two independent retrospective sleep study datasets: 1) Type III HSATS (N=5583) and, 2) Type I polysomnograms (N=1037). Each contained raw sleep study waveforms, manually scored sleep events (respiratory, arousal, sleep staging), and standard report indices (apnea-hypopnea index; AHI, arousal index). Additionally, the first dataset contained 90 EMR based metadata variables and the second dataset contained 54 EMR based metadata variables. Three random forest models were trained to detect OSA diagnostic thresholds (AHI> 5, AHI>15, and AHI>30) over three different screening models: STOP-Bang, P-Bang (blood-pressure, BMI, age, neck-size, gender), and Common Clinical Data Set (CCDS)-OSA (all metadata variables simulating EMR CCDS standard). Results CCDS-OSA ROC-AUC exceeded STOP-Bang and P-Bang for both sleep study collections, resulting in AHI>15 ROC-AUC values of 0.73 and 0.71 (CCDS-OSA) compared to AHI>15 ROC-AUC values of 0.68 and 0.69 (STOP-Bang). Additionally, we analyzed the Gini feature importance ranking of the trained CCDS-OSA model to evaluate which variables showed highest predictive value of OSA. The ranking revealed the top 5 features were the five physiologic based STOP-Bang parameters, followed by EMR based physiologic measurements such as HDL, triglycerides, systolic BP, and disease conditions such as diabetes, hypertension, and depression. Conclusion This study shows that while STOP-Bang contains data critical to OSA screening, a variety of other EMR-based parameters can improve performance of OSA detection. AI-based EMR screening can provide a critical tool for more systematic and accurate screening of undiagnosed sleep apnea. Nationwide standards facilitating patient EMR data interoperable health information exchange, particularly the United States Core Data for Interoperability (USCDI CCDS), holds promise to foster broad clinical and research opportunities. Resulting data sharing will allow application of AI screening tools at the population health scale with ubiquitous, existing EMR data to improve population sleep health. Support (if any):