Abstract Background Despite echocardiography being essential for cardiac assessment, a point-of-care tool for rapid left ventricular ejection fraction (LVEF) evaluation is lacking in current clinical practice, highlighting the need for a widescale, easily deployable method to assess LV function. Purpose To develop and validate two artificial intelligence (AI) models that accurately detect reduced LVEF on a single 12-lead ECG using a smartphone, facilitating early identification of patients at risk for heart failure who may benefit from more detailed echocardiographic evaluation. Methods A large collection of ECGs and transthoracic echocardiograms (TTEs) was sourced from our hospital data vault from 2011 to 2021. ECGs were paired to TTEs within a 24h time window and the resulting pairs were randomly assigned to the model development dataset (50%) and validation dataset (50%). Two distinct AI-ECG models were developed: one to detect LVEF≤40% and another for LVEF<50%, derived from the ESC definition of heart failure. Both AI-ECG models were paired with smartphone based ECG digitization technology. Key performance metrics include area under the receiver operating characteristic curve (AUC), sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and F1-score. Results A total of 1,205,370 ECGs (198,274 patients) and 291,433 TTEs (105,849 patients) were collected and paired, resulting in 109,809 ECG-TTE pairs (56,236 patients). The validation dataset consisted of 25,510 distinct TTE-ECG pairs (25,510 patients). Prevalence of LVEF≤40% and LVEF<50% was 5.4% and 7.9% respectively. The LVEF≤40% model demonstrated an AUC of 0.963 (95% CI: 0.959-0.966), sensitivity 0.924 (95% CI: 0.91-0.937), specificity 0.887 (95% CI: 0.883-0.891), and F1-score of 0.474 (95% CI: 0.457-0.490). PPV and NPV were 0.318 (95% CI: 0.304-0.333) and 0.995 (95% CI: 0.994-0.996) respectively. Performance of the LVEF <50% model shows an AUC of 0.952 (95% CI: 0.947-0.956), with a slightly lower sensitivity of 0.899 (95% CI: 0.886-0.912), specificity of 0.875 (95% CI: 0.871-0.879), PPV of 0.382 (95% CI: 0.368-0.395), NPV of 0.99 (95% CI: 0.989-0.992), and F1-score of 0.536 (0.521-0.55). Conclusion The AI models exhibit the ability to identify reduced LVEF from standard 12-lead ECGs using a smartphone. Results suggest potential clinical utility as a preliminary screening tool to select patients for confirmatory echocardiography. This AI application could potentially offer a timely and cost-effective method for identifying patients at risk for future development of heart failure.
Read full abstract