Development of a Machine Learning Model to Predict Outcomes and Cost After Cardiac Surgery

Abstract

Machine learning (ML) algorithms may enhance outcomes prediction and help guide clinical decision making. This study aimed to develop and validate a ML model that predicts postoperative outcomes and costs after cardiac surgery. The Society of Thoracic Surgeons registry data from 4874 patients who underwent cardiac surgery (56% coronary artery bypass grafting, 42% valve surgery, 19% aortic surgery) at our institution were divided into training (80%) and testing (20%) datasets. The Extreme Gradient Boosting decision-tree ML algorithms were trained to predict three outcomes: operative mortality, major morbidity or mortality, and Medicare outlier high hospitalization cost. Algorithm performance was determined using accuracy, F1 score, and area under the precision-recall curve (AUC-PR). The ML algorithms were validated in index surgery cases with The Society of Thoracic Surgeons risk scores for mortality and major morbidities and with logistic regression and were then applied to nonindex cases. The ML algorithms with 25 input parameters predicted operative mortality (accuracy 95%; F1 0.31; AUC-PR 0.21), major morbidity or mortality (accuracy 71%, F1 0.47; AUC-PR 0.47), and high cost (accuracy 84%; F1 0.62; AUC-PR 0.65). Preoperative creatinine, complete blood count, patient height and weight, ventricular function, and liver dysfunction were important predictors for all outcomes. For patients undergoing nonindex cardiac operations, the ML model achieved an AUC-PR of 0.15 (95% CI, 0.05-0.32) for mortality and 0.59 (95% CI, 0.51-0.68) for major morbidity or mortality. The extreme gradient boosting ML algorithms can predict mortality, major morbidity, and high cost after cardiac surgery, including operations without established risk models. These ML algorithms may refine risk prediction after cardiac surgery for a wide range of procedures.