Development and Validation of Machine Learning Models to Predict Readmission After Colorectal Surgery

Abstract

BackgroundReadmission after colorectal surgery is common and often implies complications for patients and costs for hospitals. Previous works have created predictive models using logistic regression for this outcome but have shown limited accuracy. Machine learning has shown promise in improving predictions by identifying non-linear patterns in data. We sought to create a more accurate predictive model for readmission after colorectal surgery using machine learning. MethodsPatients who underwent colorectal surgery were identified in the National Quality Improvement Program (NSQIP) database including years 2012–2019 and split into training, validation, and test sets. The primary outcome was readmission within 30 days of surgery. Three types of machine learning models were created, including random forest (RF), gradient boosting (XGB), and neural network (NN). A logistic regression (LR) model was also created for comparison. Model performance was evaluated using area under the receiver operating characteristic curve (AUROC). ResultsThe dataset included 213,827 patients after application of exclusion criteria. A total of 23,083 (10.8%) of patients experienced readmission. NN obtained an AUROC of 0.751 (95% CI 0.743–0.759), compared with 0.684 (95% CI 0.676–0.693) for LR. RF and XGB performed similarly with AUROCs of 0.749 (95% CI 0.741–0.757) and 0.745 (95% CI 0.737–0.753) respectively. Ileus, index admission length of stay, organ-space surgical site infection present at time of surgery, and ostomy placement were identified as the most contributory variables. ConclusionsMachine learning approaches outperformed traditional statistical methods in the prediction of readmission after colorectal surgery. After external validation, this improved prediction model could be used to target interventions to reduce readmission rate.