Predicting mortality after coronary artery bypass surgery: what do artificial neural networks learn? The Steering Committee of the Cardiac Care Network of Ontario.

Abstract

To compare the abilities of artificial neural network and logistic regression models to predict the risk of in-hospital mortality after coronary artery bypass graft (CABG) surgery. Neural network and logistic regression models were developed using a training set of 4,782 patients undergoing CABG surgery in Ontario, Canada, in 1991, and they were validated in two test sets of 5,309 and 5,517 patients having CABG surgery in 1992 and 1993, respectively. The probabilities predicted from a fully trained neural network were similar to those of a "saturated" regression model, with both models detecting all possible interactions in the training set and validating poorly in the two test sets. A second neural network was developed by cross-validating a network against a new set of data and terminating network training early to create a more generalizable model. A simple "main effects" regression model without any interaction terms was also developed. Both of these models validated well, with areas under the receiver operating characteristic curves of 0.78 and 0.77 (p > 0.10) in the 1993 test set. The predictions from the two models were very highly correlated (r=0.95). Artificial neural networks and logistic regression models learn similar relationships between patient characteristics and mortality after CABG surgery.