External validity of the Society of Thoracic Surgeons risk stratification tool for deep sternal wound infection after cardiac surgery in a UK population

Abstract

Deep sternal wound infection (DSWI) is a devastating complication of cardiac surgery, with a historical incidence of 0.4-5%. Predicting which patients are at higher risk of infection may help instituting various preventive measures. Risk calculations for mortality have been used as surrogates to estimate the risk of deep sternal wound infection, with limited success. The Society of Thoracic Surgeons (STS) 2008 Risk Calculator modelled the risk of DSWI for cardiac surgical patients, but it has not been validated since its publication. We sought to assess the external validity of the STS-estimated risk of DSWI in a United Kingdom (UK) population. Using our prospectively captured database, we retrospectively calculated the risk of DSWI for 14 036 patients undergoing valve, coronary artery bypass grafts or combined procedures between February 2001 and March 2010. DSWI was identified according to the Centre for Disease Control and Prevention definition. The receiver operator characteristic (ROC) curve was employed to test the performance of the model using the area under the ROC curve (AUROC). The calibration of the model was interrogated using the Hosmer-Lemeshow test for Goodness of Fit. A total of 135 (0.95%) patients developed DSWI. Although there was a statistically significant difference in the calculated risk of patients who contracted DSWI (0.44% ± 0.01) vs those who did not (0.28% ± 0.00, P < 0.0001), the AUROC of 0.699 (95% confidence interval: 0.6522-0.7414) denoted a modest discriminatory power, with the Hosmer-Lemeshow Goodness of Fit statistic (P < 0.001) suggesting poor calibration. A risk-adjusted modifier improved the calibration (P = 0.08). The STS risk calculator lacks adequate discriminatory power for estimating the isolated risk of developing deep sternal wound infection in a UK population. The discrimination is similar to the tool's validation c-statistic and may have a place in an integrated calculator.