30 days mortality prediction and risk factor analysis of Asian patients with ACS using interpretable machine learning algorithm

Abstract

Abstract Background Thrombolysis in Myocardial Infarction (TIMI) is used to predict the mortality rate in patients with acute coronary syndrome (ACS). TIMI was developed with limited data on the Asian cohort and was based on the Western cohort. STEMI and NSTEMI have separate TIMI scores. There has been limited research on Asian ACS patients using interpretable machine learning (ML) algorithms. Purpose To construct a single 30-day mortality risk scoring system, as well as identify and analyse risk factors in ASIAN patients with ACS, that is applicable to both STEMI and NSTEMI patients, using an interpretable ML algorithm. Methods The National Cardiovascular Disease Database registry data of 9054 patients was used. 70% of the data was used for algorithm development, with the remaining 30% used for validation Fifty-four parameters were considered, demographics, cardiovascular risk, medications, and clinical variables. To provide better guidance and advice for clinical judgement, the gradient boosting algorithm (XGBoost) for classification analysis and SHapley Additive exPlanation (SHAP) value analysis graphs were used. Each indicator's SHAP value indicates the impact on model output (mortality) and was calculated using the XGBoost model. The performance evaluation metric was the area under the curve (AUC). The model was validated with a validation dataset and compared to the conventional score TIMI for STEMI and NSTEMI. Results The performance on validation dataset of the XGBoost algorithm using the top ten predictors from SHAP for; STEMI (AUC = 0.8534, 95% CI: 0.8226–0.8842, Accuracy: 0.8053, Sensitivity: 0.73125, Specificity: 0.81355) and NSTEMI (AUC = 0.8145, 95% CI: 0.77–0.8589, Accuracy: 0.7972, Sensitivity: 0.64356, Specificity: 0.81232) outperformed TIMI score (STEMI AUC = 0.785, NSTEMI AUC = 0.543). Killip class, age, heart rate, fasting blood glucose, ACEI, creatine kinase, systolic blood pressure, HDLC, cardiac catheterization, and oralhypogly are the top ten predictors chosen by the SHAP feature selection in ascending order. Cardiac catheterization and pharmacotherapy drugs as selected predictors improve mortality prediction in STEMI and NSTEMI patients compared to TIMI. The variable names are displayed on the y-axis in ascending order of importance. The average SHAP value is shown next to them. The SHAP value is shown on the x-axis. The colour represents the value of the feature, ranging from small to large, allowing comprehension of the distribution of the SHAP values for each feature (Figure 1). We can see that having a high killip class and being older are linked to a lower survival rate in ACS patients. Cardiac catheterization procedures, as well as the use of ACEI and OHA, both improve patient mortality (Figure 2). Conclusions A single algorithm would classify ACS patients better than TIMI, which requires two distinct scores. In order to better predict 30-day mortality in an ASIAN population, interpretable ML can be used. Funding Acknowledgement Type of funding sources: Public grant(s) – National budget only. Main funding source(s): Technology Development Fund 1