Abstract

Background: Assessment of cerebral aneurysm rupture risk is an important task, but it remains challenging. Recent works applying machine learning to rupture risk evaluation presented positive results. Yet they were based on limited aspects of data, and lack of interpretability may limit their use in clinical setting. We aimed to develop interpretable machine learning models on multidimensional data for aneurysm rupture risk assessment.Methods: Three hundred seventy-four aneurysms were included in the study. Demographic, medical history, lifestyle behaviors, lipid profile, and morphologies were collected for each patient. Prediction models were derived using machine learning methods (support vector machine, artificial neural network, and XGBoost) and conventional logistic regression. The derived models were compared with the PHASES score method. The Shapley Additive Explanations (SHAP) analysis was applied to improve the interpretability of the best machine learning model and reveal the reasoning behind the predictions made by the model.Results: The best machine learning model (XGBoost) achieved an area under the receiver operating characteristic curve of 0.882 [95% confidence interval (CI) = 0.838–0.927], significantly better than the logistic regression model (0.779; 95% CI = 0.729–0.829; P = 0.002) and the PHASES score method (0.758; 95% CI = 0.713–0.800; P = 0.001). Location, size ratio, and triglyceride level were the three most important features in predicting rupture. Two typical cases were analyzed to demonstrate the interpretability of the model.Conclusions: This study demonstrated the potential of using machine learning for aneurysm rupture risk assessment. Machine learning models performed better than conventional statistical model and the PHASES score method. The SHAP analysis can improve the interpretability of machine learning models and facilitate their use in a clinical setting.

Highlights

  • Intracranial aneurysms are present in 3–7% of the population [1]

  • Besides commonly used metrics such as area under the receiver operating characteristic (ROC) curve, we reported results of area under the precision recall curve, which is more informative on imbalanced dataset

  • The XGBoost model achieved the highest area under the ROC curve of 0.882 [95% confidence interval (CI), 0.838–0.927], followed by the support vector machine (SVM) model of 0.838, artificial neural network (ANN) model of 0.837, and logistic regression (LR) model of 0.779

Read more

Summary

Introduction

Intracranial aneurysms are present in 3–7% of the population [1]. the rupture rates of aneurysms are low, the consequences can be dire [2, 3]. The PHASES score is among the most quoted, which is derived based on several large cohort studies [14, 15] In both ISUIA and UCAS studies, aneurysms smaller than 7 mm have been associated with very low risk profiles for rupture [3]. Assessment of cerebral aneurysm rupture risk is an important task, but it remains challenging. Recent works applying machine learning to rupture risk evaluation presented positive results. They were based on limited aspects of data, and lack of interpretability may limit their use in clinical setting. We aimed to develop interpretable machine learning models on multidimensional data for aneurysm rupture risk assessment

Objectives
Methods
Results
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call