Commentary: Automated Machine Learning Model Development for Intracranial Aneurysm Treatment Outcome Prediction: A Feasibility Study.

Abstract

While the discriminatory ability of the AutoML approach is highest among the statistical approaches in the study presented, the authors did not assess the calibration of the various algorithms. We argue that an assessment of the calibration could be a further step to both evaluate and compare classical statistical methods with AutoML approaches to provide a more holistic estimate of the performance of various classifiers. Furthermore, we would like to point out that the application of AutoML as exemplified still requires rather profound knowledge of the hyperparameters of the algorithm used in the model-building pipeline, so that a certain essential knowledge of ML is required from the user to obtain robust and unbiased results.We hope that our letter like the Ou article will stimulate critical thinking in the outcome prediction of patients with intracranial aneurysms.We look forward to your reply.Lukas Andereggen, MD