External validation of a deep-learning model to predict severe acute kidney injury based on urine output changes in critically ill patients

Abstract

ObjectivesThe purpose of this study was to externally validate algorithms (previously developed and trained in two United States populations) aimed at early detection of severe oliguric AKI (stage 2/3 KDIGO) in intensive care units patients.MethodsThe independent cohort was composed of 10'596 patients from the university hospital ICU of Amsterdam (the “AmsterdamUMC database”) admitted to their intensive care units. In this cohort, we analysed the accuracy of algorithms based on logistic regression and deep learning methods. The accuracy of investigated algorithms had previously been tested with electronic intensive care unit (eICU) and MIMIC-III patients.ResultsThe deep learning model had an area under the ROC curve (AUC) of 0,907 (± 0,007SE) with a sensitivity and specificity of 80% and 89%, respectively, for identifying oliguric AKI episodes. Logistic regression models had an AUC of 0,877 (± 0,005SE) with a sensitivity and specificity of 80% and 81%, respectively. These results were comparable to those obtained in the two US populations upon which the algorithms were previously developed and trained.ConclusionExternal validation on the European sample confirmed the accuracy of the algorithms, previously investigated in the US population. The models show high accuracy in both the European and the American databases even though the two cohorts differ in a range of demographic and clinical characteristics, further underlining the validity and the generalizability of the two analytical approaches.Graphical abstract