Development and validation of a machine learning model for prediction of comorbid major depression disorder among narcolepsy type 1

Abstract

BackgroundMajor depression disorder (MDD) forms a common psychiatric comorbidity among patients with narcolepsy type 1 (NT1), yet its impact on patients with NT1 is often overlooked by neurologists. Currently, there is a lack of effective methods for accurately predicting MDD in patients with NT1. ObjectiveThis study utilized machine learning (ML) algorithms to identify critical variables and developed the prediction model for predicting MDD in patients with NT1. MethodsThe study included 267 NT1 patients from four sleep centers. The diagnosis of comorbid MDD was based on Diagnostic and Statistical Manual of Mental Disorders fifth edition (DSM-5). ML models, including six full models and six compact models, were developed using a training set. The performance of these models was compared in the testing set, and the optimal model was evaluated in the testing set. Various evaluation metrics, such as Area under the receiver operating curve (AUC), precision-recall (PR) curve and calibration curve were employed to assess and compare the performance of the ML models. Model interpretability was demonstrated using SHAP. ResultIn the testing set, the logistic regression (LG) model demonstrated superior performance compared to other ML models based on evaluation metrics such as AUC, PR curve, and calibration curve. The top eight features used in the LG model, ranked by feature importance, included social impact scale (SIS) score, narcolepsy severity scale (NSS) score, total sleep time, body mass index (BMI), education years, age of onset, sleep efficiency, sleep latency. ConclusionThe study yielded a straightforward and practical ML model for the early identification of MDD in patients with NT1. A web-based tool for clinical applications was developed, which deserves further verification in diverse clinical settings.