Temporal validation and updating of a prediction model for the diagnosis of gestational diabetes mellitus

Abstract

ObjectiveThe original Monash gestational diabetes mellitus (GDM) risk prediction in early pregnancy model is internationally externally validated and clinically implemented. We temporally validate and update this model in a contemporary population with a universal screening context and revised diagnostic criteria and ethnicity categories, thereby improving model performance and generalizability. Study Design and SettingThe updating dataset comprised of routinely collected health data for singleton pregnancies delivered in Melbourne, Australia from 2016 to 2018. Model predictors included age, body mass index, ethnicity, diabetes family history, GDM history, and poor obstetric outcome history. Model updating methods were recalibration-in-the-large (Model A), intercept and slope re-estimation (Model B), and coefficient revision using logistic regression (Model C1, original ethnicity categories; Model C2, revised ethnicity categories). Analysis included 10-fold cross-validation, assessment of performance measures (c-statistic, calibration-in-the-large, calibration slope, and expected-observed ratio), and a closed-loop testing procedure to compare models’ log-likelihood and akaike information criterion scores. ResultsIn 26,474 singleton pregnancies (4,756, 18% with GDM), the original model demonstrated reasonable temporal validation (c-statistic = 0.698) but suboptimal calibration (expected-observed ratio = 0.485). Updated model C2 was preferred, with a high c-statistic (0.732) and significantly better performance in closed testing. ConclusionWe demonstrated updating methods to sustain predictive performance in a contemporary population, highlighting the value and versatility of prediction models for guiding risk-stratified GDM care.