Independent External Validation and Comparison of Death and Kidney Replacement Therapy Prediction Models in Advanced CKD

Abstract

Rationale & ObjectiveThe Kidney Failure Risk Equation (KFRE) is widely used to predict the risk of kidney replacement therapy (KRT) initiation in chronic kidney disease (CKD) stages G3-G5. The new Grams calculator developed for advanced CKD (stage G4+) predicts KRT initiation, cardiovascular events, and death by uniquely incorporating the competing risk of death. We aimed to validate this tool in a stage G4+ cohort for death and KRT.Study DesignRetrospective cohort study.Setting & Participants442 patients with CKD stage G4+ (mean ± SD age, 73 ± 12 years; mean ± SD estimated glomerular filtration rate, 20 ± 6.2 mL/min/1.73 m2) who visited the multidisciplinary CKD clinic at Kingston Health Sciences Center in Ontario, Canada.Outcomes & Analytical ApproachDiscrimination and calibration were examined for the outcome of death using the 2- and 4-year Grams scores. The 2- and 5-year KFRE and 2- and 4-year Grams scores were compared in terms of discrimination and calibration for KRT.ResultsThere were 91, 161, and 206 death events and 90, 145, and 159 KRT events in our cohort at 2, 4, and 5 years, respectively. The Grams model demonstrated modest discrimination for death at 4 years (area under the curve [AUC] 0.70; 95% CI, 0.65-0.75) and performed worse at 2 years (AUC, 0.63; 95% CI, 0.57-0.70). It only overpredicted death by approximately 10% across most of the predicted range. Both models had similar discrimination for KRT at 2 years (KFRE AUC, 0.83; 95% CI, 0.78-0.88 and Grams AUC, 0.8; 95% CI, 0.76-0.87), 4 years (Grams AUC, 0.82; 95% CI, 0.77-0.86), and 5 years (KFRE AUC, 0.81; 95% CI, 0.76-0.85). There was excellent calibration for KRT using the 2-year KFRE and Grams values for predicted risk thresholds of ≤15% and using the 5-year KFRE and 4-year Grams values for predicted risk thresholds of ≤20%. At higher risk ranges, KFRE overpredicts and Grams underpredicts the KRT risk.LimitationsThis is a single-center study with a primarily White cohort limited by smaller sample sizes at the higher ranges of the predicted risks, particularly for the Grams calculator.ConclusionsThe Grams model provides moderately accurate death predictions, and consideration should be given to its incorporation into patient education and advanced care planning. Both the Grams and KFRE models remain clinically useful for determining KRT risks in advanced CKD.