Visual predictive check of longitudinal models and dropout.

Abstract

Visual predictive checks (VPC) are commonly used to evaluate pharmacometrics models. However their performance may be hampered if patients with worse outcomes drop out earlier, as often occurs in clinical trials, especially in oncology. While methods accounting for dropouts have appeared in literature, they vary in assumptions, flexibility, and performance, and the differences between them are not widely understood. This manuscript aims to elucidate which methods can be used to handle VPC with dropout and when, along with a more informative VPC approach using confidence intervals. Additionally, we propose constructing the confidence interval based on the observed data instead of the simulated data. The theoretical framework for incorporating dropout in VPCs is developed and applied to propose two approaches: full and conditional. The full approach is implemented using a parametric time-to-event model, while the conditional approach is implemented using both parametric and Cox proportional-hazard (CPH) models. The practical performances of these approaches are illustrated with an application to the tumor growth dynamics (TGD) modeling of data from two cancer clinical trials of nivolumab and docetaxel, where patients were followed until disease progression. The dataset consisted of 3504 tumor size measurements from 855 subjects, which were described by a TGD model. The dropout of subjects was described by a Weibull or CPH model. Simulated datasets were also used to further illustrate the properties of the VPC methods. The results showed that the more familiar full approach might not provide meaningful improvement for TGD model evaluation over the naive approach of not adjusting for dropout, and could be outperformed by the conditional approach using either the Weibull model or the Cox proportional hazard model. Overall, including confidence intervals in VPC should improve interpretation, the conditional approach was shown to be more generally applicable when dropout occurs, and the nonparametric approach could provide additional robustness.