On the Application of Artificial Intelligence/Machine Learning (AI/ML) in Late-Stage Clinical Development.

Abstract

Whereas AI/ML methods were considered experimental tools in clinical development for some time, nowadays they are widely available. However, stakeholders in the health care industry still need to answer the question which role these methods can realistically play and what standards should be adhered to. Clinical research in late-stage clinical development has particular requirements in terms of robustness, transparency and traceability. These standards should also be adhered to when applying AI/ML methods. Currently there is some formal regulatory guidance available, but this is more directed at settings where a device or medical software is investigated. Here we focus on the application of AI/ML methods in late-stage clinical drug development, i.e. in a setting where currently less guidance is available. This is done via first summarizing available regulatory guidance and work done by regulatory statisticians followed by the presentation of an industry application where the influence of extensive sets of baseline characteristics on the treatment effect can be investigated by applying ML-methods in a standardized manner with intuitive graphical displays leveraging explainable AI methods. The paper aims at stimulating discussions on the role such analyses can play in general rather than advocating for a particular AI/ML-method or indication where such methods could be meaningful.