A Mixed Methods Study to Explore Relevant Metrics for a Results Framework Measuring the Public Health Impact of Reliance-Based Pathways

Abstract

Reliance-based pathways for the marketing authorization of medical products have been identified as valuable regulatory tools for the timely provision of effective, safe, quality medicines for people worldwide; however, little research has been conducted on the best way to measure the public health impact of using reliance-based pathways. The current mixed methods study was designed to explore which characteristics or “metrics” could be used to measure the impact of reliance-based pathways. A quantitative survey (n = 70) and in-depth interviews (IDIs) (n = 10) were employed to query various stakeholders (e.g., industry, regulatory authorities, NGOs) about the metrics they believed would be important to include in a framework designed to measure the impact of reliance-based regulatory pathways on advancing public health. Based on survey results, (1) ability to meet targeted product assessment timeline, (2) increased access to expertise, which is limited or not available in the agency, (3) shortened median number of days (annually) to market for medical products, (4) lower morbidity and mortality rates due to greater access to medical products, and (5) movement toward technical standards harmonization were the Top Five most important metrics to be included in a framework. IDI results suggest that, while important, the relevance of the Top Five metrics may vary by region or regulatory authority. Interviewed stakeholders intuitively believe reliance-based regulatory pathways are a worthwhile endeavor; however, there must be “harmonization” within the reliance ecosystem that creates a strong understanding of the factors necessary for reliance-based pathways to be utilized in a successful manner.