Introduction: Starting from 2023, Australian medical practitioners must meet new mandatory continuing professional development (CPD) requirements for registration renewal. In particular, each year they must complete 12.5 hours of educational activities and 25 hours of CPD activities related to reviewing performance and measuring outcomes, with a minimum of 5 hours each for reviewing performance and measuring outcomes activities, and they are encouraged to use patient health data and large eHealth datasets for better insights. Despite concerns regarding data accessibility and outcome measurement, specialist medical colleges are implementing these requirements. This study aims to explore factors influencing colleges’ efforts and provide recommendations for future research and action to enable data-driven CPD practices. Methods: A policy implementation gap analysis employing semi-structured interviews as a standalone method was conducted with participating colleges. Four colleges agreed to participate, with a total of 18 participants recruited from either the colleges’ staff who are responsible for interpreting and implementing CPD regulatory policies or the colleges’ CPD committees. Interviews were analysed using inductive and deductive thematic analysis. Data collection, data analysis and final results were reported using the COREQ checklist. Results: Three themes were identified from the interview analysis: (1) colleges' organisational structure and their roles and responsibilities within the Australasian CPD ecosystem, (2) challenges and enablers for policy implementation and (3) organisational needs and future actions at college level and necessary pre-conditions at ecosystemic level for strengthened CPD. Conclusions: Internal and external organisational factors are hindering colleges’ efforts to implement policy. More research, a reassessment of colleges’ roles, responsibilities and structure, and collaboration among colleges and data holders are necessary to enable full policy implementation and strengthened CPD practices.