A Qualitative Analysis of Assessment and Evaluation Practices Within the Individualized Curriculum.

Abstract

The Accreditation Council of Graduate Medical Education requires an "individualized curriculum" (IC) in pediatric residency. A shared understanding across programs of methods to evaluate the IC is lacking. We explored pediatric program leaders' perceptions of assessment and evaluation within the IC to further understand and inform most useful practices. We conducted a phenomenology study using semi-structured interviews to 1) determine what IC assessment and evaluation strategies are utilized in pediatric residency programs, and 2) explore program leaders' perceptions of the feasibility and value of assessment and evaluation in the IC. We recruited a purposive sample of leaders from 15 pediatric residency programs of various sizes and regions. Interviews were recorded and transcribed. Data were analyzed to produce themes. Three themes arose from our analysis: 1) Systematic assessment of the IC, though desired, is not robust in pediatric residency training; 2) Program differences present unique barriers and facilitators that impact the feasibility of assessment within the IC; and 3) Meaningfulness of assessment in the IC varies by stakeholder. Themes reflected perspectives on individual learner assessment and program evaluation. While systematic assessment and evaluation of the IC in pediatric residency training is lacking, program leaders desire feasible strategies that are meaningful to the resident, the program, and its leadership team. Leveraging current assessment and evaluation tools and aligning new assessment strategies could promote the integration of IC assessment with other assessments, minimizing burden. More structured IC assessment and evaluation could inform how to best achieve curricular goals of the IC.