Sort by
Feedback in an Entrustment-Based Objective Structured Clinical Examination: Analysis of Content and Scoring Methods.

Background The integration of entrustable professional activities (EPAs) within objective structured clinical examinations (OSCEs) has yielded a valuable avenue for delivering timely feedback to residents. However, concerns about feedback quality persist. Objective This study aimed to assess the quality and content alignment of verbal feedback provided by examiners during an entrustment-based OSCE. Methods We conducted a progress test OSCE for internal medicine residents in 2022, assessing 7 EPAs. The immediate 2-minute feedback provided by examiners was recorded and analyzed using the Quality of Assessment of Learning (QuAL) score. We also analyzed the degree of alignment with EPA learning objectives: competency milestones and task-specific abilities. In a randomized crossover experiment, we compared the impact of 2 scoring methods used to assess residents' clinical performance (3-point entrustability scales vs task-specific checklists) on feedback quality and alignment. Results Twenty-one examiners provided feedback to 67 residents. The feedback demonstrated high quality (mean QuAL score 4.3 of 5) and significant alignment with the learning objectives of the EPAs. On average, examiners addressed in their feedback 2.5 milestones (61%) and 1.2 task-specific abilities (46%). The scoring methods used had no significant impact on QuAL scores (95% CI -0.3, 0.1, P=.28), alignment with competency milestones (95% CI -0.4, 0.1, P=.13), or alignment with task-specific abilities (95% CI -0.3, 0.1, P=.29). Conclusions In our entrustment-based OSCE, examiners consistently offered valuable feedback aligned with intended learning outcomes. Notably, we explored high-quality feedback and alignment as separate dimensions, finding no significant impact from our 2 scoring methods on either aspect.

Relevant
Chronicling the Transition to Competency-Based Medical Education in a Small Subspeciality Program.

Background As medical education programs transition to competency-based medical education (CBME), experiences transitioning in the context of small subspecialty programs remain unknown, yet they are needed for effective implementation and continual improvements. Objective To examine faculty and resident experiences transitioning to CBME in a small subspeciality program. Methods Using a qualitative descriptive approach and constructivist lens, faculty and residents in McMaster University's geriatric psychiatry subspecialty program were interviewed about their transition experiences between November 2021 and February 2022, after the program's soft launch of CBME in 2020. Interviews were transcribed and data were analyzed using thematic analysis. Reflexive memo writing and investigator and data triangulation strategies were employed to ensure rigor and trustworthiness of the data. Results Ten of the 17 faculty members (59%) and 3 residents (100%) participated. Six themes were developed: (1) Both faculty and residents see themselves as somewhat knowledgeable about CBME, but sources of knowledge vary; (2) More frequent feedback is beneficial; (3) Aspects of CBME that are challenging for residents are beneficial for faculty; (4) Competence committees are perceived positively despite most participants' limited firsthand experience with them; (5) Small program size is both a barrier and facilitator to providing and receiving feedback; and (6) Suggestions for improvement are centered on helping manage faculty and resident workload imposed by CBME. Conclusions Incongruent expectations surrounding entrustable professional activity management were highlighted as an area requiring support. Collegial relationships among faculty and residents made it difficult for faculty to provide constructive feedback but improved residents' perceptions of the feedback.

Relevant
Implementation of a "Best Self" Exercise to Decrease Imposter Phenomenon in Residents.

Background Imposter phenomenon (IP) is common in medicine. An intervention from the business world, the Reflected Best Self Exercise (RBSE), in which an individual elicits stories of themselves at their best, has not been studied in medical residents. Objective To determine the feasibility of implementing the RBSE and its potential for reducing IP in residents. Methods All incoming internal medicine and medicine-pediatrics interns in the 2022-2023 academic year at a single institution were invited to complete the RBSE. Participants elicited stories from contacts prior to beginning residency and received their stories during intern orientation in a 1-hour session led by one author with no prior training. Cost and time requirements were assessed. IP was measured via the Clance Impostor Phenomenon Scale (CIPS) at baseline, 1 month, and 6 months following the RBSE. Informal feedback on the RBSE was collected via surveys at 1 month and 6 months. Results Nineteen of 35 interns (54.3%) completed the RBSE. It cost $75 per participant, for a total cost of $1,425. Twenty-eight of 35 (80%) completed the baseline CIPS, with scores similar between participants and nonparticipants (64.9 vs 68.9). CIPS scores were lower in participants at 1 month (57.6 vs 69.6) and 6 months (55.6 vs 64.5) but did not meet statistical significance. Survey feedback from participants suggested the intervention was beneficial. Conclusions Implementing the RBSE in residents was feasible with reasonable cost and time commitment. It appeared highly acceptable to residents, with some promise of effects on an IP scale.

Relevant
Resident-as-Teacher: Can It Be Done With an E-Learning Module?

Background Resident-as-teacher initiatives are traditionally specialty-specific and performed in-person, limiting ability to disseminate essential teaching skills to all residents. Objective The aim of this study was to develop, implement, and evaluate a resident-as-teacher interactive e-learning module on growth mindset and coaching. Methods The module was designed and implemented between August 2022 and March 2023. It was distributed to postgraduate year (PGY) 1 residents in all specialties at a large academic institution. Completion rates, Likert ratings, and answers to 2 open-ended questions were used for assessment. Descriptive statistics and 1-way analysis of variance with Sîdák correction for multiple comparisons were performed on Likert ratings. Responses to open-ended questions were evaluated using content analysis. Results The module was completed by all 277 PGY-1 residents (100%), with the evaluation completed by 276 of 277 (99.6%) residents. Mean rating of the module's relevance to the role of resident teacher was 4.06±0.90 (5-point Likert scale), with general surgery residents rating the module less favorably compared to all specialties (3.28±1.06; P<.01; 95% CI 0.26-1.30). Open-ended comments revealed that residents most liked the delivery of relevant teaching strategies and the interactive design of the module. The most common area for suggested improvement was the addition of content such as teaching in challenging situations. Time needed for design, implementation, and evaluation was 80 hours total. Conclusions An e-learning module offers an interactive platform for teaching skills and was found to be an acceptable method of instruction for residents.

Relevant