In-Training Examination Scores Research Articles

Factors associated with infectious diseases fellowship academic success

ABSTRACT Background A multitude of factors are considered in an infectious disease (ID) training program’s meticulous selection process of ID fellows but their correlation to pre and in-fellowship academic success as well as post-fellowship academic success and short-term outcomes is poorly understood. Our goal was to investigate factors associated with subsequent academic success in fellowship as well as post-fellowship short-term outcomes. Methods In 2022, we retrospectively analyzed deidentified academic records from 39 graduates of the Mayo Clinic Rochester ID Fellowship Program (1 July 2013- 30 June 2022). Data abstracted included demographics, degrees, honor society membership, visa/citizenship status, medical school, residency training program, United States Medical Licensure Exam (USMLE) scores, letters of recommendation, in-training examination (ITE) scores, fellowship track, academic rank, career choice, number of honors, awards, and abstracts/publications prior to fellowship, during training, and within 2 years of graduation. Results Younger fellows had higher USMLE step 1 scores, pre and in-fellowship scholarly productivity, and higher ITE performance. Female fellows had significantly higher USMLE step 3 scores. Prior research experience translated to greater in-fellowship scholarly productivity. Higher USMLE scores were associated with higher ID ITE performance during multiple years of fellowship, but USMLE step 2 clinical knowledge and 3 scores were associated with higher pre and in-fellowship scholarly productivity and receiving an award during fellowship. The USMLE step 1 score did not correlate with fellowship performance beyond year 1 and 2 ITE scores. Conclusions Multiple aspects of a prospective fellow’s application must be considered as part of a holistic review process for fellowship selection. USMLE step 2 CK and 3 scores may predict fellowship performance across multiple domains.

Flipping the Classroom in Residency Didactics Leads to Higher American Board of Surgery in-Training Examination Scores

Didactic education in General Surgery (GS) residency typically follows a nationally standardized curriculum; however, instructional format varies by institution. In recent years, GS residents at our institution expressed discontentment with weekly didactics and were not meeting their goals on the American Board of Surgery In-Training Examination (ABSITE). We sought to develop improvements in our didactic curriculum to increase resident satisfaction and ABSITE scores of GS junior residents (Jrs). In a quality improvement project, we changed the weekly didactic curriculum format from hour-long lectures in the 2018 to 2019 academic year (AY) to a partially-flipped classroom in the 2019 to 2020 AY, involving a 30-minute faculty-led presentation followed by 30 minutes of resident-led practice questions. The outcomes measured were ABSITE scores taken in 2019 and 2020 and resident opinions via an anonymous survey. This study was conducted at the University of Minnesota (Minneapolis, MN). The cohort for this study included all GS Jrs in our GS residency program, including postgraduate year (PGY) 1 nondesignated preliminary, PGY1 to 3 categorical GS residents, and residents in their lab time. Senior residents attended a separate didactics session. After curriculum changes, the ABSITE percentile scores for GS Jrs rose from 52% ± 5% to 66% ± 4% (p = 0.03). No categorical GS Jr scored <30% in 2020, compared to 20% (6/30) of categorical General Surgery residents in 2019. All residents preferred the new format overall and reported greater engagement in and preparation for didactics. After changing didactic education from hour-long lectures in the 2018 to 2019 AY to a flipped classroom model in the 2019 to 2020 AY including 30 minutes of faculty-led lecture followed by 30 minutes of resident-led practice questions, ABSITE scores and resident satisfaction at the University of Minnesota General Surgery Program improved.

Early Emergency Medicine Milestone Assessment for Predicting First-Year Resident Performance.

The Accreditation Council for Graduate Medical Education (ACGME) requires emergency medicine (EM) residency training programs to monitor residents' progress using standardized milestones. The first assessment of PGY 1 resident milestones occurs midway through the first year and could miss initial deficiencies. Early assessment of PGY 1 EM resident milestones has potential to identify at-risk residents prior to standard midyear evaluations. We developed an orientation syllabus for PGY 1 residents followed by a milestone assessment. Assessment scores helped predict future milestone scores and American Board of Emergency Medicine (ABEM) In-Training Examination (ITE) scores for PGY 1 residents. From 2013 to 2020, we developed and implemented Milestone Evaluation Day (MED), a simulation-based day and written exam assessing PGY 1 EM residents during their first month on the 23 ACGME 1.0 milestones. MED stations included a history and physical with verbal presentation, patient simulation, vascular access, wound management, and airway management. MED, Clinical Competency Committee-generated (CCC-generated) milestone, and ABEM ITE scores were averaged and compared utilizing Pearson's correlation coefficient. Of 112 PGY 1 EM residents, 110 (98%) were analyzed over an 8-year period. We observed a moderate positive correlation of MED and CCC-generated milestone scores (r = .34, p < .001). There was a nonstatistically significant weak positive correlation of MED and ABEM ITE scores (r = .13, p = .17). An early assessment of EM milestones in the PGY 1 year can assist in the prediction of CCC-generated milestone scores for PGY 1 residents.

Use of In-Training Examination Scores as a Fellowship Candidate Evaluation Metric: Time for a Change.

In the field of obstetrics and gynecology (OB/GYN), the Council on Resident Education in Obstetrics and Gynecology (CREOG) administers an annual in-training examination to all OB/GYN residents as a formative educational tool for assessing medical knowledge and promoting self-improvement. Although the CREOG examination is not designed or intended for knowledge certification, many OB/GYN subspecialty fellowship programs request and use CREOG examination scores as a metric to evaluate fellowship candidates. Among the 57 gynecology-based urogynecology fellowship programs, 30 programs (53%) request CREOG examination scores to be submitted by candidates, as of March 2023. Although the use of CREOG examination scores as an evaluation metric may constitute a minor component within the fellowship match process, this practice fundamentally contradicts the intended purpose of the examination as an educational self-assessment. In addition, it introduces the potential for bias in fellowship recruitment, lacks psychometric validity in predicting specialty board examination failure, and shifts the CREOG examination from its original intention as low-stakes self-assessment into a high-stakes examination akin to a certification examination. For these reasons, we call upon the urogynecology community to prioritize the educational mission of the CREOG examination and reconsider the practice of requesting or using CREOG examination scores in the fellowship match progress.

COVID-19 Impact on Family Medicine Residents Exam Performance.

The COVID-19 pandemic began interrupting family medicine residency training in spring 2020. While a decline in scores on the American Board of Family Medicine In-Training Examination (ITE) has been observed, whether this decline has translated into the high-stakes Family Medicine Certification Examination (FMCE) is unclear. The goal of this study was to systematically assess the magnitude of COVID-19 impact on medical knowledge acquisition during residency, as measured by the ITE and FMCE. A total of 19,101 initial certification candidates from 2017 to 2022 were included in this study. Annual ITE scores and FMCE scores were reported on the same scale (200-800) and served as the outcome measure. We conducted multilevel regression analysis to determine ITE score growth and FMCE scores compared to cohorts prior to COVID-19. During COVID-19, the increase in ITE scores from postgraduate year 2 (PGY-2) to PGY-3 was 25.5 points less, representing a 57.6% relative decrease; and from PGY-3 ITE to FMCE, it was 8.6 points less, a 12.7% relative decrease, compared with cohorts prior to COVID-19. FMCE scores were 6.6 points less during COVID-19, representing a 1.2% relative decline from the average FMCE score prior to COVID-19. This study found nonsubstantive COVID-19 impact on FMCE scores, but a considerable knowledge acquisition decline during residency, especially during the PGY-2 to PGY-3 period. While COVID-19 impacted learning, our findings indicated that residencies were largely able to remediate knowledge deficits before residents took the FMCE.

Resident Burnout, Wellness, Professional Development, and Engagement Before and After New Training Schedule Implementation

Burnout is a work-related syndrome of depersonalization (DP), emotional exhaustion (EE), and low personal achievement (PA) that is prevalent among internal medicine resident trainees. Prior interventions have had modest effects on resident burnout. The association of a new 4 + 4 block schedule (4 inpatient weeks plus 4 outpatient weeks) with resident burnout has not previously been evaluated. To evaluate the association of a 4 + 4 block schedule, compared with a 4 + 1 schedule, with burnout, wellness, and self-reported professional engagement and clinical preparedness among resident physicians. This nonrandomized preintervention and postintervention survey study was conducted in a single academic-based internal medicine residency program from June 2019 to June 2021. The study included residents in the categorical, hospitalist, and primary care tracks in postgraduate years 1 and 2 (PGY1 and PGY2). Data analysis was conducted from October to December 2022. In the 4 + 4 structure, resident schedules alternated between 4-week inpatient call-based rotations and 4-week ambulatory non-call-based rotations. The primary outcome was burnout, assessed using the Maslach Burnout Inventory subcategories of EE (range, 0-54), DP (range, 0-30), and PA (range, 0-48), adjusted for sex and PGY. Secondary outcomes included In-Training Examination (ITE) scores and a questionnaire on professional, educational, and health outcomes. Multivariable logistic regression was used to assess the primary outcome, 1-way analysis of variance was used to compare ITE percentiles, and a Bonferroni-adjusted Kruskal Wallis test was used for the remaining secondary outcomes. The findings were reexamined with several sensitivity analyses, and Cohen's D was used to estimate standardized mean differences (SMDs). Of the 313 eligible residents, 216 completed the surveys. A total of 107 respondents (49.5%) were women and 109 (50.5%) were men; 119 (55.1%) were PGY1 residents. The survey response rates were 78.0% (85 of 109) in the preintervention cohort and 60.6% (63 of 104) and 68.0% (68 of 100) in the 2 postintervention cohorts. The PGY1 residents had higher response rates than the PGY2 residents (119 of 152 [78.2%] vs 97 of 161 [60.2%]; P < .001). Adjusted EE scores (mean difference [MD], -6.78 [95% CI, -9.24 to -4.32]) and adjusted DP scores (MD, -3.81 [95% CI, -5.29 to -2.34]) were lower in the combined postintervention cohort. The change in PA scores was not statistically significant (MD, 1.4 [95% CI, -0.49 to 3.29]). Of the 15 items exploring professional, educational, and health outcomes, a large positive association was observed for 11 items (SMDs >1.0). No statistically significant change in ITE percentile ranks was noted. In this survey study of internal medicine resident physicians, a positive association was observed between a 4 + 4 block training schedule and internal medicine resident burnout scores and improved self-reported professional, educational, and health outcomes. These results suggest that specific 4 + 4 block combinations may better improve resident burnout than a 4 + 1 combination used previously.

Musculoskeletal Knowledge on the in-Training Examination Improves in Family Medicine Residents Participating in a Longitudinal Sports Medicine Clinical Track.

The study aims to assess the impacts of a sports medicine (SM) track on musculoskeletal (MSK) knowledge of family medicine (FM) residents. In-training examination (ITE) results were used to compare the MSK knowledge of FM residents with and without SM track participation. A single-center, retrospective study was completed on 85 FM residents from the 2018 to 2024 graduating classes who completed the ITE from 2017 to 2021. Residents were categorized by participation in the SM track, where half a day of FM continuity clinic per week is replaced with an SM clinic, supervised by a fellowship-trained SM physician. ITE scores throughout training were compared between the 2 groups using mixed-effects regression. The ITE MSK scores increased among both SM track participants (+77 points/year, p = .001) and nonparticipants (+39 points/year, p = .001) throughout their training. By postgraduate year 3, SM track participants performed significantly better on the MSK portion of the ITE (+87 points compared to non-participants, p = .045). No significant difference in total ITE scores was seen between groups. Our data demonstrates that participation in an SM track is associated with an increase in MSK knowledge of ITE, suggesting that an SM track may provide FM residents with a better understanding of MSK conditions.

Association between regional quota program in medical schools and practical clinical competency based on General Medicine In-Training Examination score: a nationwide cross-sectional study of resident physicians in Japan.

A regional quota program (RQP) was introduced in Japan to ameliorate the urban-rural imbalance of physicians. Despite concerns about the low learning abilities of RQP graduates, the relationship between the RQP and practical clinical competency after initiating clinical residency has not been evaluated. We conducted a nationwide cross-sectional study to assess the association between the RQP and practical clinical competency based on General Medicine In-Training Examination (GM-ITE) scores. We compared the overall and category GM-ITE results between RQP graduates and other resident physicians. The relationship between the RQP and scores was examined using multilevel linear regression analysis. There were 4978 other resident physicians and 1119 RQP graduates out of 6097 participants from 593 training hospitals. Being younger; preferring internal, general, or emergency medicine; managing fewer inpatients; and having fewer ER shifts were all characteristics of RQP graduates. In multilevel multivariable linear regression analysis, there was no significant association between RQP graduates and total GM-ITE scores (coefficient: 0.26; 95% confidence interval: -0.09, 0.61; P = .15). The associations of RQP graduates with GM-ITE scores in each category and specialty were not clinically relevant. However, in the same multivariable model, the analysis did reveal that total GM-ITE scores demonstrated strong positive associations with younger age and GM preference, both of which were significantly common in RQP graduates. Practical clinical competency evaluated based on the GM-ITE score showed no clinically relevant differences between RQP graduates and other resident physicians. Key messages What is already known on this topic Many countries offer unique admission processes to medical schools and special undergraduate programs to increase the supply of physicians in rural areas. Concerns have been raised about the motivation, learning capabilities, and academic performance of the program graduates. What this study adds This nationwide cross-sectional study in Japan revealed clinical competency based on the scores from the General Medicine In-Training Examination showed no clinically relevant differences between graduates of regional quota programs and other resident physicians. How this study might affect research, practice, or policy The study provides evidence to support the Japanese regional quota program from the perspective of clinical competency after initiating clinical practice.

Critical care medicine training in the age of COVID-19.

The COVID-19 pandemic caused the largest disruption to graduate medical education in modern history. The danger associated with SARS-CoV-2 necessitated a paradigm shift regarding the fundamental approach to the education of medical residents and fellows. Whereas prior work has examined the effect of the pandemic on residents' experiences during training, the effect of the pandemic on academic performance of critical care medicine (CCM) fellows is not well understood. This study examined the relationship between CCM fellow's lived experiences during the COVID-19 pandemic and performance on in-training examinations. This mixed-methods study consisted of a quantitative retrospective analysis of critical care fellows' in-training examination scores and a qualitative, interview-based phenomenological examination of fellows' experiences during the pandemic while training in a single large academic hospital in the American Midwest. Quantitative: Prepandemic (2019 and 2020) and intrapandemic (2021 and 2022) in-training examination scores were analyzed utilizing an independent samples t test to determine whether a significant change occurred during the pandemic. Qualitative: Individual semi-structured interviews were conducted with CCM fellows exploring their lived experiences during the pandemic and their perception of the effect on their academic performance. Transcribed interviews were analyzed for thematic patterns. These themes were coded and categorized, and subcategories were developed as indicated during the analysis. The identified codes were then analyzed for thematic connections and apparent patterns. Relationships between themes and categories were analyzed. This process was continued until a coherent picture could be assembled from the data to answer the research questions. Analysis was performed from a phenomenological perspective with an emphasis on interpretation of the data from the participants' perspectives. Quantitative: Fifty-one in-training examination scores from 2019 to 2022 were obtained for analysis. Scores from 2019 to 2020 were grouped as prepandemic scores, while scores from 2021 to 2022 were grouped as intrapandemic scores. Twenty-four prepandemic and 27 intrapandemic scores were included in the final analysis. A significant difference was found between mean total prepandemic and intrapandemic in-service examination scores (t 49=2.64, p=0.01), with mean intrapandemic scores being 4.5 points lower than prepandemic scores (95 % CI, 1.08-7.92). Qualitative: Interviews were conducted with eight CCM fellows. Thematic analysis of the qualitative interviews revealed three main themes: psychosocial/emotional effects, effects on training, and effects on health. The factors that most effected participants' perceptions of their training were burnout, isolation, increased workload, decreased bedside teaching, decreased formal academic training opportunities, decreased procedural experience, a lack of an external reference point for normal training in CCM, fear of spreading COVID-19, and neglect of personal health during the pandemic. In-training examination scores decreased significantly during the COVID-19 pandemic for CCM fellows in this study. The fellows in this study reported perceived effects of the pandemic on their psychosocial/emotional well-being, medical training, and health.

Comparison of performance data between emergency medicine 1-3 and 1-4 program formats.

This study compares performance data from physicians completing 3-year versus 4-year emergency medicine residency training programs. Currently, there are 2 training formats and little is known about objective performance differences. This was a retrospective cross-sectional analysis of emergency residents and physicians. Multiple analyses were conducted comparing physicians' performances, including Accreditation Council of Graduate Medical Education Milestones and American Board of Emergency Medicine In-training Examination (ITE), Qualifying Examination (QE), Oral Certification Examination (OCE), and program extensions from 3-year and 4-year residency programs. Some confounding variables were not or could not be considered, such as rationale for medical students to choose one format over another, as well as application and final match rates. Milestone scores are higher for emergency medicine 3 residents in 1-3 programs (3.51) versus emergency medicine 3 residents in 1-4 programs (3.07; P<0.001, d=1.47) and highest for emergency medicine 4 residents (3.67). There was no significant difference in program extension rates (emergency medicine 1-3, 8.1%; emergency medicine 1-4, 9.6%; P=0.05, ω=0.02). ITE scores were higher for emergency medicine 1, 2, and 3 residents from 1-3 programs and emergency medicine 4 residents from 1-4 programs scored highest. Mean QE score was slightly higher for emergency 1-3 physicians (83.55 vs 83.00; P<0.01, d=0.10). QE pass rate was higher for emergency 1-3 physicians (93.1% vs 90.8%; P<0.001, ω=0.08). Mean OCE score was slightly higher for emergency 1-4 physicians (5.67 vs 5.65; P=0.03, d=-0.07) but did not reach a priori statistical significance (α<0.01). OCE pass rate was also slightly higher for emergency 1-4 physicians (96.9% vs 95.5%; P=0.06, ω=-0.07) but also non-significant. These results suggest that although performance measures demonstrate small differences between physicians from emergency medicine 1-3 and 1-4 programs, these differences are limited in their ability to make causal claims about performance on the basis of program format alone.

0966 Correlation of Sleep-related Habits and COVID-19 to Pediatric Residents ITE Scores

Abstract Introduction Inadequate sleep negatively affects decision-making. The extent to which it may affect medical residents' performance on the In-Training Examination (ITE) is unclear. Research from Weeks et al., 2021 showed that each hour of sleep a medical resident received prior to the ITE, increased their odds of scoring over 70% on the exam by 25%. A typical resident sleeps six hours a night, which is less than the recommended seven to nine hours a night. Associations between COVID-19 and sleep disorders are more prevalent among healthcare workers. We aim to correlate pediatric ­residents' habits and COVID-19 status with their 2022 ITE scores. Methods A cross-sectional, 10-question, electronic, and anonymous survey was sent to the pediatric residents (N=74) in our program. Fisher’s exact test was used to assess the correlation between ITE score less than 70% and rotation at the time of the exam, COVID-19 status, caffeinated beverages, and exercise. Linear regression model was used to analyze the impact of these variables on ITE scores. All statistical tests were two-sided, and p&amp;lt; 0.05 was considered statistically significant. Our methods were limited by a small sample size and recall bias. Results A total of 37(50%) residents completed the survey and were included in the analysis. Of those residents, 27(73%) sleep 6-7 hours/night, 9(24.3%) use melatonin regularly, and 23(62.2%) drink caffeine daily. Residents diagnosed with COVID-19 before the 2022 ITE scored significantly lower on the ITE. (-12.1, 95% CI[-23.9, -0.27], p=0.045. There was not any significant association between ITE score less than 70% and rotation (p=0.79), caffeinated beverages (p=0.41), and exercise (p=0.99). Conclusion ITE scores of pediatric residents in our program were not significantly influenced by exercise, caffeine consumption, or rotation at the time of the exam. Interestingly, residents who tested positive for COVID-19 before the 2022 ITE displayed significantly lower scores. This finding is in line with a limited number of prior studies pointing to possible long-term cognitive consequences associated with this infection. To better understand this association, we suggest a larger study incorporating sleep hours the night before the exam and COVID status. Support (if any)

Association Between In-Training Exam Scores and Clinical Exposure During the COVID-19 Pandemic

BackgroundWe sought to evaluate changes in In-Training Examination (ITE) scores and associations with clinical work during the COVID-19 pandemic. We hypothesized that residents saw a decrease in clinical encounters during the pandemic and that this would be associated with smaller gains in ITE scores. MethodsWe compared ITE score changes with data on patient notes for three classes of pediatric residents at four residency programs: one not exposed to the pandemic during their intern year who entered residency in 2018, one partially exposed to COVID-19 in March of their intern year (2019–2020), and one that was fully exposed to the pandemic, starting residency in June of 2020. ResultsITE scores on average improved from the PGY1 to PGY2 year in the “no covid” and “partial COVID” cohorts. The “full COVID” cohort had little to no improvement, on average. The total number of patient encounters was not associated with a change in ITE scores from PGY1 to PGY2. There was a small but statistically significant association between change in ITE score and number of inpatient H+P notes. ConclusionsA drop in ITE scores occurred in pediatric residents who entered residency during the COVID-19 pandemic. This change was largely unrelated to clinical encounter number changes.

Emergency Medicine In-Training Examination Scores are Not Associated with Burnout and Not Affected by the Introduction of a Wellness Curriculum

Introduction: There is little research examining the relationship between burnout and medical knowledge. Study Objectives: The authors sought to determine if emergency medicine (EM) resident performance on the In-Training Examination (EM-ITE) is associated with burnout and if EM-ITE scores are affected by the implementation of a wellness curriculum.

The Decline in Family Medicine in-Training Examination Scores: What We Know and Why It Matters

The Decline in Family Medicine in-Training Examination Scores: What We Know and Why It Matters

COVID-19 online medical education and outcomes on Internal Medicine In-Training Examination scores

Background COVID-19 presented a unique opportunity to explore new methods to deliver medical education virtually due to requirements for social distancing. We provided webcams and microphones in each of our core teaching team rooms. We used existing teleconferencing systems with share screen, polling, and audio/video capabilities to continue fostering a group learning environment. Methods The Internal Medicine In-Training Examination (IM-ITE) was used as a surrogate measurement of the effectiveness of virtual medical education, comparing composite scores from 2015 to 2019 (pre-COVID, in-person conference) to 2020 (post-COVID, virtual conference) for each postgraduate class. Results No statistically significant differences between the mean or median scores on the IM-ITE were noted for all three classes. Conclusion Although COVID-19 presented many challenges to residency programs across the United States, our pilot study demonstrated that virtual medical education did not result in lower IM-ITE scores and may be an innovative solution to bridge the education gap during COVID-19.

The Association Between Length of Training and Family Medicine Residents’ Clinical Knowledge: A Report From the Length of Training Pilot Study

The associations between training length and clinical knowledge are unknown. We compared family medicine in-training examination (ITE) scores among residents who trained in 3- versus 4-year programs and to national averages over time. In this prospective case-control study, we compared the ITE scores of 318 consenting residents in 3-year programs to 243 who completed 4 years of training between 2013 through 2019. We obtained scores from the American Board of Family Medicine. The primary analyses involved comparing scores within each academic year according to length of training. We used multivariable linear mixed effects regression models adjusted for covariates. We performed simulation models to predict ITE scores after 4 years of training among residents who underwent only 3 years of training. At baseline postgraduate year-1 (PGY1), the estimated mean ITE scores were 408.5 for 4-year programs and 386.5 for 3-year programs, a 21.9 point difference (95% CI=10.1-33.8). At PGY2 and PGY3, 4-year programs scored 15.0 points higher and 15.6 points higher, respectively. When extrapolating an estimated mean ITE score for 3-year programs, 4-year programs would still score 29.4 points higher (95% CI=15.0-43.8). Our trend analysis revealed those in 4-year programs had a slightly lesser slope increase compared to 3-year programs in the first 2 years. Their drop-off in ITE scores is less steep in later years, though these differences were not statistically significant. While we found significantly higher absolute ITE scores in 4 versus 3-year programs, these increases in PGY2, PGY3 and PGY4 may be due to initial differences in PGY1 scores. Additional research is needed to support a decision to change the length of family medicine training.

Academic Achievement and Competency in Rural and Urban Family Medicine Residents.

The quality of training in rural family medicine (FM) residencies has been questioned. Our objective was to assess differences in academic performance between rural and urban FM residencies. We used American Board of Family Medicine (ABFM) data from 2016-2018 residency graduates. Medical knowledge was measured by the ABFM in-training examination (ITE) and Family Medicine Certification Examination (FMCE). The milestones included 22 items across six core competencies. We measured whether residents met expectations on each milestone at each assessment. Multilevel regression models determined associations between resident and residency characteristics milestones met at graduation, FMCE score, and failure. Our final sample was 11,790 graduates. First-year ITE scores were similar between rural and urban residents. Rural residents passed their initial FMCE at a lower rate than urban residents (96.2% vs 98.9%) with the gap closing upon later attempts (98.8% vs 99.8%). Being in a rural program was not associated with a difference in FMCE score but was associated with higher odds of failure. Interactions between program type and year were not significant, indicating equal growth in knowledge. The proportions of rural vs urban residents who met all milestones and each of six core competencies were similar early in residency but diverged over time with fewer rural residents meeting all expectations. We found small, but persistent differences in measures of academic performance between rural- and urban-trained FM residents. The implications of these findings in judging the quality of rural programs are much less clear and warrant further study, including their impact on rural patient outcomes and community health.

The impact of fellowship-trained medical toxicology faculty on emergency medicine resident in-training examination scores.

The American Board of Emergency Medicine (ABEM) In Training Exam (ITE) gauges residents' medical knowledge and has been shown to correlate with subsequent performance on the ABEM board qualifying examination. It is common for emergency medicine (EM) residencies to employ subspecialty-trained faculty members with the expectation of improved resident education and subspecialty knowledge. We hypothesized that the presence of subspecialty faculty in toxicology would increase residents' scores on the toxicology portion of the ITE. We assessed ABEM ITE scores at our institution from 2013-2022 and compared these to national data. The exposure of interest was the absence or presence of fellowship-trained toxicology faculty. The primary outcome was performance on the toxicology portion of the ITE, and secondary outcome was overall performance on the exam. Residents who had ≥1 toxicology faculty were 37% (95% CI: 1.01-1.87) more likely to surpass the national average for toxicology scores, and those who had ≥2 toxicology faculty were 77% (95% CI: 1.28-2.44) more likely to surpass the national average for toxicology scores on the ABEM ITE. With the presence of ≥2 toxicology faculty, there was also an increase in toxicology score by years in training, with residents being 63% (95% CI: 1.01-2.64), 68% (95% CI: 1.08-2.61), and 92% (95% CI: 1.01-3.63) more likely to surpass the national average for toxicology score in first, second, and third years of residency, respectively. There was no significant relationship between the presence of toxicology faculty and the overall ABEM ITE scores. The presence of fellowship-trained toxicology faculty positively impacted residents' performance on the toxicology portion of the ABEM ITE but did not significantly impact the overall score. With the presence of ≥2 toxicology faculty we noted an improvement in toxicology scores throughout the 3 years of training, indicating that an individual rotation or educational block is probably less important than spaced repetition through a longitudinal curriculum.

The Association Between USMLE Step 2 Clinical Knowledge Scores and Residency Performance: A Systematic Review and Meta-Analysis.

With the change in Step 1 score reporting, Step 2 Clinical Knowledge (CK) may become a pivotal factor in resident selection. This systematic review and meta-analysis seeks to synthesize existing observational studies that assess the relationship between Step 2 CK scores and measures of resident performance. The authors searched MEDLINE, Web of Science, and Scopus databases using terms related to Step 2 CK in 2021. Two researchers identified studies investigating the association between Step 2 CK and measures of resident performance and included studies if they contained a bivariate analysis examining Step 2 CK scores' association with an outcome of interest: in-training examination (ITE) scores, board certification examination (BCE) scores, select Accreditation Council for Graduate Medical Education (ACGME) core competency assessments, overall resident performance evaluations, or other subjective measures of performance. For outcomes that were investigated by 3 or more studies, pooled effect sizes were estimated with random-effects models. Among 1,355 potential studies, 68 met inclusion criteria and 43 were able to be pooled. There was a moderate positive correlation between Step 2 CK and ITE scores (0.52, 95% CI 0.45-0.59, P < .01). There was a moderate positive correlation between Step 2 CK and ITE scores for both nonsurgical (0.59, 95% CI 0.51-0.66, P < .01) and surgical specialties (0.41, 95% CI 0.33-0.48, P < .01). There was a very weak positive correlation between Step 2 CK scores and subjective measures of resident performance (0.19, 95% CI 0.13-0.25, P < .01). This study found Step 2 CK scores have a statistically significant moderate positive association with future examination scores and a statistically significant weak positive correlation with subjective measures of resident performance. These findings are increasingly relevant as Step 2 CK scores will likely become more important in resident selection.

Applicant characteristics and interview-day structure of shoulder and elbow surgery fellowships

Background: The purpose of this study was to determine the selection criteria and interview-day structure used by shoulder and elbow fellowship program directors. Methods: An anonymous 14-question survey was distributed to the program directors of the 31 American Shoulder and Elbow Surgeons (ASES) recognized orthopaedic shoulder and elbow fellowship programs. Surveys were sent via email, and responses were collected from March 31, 2021 to May 10, 2021. Results: All 31 fellowship directors responded (100%). The most valuable selection criteria for applicants were subjective measures: quality of interview, letters of recommendation, and quality of residency program. Objective criteria such as United States Medical Licensing Examination (USMLE) scores and Orthopaedic In-Training Examination (OITE) scores were less important. Fifteen (50%, 15/30) programs required applicants to have one to two publications, while 15 (50%, 15 of 30) required three to five publications. Programs most commonly interviewed 16 to 20 residents (38.7%). The interview day was a half day for the majority of programs (n=20; 64.5%), with most programs utilizing three (25.8%) or four (45.2%) separate interviews. Current fellows interviewed applicants in about half of the programs (51.6%). Conclusions: Shoulder and elbow fellowship program directors prioritize subjective over objective attributes when selecting applicants. The interview day is most commonly a half day with each applicant undergoing multiple interviews at each institution. Understanding the selection process used by shoulder and elbow fellowship directors provides a valuable resource for residents. Level of Evidence: Level V.