Internal Medicine In-Training Examination Research Articles

A Comparison of Remote vs In-Person Proctored In-Training Examination Administration for Internal Medicine.

In response to COVID-19, the American College of Physicians provided residents the option to complete the 2020 Internal Medicine In-Training Examination (IM-ITE) via in-person and remote proctoring. This study evaluated the extent to which scores obtained from both testing modalities were comparable. Data were analyzed from residents from all U.S.-based Accreditation Council for Graduate Medical Education-accredited IM residency programs and participating Canadian and international programs who completed the IM-ITE in 2020. The final sample contained 27,115 IM residents: 9,205 postgraduate year (PGY) 1, 9,332 PGY-2, and 8,578 PGY-3. Testing modality, gender, PGY, time spent on assessment, and native language were used to predict percent-correct scores in a multilevel regression model. This model included all main effects and all 2-way interactions between testing modality and each resident-level demographic variable, allowing those effects to be controlled for. Of 27,115 residents studied, 11,354 (42%) tested remotely and 15,761 (58%) in person. Across the parameters of interest (main effect of testing modality and 2-way interactions), the only statistically significant effects were the interaction effects between testing mode (interaction effect: -0.61; 95% confidence interval [CI], -1.01 to -0.21) and PGY (interaction effect: -0.54; 95% CI, -0.95 to -0.13) ( P = .002). Differences between in-person and remote predicted scores were slightly larger for PGY-1 than for PGY-2 and PGY-3 residents, but the magnitude of these differences across residency training was well under one percentage point. Because these statistically significant effects were deemed educationally nonsignificant, the study concluded that performance did not substantively differ across in-person and remote examinees. Residents taking the 2020 IM-ITE performed similarly across in-person and remote proctoring. This study provides evidence of score comparability across the 2 testing modalities and supports continued use of remote proctoring for the IM-ITE.

COVID-19 online medical education and outcomes on Internal Medicine In-Training Examination scores

Background COVID-19 presented a unique opportunity to explore new methods to deliver medical education virtually due to requirements for social distancing. We provided webcams and microphones in each of our core teaching team rooms. We used existing teleconferencing systems with share screen, polling, and audio/video capabilities to continue fostering a group learning environment. Methods The Internal Medicine In-Training Examination (IM-ITE) was used as a surrogate measurement of the effectiveness of virtual medical education, comparing composite scores from 2015 to 2019 (pre-COVID, in-person conference) to 2020 (post-COVID, virtual conference) for each postgraduate class. Results No statistically significant differences between the mean or median scores on the IM-ITE were noted for all three classes. Conclusion Although COVID-19 presented many challenges to residency programs across the United States, our pilot study demonstrated that virtual medical education did not result in lower IM-ITE scores and may be an innovative solution to bridge the education gap during COVID-19.

Resident factors associated with American board of internal medicine certification exam failure

ABSTRACT Introduction Performance on the certifying examinations such as the American Board of Internal Medicine Certification Exam (ABIM-CE) is of great interest to residents and their residency programs. Identification of factors associated with certification exam result may allow residency programs to recognize and intervene for residents at risk of failing. Despite this, residency programs have few evidence-based predictors of certification exam outcome. The change to pass-or-fail score reporting of the USA Medical Licensing Exam (USMLE) Step 1 removes one such predictor. Materials and Methods We performed a retrospective study of residents from a medium-sized internal medicine residency program who graduated from 1998 through 2017. We used univariate tests of associations between ABIM-CE result and various demographic and scholastic factors. Results Of 166 graduates, 14 (8.4%) failed the ABIM-CE on the first attempt. Failing the first attempt of the ABIM-CE was associated with older median age on entering residency (29 vs 27 years; P = 0.01); lower percentile rank on the Internal Medicine In-Training Examination (IM-ITE) in each of the first, second, and third years of training (P < 0.001 for all); and lower scores on the USMLE Steps 1, 2 Clinical Knowledge, and 3 (P < 0.05 for all). No association was seen between a variety of other scholastic or demographic factors and first-attempt ABIM-CE result. Discussion Although USMLE step 1 has changed to a pass-or-fail reporting structure, there are still other characteristics that allow residency programs to identify residents at risk of ABIM-CE first time failure and who may benefit from intervention.

Association of Gender and Race/Ethnicity with Internal Medicine In-Training Examination Performance in Graduate Medical Education.

Disparities in objective assessments in graduate medical education such as the In-Training Examination (ITE) that disadvantage women and those self-identifying with race/ethnicities underrepresented in medicine (URiM) are of concern. Examine ITE trends longitudinally across post-graduate year (PGY) with gender and race/ethnicity. Longitudinal analysis of resident ITE metrics at 7 internal medicine residency programs, 2014-2019. ITE trends across PGY of women and URiM residents compared to non-URiM men assessed via ANOVA. Those with ITE scores associated with less than 90% probability of passing the American Board of Internal Medicine certification exam (ABIM-CE) were identified and odds of being identified as at-risk between groups were assessed with chi square. A total of 689 IM residents, including 330 women and URiM residents (48%). ITE score KEY RESULTS: There was a significant difference in ITE score across PGY for women and URiM residents compared to non-URiM men (F(2, 1321) 4.46, p=0.011). Adjusting for program, calendar year, and baseline ITE, women and URiM residents had smaller ITE score gains (adjusted mean change in score between PGY1 and PGY3 (se), non-URiM men 13.1 (0.25) vs women and URiM residents 11.4 (0.28), p<0.001). Women and URiM residents had greater odds of being at potential risk for not passing the ABIM-CE (OR 1.75, 95% CI 1.10 to 2.78) with greatest odds in PGY3 (OR 3.13, 95% CI 1.54 to 6.37). Differences in ITE over training were associated with resident gender and race/ethnicity. Women and URiM residents had smaller ITE score gains across PGY translating into greater odds of potentially being seen as at-risk for not passing the ABIM-CE. Differences in ITE over training may reflect differences in experiences of women and URiM residents during training and may lead to further disparities.

Curriculum Transition From Lecture-Based to Team-Based Learning is Associated With Improved Performance on Internal Medicine In-Training Examination.

Team-based learning (TBL) is an alternative to traditional lectures in graduate medical education, but evidence is scarce regarding its impact on knowledge acquisition and standardized testing performance. We examined the association between resident performance on the Internal Medicine In-Training Examination (IM-ITE) and these 2 educational methods. In 2013, the internal medicine residency program at Albany Medical College transitioned from a lecture-based curriculum to TBL. Residents enrolled in academic years 2011-2012 and 2012-2013 comprised the lecture cohort, and those enrolled in 2015-2016 and 2016-2017 the TBL cohort. Covariates included the type of medical school attended, gender, and United States Medical Licensing Examination Step 2 Clinical Knowledge scores. We performed univariate analysis and multivariable regression to determine the association between covariates and ITE scores. Of 120 residents, 60 were in the lecture cohort and 60 in the TBL cohort. The IM-ITE percent correct scores were higher with TBL than lecture (PGY-1 61.0% vs 55.0%, P < .001; PGY-2 69.0% vs 59.7%, P < .001; PGY-3 73.2% vs 61.7%, P < .001). In a multivariable regression analysis of 3 PGYs combined, the transition from lecture to TBL resulted in an increase in IM-ITE Z-score of 0.415 (P < .001), equivalent to 0.415 SD, when including the effects of all covariates. Compared to a lecture-based curriculum, TBL was associated with improved resident medical knowledge acquisition as evidenced by higher IM-ITE scores.

Gender Differences in Milestone Ratings and Medical Knowledge Examination Scores Among Internal Medicine Residents.

To examine whether there are group differences in milestone ratings submitted by program directors working with clinical competency committees (CCCs) based on gender for internal medicine (IM) residents and whether women and men rated similarly on milestones perform comparably on subsequent in-training and certification examinations. This national retrospective study examined end-of-year medical knowledge (MK) and patient care (PC) milestone ratings and IM In-Training Examination (IM-ITE) and IM Certification Examination (IM-CE) scores for 2 cohorts (2014-2017, 2015-2018) of U.S. IM residents at ACGME-accredited programs. It included 20,098/21,440 (94%) residents, with 9,424 women (47%) and 10,674 men (53%). Descriptive statistics and differential prediction techniques using hierarchical linear models were performed. For MK milestone ratings in PGY-1, men and women showed no statistical difference at a significance level of .01 (P = .02). In PGY-2 and PGY-3, men received statistically higher average MK ratings than women (P = .002 and P < .001, respectively). In contrast, men and women received equivalent average PC ratings in each PGY (P = .47, P = .72, and P = .80, for PGY-1, PGY-2, and PGY-3, respectively). Men slightly outperformed women with similar MK or PC ratings in PGY-1 and PGY-2 on the IM-ITE by about 1.7 and 1.5 percentage points, respectively, after adjusting for covariates. For PGY-3 ratings, women and men with similar milestone ratings performed equivalently on the IM-CE. Milestone ratings were largely similar for women and men. Generally, women and men with similar MK or PC milestone ratings performed similarly on future examinations. Although there were small differences favoring men on earlier examinations, these differences disappeared by the final training year. It is questionable whether these small differences are educationally or clinically meaningful. The findings suggest fair, unbiased milestone ratings generated by program directors and CCCs assessing residents.

Barriers to Accessing Nighttime Supervisors: a National Survey of Internal Medicine Residents.

Single-center studies have reported residents experience barriers to accessing supervising physicians overnight, but no national dataset has described barriers perceived by residents or the association between supervision models and perceived barriers. To explore residents' perception of barriers to accessing overnight supervision. Questions about overnight supervision and barriers to accessing it were included on the American College of Physicians Internal Medicine In-Training Examination® (IM-ITE®) Resident Survey in Fall 2017. All US-based internal medicine residents who completed the 2017 IM-ITE®. Responses from 20,744 residents (84%) were analyzed. For our main outcome, we calculated percentages of responses for eight barriers and tested for association with the presence or absence of nocturnists. For our secondary outcome, we categorized free-text responses enumerating barriers from all residents into the five Systems Engineering Initiative for Patient Safety (SEIPS) categories to elucidate future areas for study or intervention. Internal medicine residents working in hospitals without nocturnists more commonly reported having at least one barrier to accessing a supervising physician "always" or "most of the time" (5075/9842, 51.6%) compared to residents in hospitals with nocturnists (3074/10,902, 28.2%, p < 0.001). Among residents in hospitals without nocturnists, the most frequently reported barrier to accessing attending supervision was attendings not being present in the hospital (30.4% "always" or "most of the time"); residents in hospitals with nocturnists most frequently reported desire to make their own decisions as a barrier to contacting attendings (15.7% "always" or "most of the time"). Free-text responses from residents with and without nocturnists most commonly revealed organization (47%) barriers to accessing supervision; 28% cited person barriers, and 23% cited tools/technology barriers. Presence of nocturnists is associated with fewer reported barriers to contacting supervising physicians overnight. Organizational culture, work schedules, desire for independence, interpersonal interactions, and technology may present important barriers.

Assessment of Training in Health Disparities in US Internal Medicine Residency Programs

Health disparities continue to exist despite the call to increase education of health care practitioners. An assessment of health disparities education has not been previously studied in a national cohort. To describe and compare the curriculum on health disparities from the perspective of program directors and perceptions of training among internal medicine residents. This cross-sectional survey study used a survey of US internal medicine program directors, the 2015 Association of Program Directors in Internal Medicine annual survey, which included questions about health disparities curriculum, and a 1-time survey of US internal medicine residents that asked questions related to their training in health disparities on the American College of Physicians 2015 Internal Medicine In-Training Examination. All internal medicine program directors who were members of Association of Program Directors in Internal Medicine (368 of 396 accredited programs), and internal medicine residents who took the Internal Medicine In-Training Examination were eligible. Final analysis of the merged data set was completed in 2018. Questions were included on the annual Association of Program Directors in Internal Medicine survey and the Internal Medicine In-Training Examination. Program directors reported on presence of health disparities curriculum, educational methods, quality, barriers and challenges to curriculum, and Clinical Learning Environment Review. Residents reported whether they received training and quality of the training in health disparities. A total of 227 program directors (response rate, 61.7%) and 22 723 residents (response rate, 87.2%) responded to the surveys. A total of 90 program directors (39.6%) reported a curriculum in health disparities, but among these, only 16 program directors (17.8%) felt quality of their education was very good or excellent. In more than half of the programs (52 programs [55.9%]), outcomes of the curriculum were not measured. After merging, the combined data set included 18 883 residents from 366 APDIM member programs with 225 program director responses. Among these, 13 251 residents (70.2%) reported some training in caring for patients at risk for health disparities. Of residents who reported receiving training, 10 494 (79.2%) rated the quality as very good or excellent. These findings suggest that that despite the Clinical Learning Environment Review mandate and Accreditation Council for Graduate Medical Education required competencies for training in health disparities, relatively few internal medicine programs in the US provided educational curriculum. Additionally, the existence of health disparities curricula in internal medicine training programs was not associated with resident's perception of training or its quality.

Correlations Between the USMLE Step Examinations, American College of Physicians In-Training Examination, and ABIM Internal Medicine Certification Examination.

To assess the correlations between United States Medical Licensing Examination (USMLE) performance, American College of Physicians Internal Medicine In-Training Examination (IM-ITE) performance, American Board of Internal Medicine Internal Medicine Certification Exam (IM-CE) performance, and other medical knowledge and demographic variables. The study included 9,676 postgraduate year (PGY)-1, 11,424 PGY-2, and 10,239 PGY-3 internal medicine (IM) residents from any Accreditation Council for Graduate Medical Education-accredited IM residency program who took the IM-ITE (2014 or 2015) and the IM-CE (2015-2018). USMLE scores, IM-ITE percent correct scores, and IM-CE scores were analyzed using multiple linear regression, and IM-CE pass/fail status was analyzed using multiple logistic regression, controlling for USMLE Step 1, Step 2 Clinical Knowledge, and Step 3 scores; averaged medical knowledge milestones; age at IM-ITE; gender; and medical school location (United States or Canada vs international). All variables were significant predictors of passing the IM-CE with IM-ITE scores having the strongest association and USMLE Step scores being the next strongest predictors. Prediction curves for the probability of passing the IM-CE based solely on IM-ITE score for each PGY show that residents must score higher on the IM-ITE with each subsequent administration to maintain the same estimated probability of passing the IM-CE. The findings from this study should support residents and program directors in their efforts to more precisely identify and evaluate knowledge gaps for both personal learning and program improvement. While no individual USMLE Step score was as strongly predictive of IM-CE score as IM-ITE score, the combined relative contribution of all 3 USMLE Step scores was of a magnitude similar to that of IM-ITE score.

Association Between Nocturnist Supervision and Perceived Overnight Supervision Adequacy Among Internal Medicine Residents in the US

This cross-sectional study uses data from a voluntary survey that was administered during the American College of Physicians Internal Medicine In-Training Examination to assess whether residents in programs with nocturnists perceived nighttime supervision differently than those in programs without nocturnists.

Evaluation of Progress of an ACGME-International Accredited Residency Program in Qatar.

Background: The American College of Physicians’ (ACP) Internal Medicine In-Training Examination (IM-ITE) is designed to evaluate the cognitive knowledge of residents to aid them and program directors in evaluating the training experience. Objective: To determine the impact of the curriculum reform accompanied by the Accreditation Council for Graduate Medical Education (ACGME)-I alignment and accreditation on the internal medicine residency program (IMRP) using residents’ performance in the ACP's ITE from 2008 to 2016, and where the IMRP stands in comparison to all ACGME and ACGME-I accredited programs. Methods: This is a descriptive study conducted at a hospital-based IMRP in Doha, Qatar from 2008 to 2016. The study population is 1052 residents at all levels of training in IMRP. The ACP-generated ITE results of all the United States and ACGME-I accredited programs were compared with IM-ITE results in Qatar. These results were expressed in the total program average and the ranking percentile. Results: There is a progressive improvement in resident performance in Qatar as shown by the rise in total average program score from 52% in 2008 to 72% in 2016 and the sharp rise in percentile rank from 3rd percentile in 2008 to 93rd percentile in 2016 with a dramatic increase during the period 2013 to 2014 (from 32nd percentile to 73rd percentile), which represents the period of ACGME-I accreditation. None of the factors (ethnicity, USMLE or year of residency) were statistically significant with a p value >0.05 and standard coefficient ( − 0.017–0.495). There was negligible correlation between the USMLE test scores with the residents’ ITE scores with a p value = 0.023 and a Pearson correlation r = 0.097. Conclusion: The initial ACGME-I alignment followed by the accreditation, together with whole curriculum redesign to a structured, competency-based program starting from 2008, has led to an improvement in the ITE scores in the IMRP. This was further evidenced by the lack of change in the residency entry selection criteria.

Learning Styles of Internal Medicine Residents and Association With the In-Training Examination Performance

IntroductionAssessment of how medical residents learn and the impact on standardized test performance is important for effective training. Kolb's learning study inventory categorizes learning into accommodating, assimilating, converging and diverging based on the four stages of learning: active experimentation, abstract conceptualization, concrete experience and reflective observation. The American College of Physicians (ACP) Internal Medicine In-Training Examination (IM-ITE) has been shown to positively correlate with successful performance on clinical assessments and board certification. We sought to evaluate the association between the individual learning styles of IM residents and performance on the ACP IM-ITE. MethodsThe Kolb LSI questionnaire was administered to IM residents during the 2016/2017 academic year. Logistic regression was used to analyze the association between residents preferred learning styles and performance on the ACP IM – ITE. Results53 residents in the IM Residency Program of Morehouse School of Medicine completed the questionnaire. The predominant learning style was assimilating (49%), followed by converging (26%). There was no significant difference between the learning styles of residents when compared across gender, age, race, and PGY levels. Residents with a diverging learning style had the highest mean IM-ITE percentage score followed by assimilating and converging respectively (P = 0.14) ConclusionsThe predominant learning styles among our IM residents are assimilating and converging, which is consistent with previous studies. Residents with a diverging style of learning appeared to perform better on the IM-ITE. We suggest that future studies should evaluate the feasibility of integrating brainstorming and group work sessions into the IM residency teaching curriculum and the impact on academic performance.

Use of Filters for Residency Application Review: Results From the Internal Medicine In-Training Examination Program Director Survey.

The increase in applications to residency programs, known as "application inflation," creates challenges for program directors (PDs). Prior studies have shown that internal medicine (IM) PDs utilize criteria, such as United States Medical Licensing Examination (USMLE) Step examination performance, when reviewing applications. However, little is known about how early these filters are utilized in the application review cycle. This study sought to assess the frequency and types of filters utilized by IM PDs during initial residency application screening and prior to more in-depth application review. A web-based request for the 2016 Internal Medicine In-Training Examination (IM-ITE) PD Survey was sent to IM PDs. Responses from this survey were analyzed, excluding non-US programs. With a 50% response rate (214 of 424), IM PDs responded that the most commonly used data points to filter applicants prior to in-depth application review were the USMLE Step 2 Clinical Knowledge score (32%, 67 of 208), USMLE Step 1 score (24%, 50 of 208), and medical school attended (12%, 25 of 208). Over half of US IM PD respondents (55%, 114 of 208) indicated that they list qualifying interview criteria on their program website, and 31% of respondents (50 of 160) indicated that more than half of their applicant pool does not meet the program's specified interview criteria. Results from the 2016 IM-ITE PD Survey indicate many IM PDs use filters for initial application screening, and that these filters, when available to applicants, do not affect many applicants' decisions to apply.

Important Skills for Internship and the Fourth-Year Medical School Courses to Acquire Them: A National Survey of Internal Medicine Residents.

To obtain feedback from internal medicine residents, a key stakeholder group, regarding both the skills needed for internship and the fourth-year medical school courses that prepared them for residency. This feedback could inform fourth-year curriculum redesign efforts. All internal medicine residents taking the 2013-2014 Internal Medicine In-Training Examination were asked to rank the importance of learning 10 predefined skills prior to internship and to use a dropdown menu of 11 common fourth-year courses to rank the 3 most helpful in preparing for internship. The predefined skills were chosen based on a review of the literature, a national subinternship curriculum, and expert consensus. Chi-square statistics were used to test for differences in responses between training levels. Of the 24,820 internal medicine residents who completed the exam, 20,484 (83%) completed the survey, had complete identification numbers, and consented to have their responses used for research. The three skills most frequently rated as very important were identifying when to seek additional help and expertise, prioritizing clinical tasks and managing time efficiently, and communicating with other providers around care transitions. The subinternship/acting internship was most often selected as being the most helpful course in preparing for internship. These findings indicate which skills and fourth-year medical school courses internal medicine residents found most helpful in preparing for internship and confirm the findings of prior studies highlighting the perceived value of subinternships. Internal medicine residents and medical educators agree on the skills students should learn prior to internship.

U.S. Internal Medicine Residents' Knowledge and Practice of High-Value Care: A National Survey.

To determine U.S. internal medicine (IM) residents' knowledge of, attitudes toward, and self-reported practice of high-value care (HVC), or care that balances the benefits, harms, and costs of tests and treatments. The authors conducted a cross-sectional survey of U.S. IM residents who took the Internal Medicine In-Training Examination in October 2012. They used multivariable mixed-effects models to examine the relationships between self-reported knowledge and practice of HVC and both exposure to HVC teaching and the care intensity of the training hospital (based on a composite age-sex-race-illness standardized measure of hospital days and inpatient physician visits by Medicare recipients). Of 21,617 residents who received the survey, 18,102 (83.7%) completed it. Self-reported HVC practices varied: 4,187 of 17,633 respondents (23.7%) agreed that they "share estimated costs of tests and treatments with patients"; 15,549 of 17,626 (88.2%) agreed that they "incorporate patients' values and concerns into clinical decisions." Discussions about balancing the benefits, harms, and costs of treatments with faculty during patient care at least a few times a week were reported by 7,103 of 17,704 respondents (40.1%) and were associated with all self-reported HVC practices. The training hospital's care intensity was inversely associated with self-reported incorporation of costs and patient values into clinical decisions but not with other self-reported behaviors. U.S. IM residents reported varying HVC knowledge and practice. Faculty discussions of HVC during patient care correlated with such knowledge and practice and may represent an opportunity to improve residents' competency in providing value-based care.

Role-Modeling Cost-Conscious Care--A National Evaluation of Perceptions of Faculty at Teaching Hospitals in the United States.

Little is known about how well faculty at teaching hospitals role-model behaviors consistent with cost-conscious care. We aimed to evaluate whether residents and program directors report that faculty at their program consistently role-model cost-conscious care, and whether the presence of a formal residency curriculum in cost-conscious care impacted responses. Cost-conscious care surveys were administered to internal medicine residents during the 2012 Internal Medicine In-Training Examination and to program directors during the 2012 Association of Program Directors in Internal Medicine Annual Survey. Respondents stated whether or not they agreed that faculty in their program consistently role-model cost-conscious care. To evaluate a more comprehensive assessment of faculty behaviors, resident responses were matched with those of the director of their residency program. A multivariate logistic regression model was fit to the outcome variable, to identify predictors of responses that faculty do consistently role-model cost-conscious care from residency program, resident, and program director characteristics. Responses from 12,623 residents (58.4 % of total sample) and 253 program directors (68.4 %) from internal medicine residency programs in the United States were included. The primary outcome measure was responses to questionnaires on faculty role-modeling cost-conscious care. Among all responses in the final sample, 6,816 (54.0 %) residents and 121 (47.8 %) program directors reported that faculty in their program consistently role-model cost-conscious care. Among paired responses of residents and their program director, the proportion that both reported that faculty do consistently role-modeled cost-conscious care was 23.0 % for programs with a formal residency curriculum in cost-conscious care, 26.3 % for programs working on a curriculum, and 23.7 % for programs without a curriculum. In the adjusted model, the presence of a formal curriculum in cost-conscious care did not have a significant impact on survey responses (odds ratio [OR], 1.04; 95 % Confidence Interval [CI], 0.52-2.06; p value [p] = 0.91). Responses from residents and program directors indicate that faculty at US teaching hospitals were not consistently role-modeling cost-conscious care. The presence of a formal residency curriculum in cost-conscious care did not impact responses. Future efforts should focus on placing more emphasis on faculty development and on combining curricular improvements with institutional interventions to adapt the training environment.

Utilization of an Educational Prescription to Improve Performance on the Internal Medicine In-Training Examination.

Utilization of an Educational Prescription to Improve Performance on the Internal Medicine In-Training Examination.

Concurrent Validity Between a Shared Curriculum, the Internal Medicine In-Training Examination, and the American Board of Internal Medicine Certifying Examination.

A core objective of residency education is to facilitate learning, and programs need more curricula and assessment tools with demonstrated validity evidence. We sought to demonstrate concurrent validity between performance on a widely shared, ambulatory curriculum (the Johns Hopkins Internal Medicine Curriculum), the Internal Medicine In-Training Examination (IM-ITE), and the American Board of Internal Medicine Certifying Examination (ABIM-CE). A cohort study of 443 postgraduate year (PGY)-3 residents at 22 academic and community hospital internal medicine residency programs using the curriculum through the Johns Hopkins Internet Learning Center (ILC). Total and percentile rank scores on ILC didactic modules were compared with total and percentile rank scores on the IM-ITE and total scores on the ABIM-CE. The average score on didactic modules was 80.1%; the percentile rank was 53.8. The average IM-ITE score was 64.1% with a percentile rank of 54.8. The average score on the ABIM-CE was 464. Scores on the didactic modules, IM-ITE, and ABIM-CE correlated with each other (P < .05). Residents completing greater numbers of didactic modules, regardless of scores, had higher IM-ITE total and percentile rank scores (P < .05). Resident performance on modules covering back pain, hypertension, preoperative evaluation, and upper respiratory tract infection was associated with IM-ITE percentile rank. Performance on a widely shared ambulatory curriculum is associated with performance on the IM-ITE and the ABIM-CE.

Development of a high-value care subscore on the internal medicine in-training examination.

Although high-value care (HVC) that balances benefits of tests or treatments against potential harms and costs has been a recently emphasized competency for internal medicine (IM) residents, few tools to assess residents' knowledge of HVC are available. To describe the development and initial results of an HVC subscore of the Internal Medicine In-Training Examination (IM-ITE). The HVC concepts were introduced to IM-ITE authors during question development. Three physicians independently reviewed each examination question for selection in the HVC subscore according to 6 HVC principles. The final subscore was determined by consensus. Data from the IM-ITE administered in October 2012 were analyzed at the program level. U.S. IM residency programs. 362 U.S. IM residency programs with IM-ITE data for at least 10 residents. Program-level performance on the HVC subscore was compared with performance on the overall IM-ITE, the Dartmouth Atlas hospital care intensity (HCI) index of the program's primary training hospital, and residents' attitudes about HVC assessed with a voluntary survey. The HVC subscore comprised 38 questions, including 21 (55%) on managing conservatively when appropriate and 14 (37%) on identifying low-value care. Of the 362 U.S. IM programs in the sample, 41% were in a different quartile when ranked based on the HVC subscore compared with overall IM-ITE performance. Rankings by HVC subscore and HCI index were modestly inversely associated, with 30% of programs ranked in the same quartile based on both measures. Knowledge of HVC assessed from examination vignettes may not reflect practice of HVC. Although the HVC subscore has face validity and can contribute to evaluation of residents' HVC knowledge, additional tools are needed to accurately measure residents' proficiency in HVC. None.

Transitioning From a Noon Conference to an Academic Half-Day Curriculum Model: Effect on Medical Knowledge Acquisition and Learning Satisfaction

The academic half-day (AHD) curriculum is an alternative to the traditional noon conference in graduate medical education, yet little is known regarding its effect on knowledge acquisition and resident satisfaction. We investigated the association between the 2 approaches for delivering the curriculum and knowledge acquisition, as reflected by the Internal Medicine In-Training Examination (IM-ITE) scores and assessed resident learning satisfaction under both curricula. The Cleveland Clinic Internal Medicine Residency Program transitioned from the noon conference to the AHD curriculum in 2011. Covariates for residents enrolled from 2004 to 2011 were age; sex; type of medical degree; United States Medical Licensing Examination Step 1, 2 Clinical Knowledge; and IM-ITE-1 scores. We performed univariable and multivariable linear regressions to investigate the association between covariates and IM-ITE-2 and IM-ITE-3 scores. Residents also were surveyed about their learning satisfaction in both curricula. Of 364 residents, 112 (31%) and 252 (69%) were exposed to the AHD and the noon conference curriculum, respectively. In multivariable analyses, the AHD curriculum was associated with higher IM-ITE-3 (regression coefficient, 4.8; 95% confidence interval 2.9-6.6) scores, and residents in the AHD curriculum had greater learning satisfaction compared with the noon conference cohort (Likert, 3.4 versus 3.0; P = .003). The AHD curriculum was associated with improvement in resident medical knowledge acquisition and increased learner satisfaction.