US Internal Medicine Residency Research Articles

How faculty members experience workplace-based assessment rater training: a qualitative study.

Direct observation of clinical skills is a common approach in workplace-based assessment (WBA). Despite widespread use of the mini-clinical evaluation exercise (mini-CEX), faculty development efforts are typically required to improve assessment quality. Little consensus exists regarding the most effective training methods, and few studies explore faculty members' reactions to rater training. This study was conducted to qualitatively explore the experiences of faculty staff with two rater training approaches - performance dimension training (PDT) and amodified approach to frame of reference training (FoRT) - to elucidate how such faculty development can be optimally designed. In a qualitative study of a multifaceted intervention using complex intervention principles, 45 out-patient resident faculty preceptors from 26 US internal medicine residency programmes participated in a rater training faculty development programme. All participants were interviewed individually and in focus groups during and after the programme to elicit how the training influenced their approach to assessment. A constructivist grounded theory approach was used to analyse the data. Many participants perceived that rater training positively influenced their approach to direct observation and feedback, their ability to use entrustment as the standard for assessment, and their own clinical skills. However, barriers to implementation and change included: (i) a preference for holistic assessment over frameworks; (ii) challenges in defining competence; (iii) difficulty in changing one's approach to assessment, and (iv) concerns about institutional culture and buy-in. Rater training using PDT and a modified approach to FoRT can provide faculty staff with assessment skills that are congruent with principles of criterion-referenced assessment and entrustment, and foundational principles of competency-based education, while providing them with opportunities to reflect on their own clinical skills. However, multiple challenges to incorporating new forms of training exist. Ongoing efforts to improve WBA are needed to address institutional and cultural contexts, and systems of care delivery.

Textual analysis of internal medicine residency personal statements: themes and gender differences.

Applicants to US residency training programmes are required to submit a personal statement, the content of which is flexible but often requires them to describe their career goals and aspirations. Despite their importance, no systematic research has explored common themes and gender differences inherent to these statements. This study was conducted to analyse US applicants' Electronic Residency Application Service (ERAS) personal statements using two automated textual analysis programs, and to assess for common themes and gender-associated differences. A retrospective cohort study of 2138 personal statements (containing 1,485,255 words) from candidates from 377 national and international medical schools applying to US internal medicine (IM) residency programmes through ERAS was conducted. A mathematical analysis of text segments using a recursive algorithm was performed; two different specifications of the text segments were used to conduct an internal validation. Five statistically significant thematic classes were identified through independent review by the researchers. These were best defined as referring to: the appeal of the residency programme; memorable patients; health care as public policy; research and academia, and family inspiration. Some themes were common to all applications. However, important gender-specific differences were identified. Notably, men were more likely to describe personal attributes and to self-promote, whereas women more frequently expressed the communicative and team-based aspects of doctoring. The results were externally validated using a second software program. Although these data comprise part of the national pool, they represent applicants to a single specialty at a single institution. By applying textual analysis to material derived from a national cohort, we identified common narrative themes in the personal statements of future US physicians, noting differences between men and women. Together, these data provide novel insight into the dominant discourse of doctoring in this generation of students applying for further training in US IM residency programmes, and depict a diverse group of applicants with multiple motivations, desires and goals. Furthermore, differences seen between men and women add to the growing understanding of bias in medical education. Training programmes may benefit by adapting curricula to foster such diverse interests.

General Medicine vs Subspecialty Career Plans Among Internal Medicine Residents

Current medical training models in the United States are unlikely to produce sufficient numbers of general internists and primary care physicians. Differences in general internal medicine (GIM) career plans between internal medicine residency program types and across resident demographics are not well understood. To evaluate the general medicine career plans of internal medicine residents and how career plans evolve during training. A study of US internal medicine residents using an annual survey linked to the Internal Medicine In-Training Examination taken in October of 2009-2011 to evaluate career plans by training program, sex, and medical school location. Of 67,207 US eligible categorical and primary care internal medicine residents, 57,087 (84.9%) completed and returned the survey. Demographic data provided by the National Board of Medical Examiners were available for 52,035 (77.4%) of these residents, of whom 51,390 (76.5%) responded to all survey items and an additional 645 (1.0%) responded to at least 1 survey item. Data were analyzed from the 16,781 third-year residents (32.2%) in this sample. Self-reported ultimate career plans of internal medicine residents. A GIM career plan was reported by 3605 graduating residents (21.5%). A total of 562 primary care program (39.6%) and 3043 categorical (19.9%) residents reported GIM as their ultimate career plan (adjusted odds ratio [AOR], 2.76; 99% CI, 2.35-3.23; P < .001). Conversely, 10 008 categorical (65.3%) and 745 primary care program (52.5%) residents reported a subspecialty career plan (AOR, 1.90; 99% CI, 1.62-2.23; P < .001). GIM career plans were reported more frequently by women than men (26.7% vs 17.3%, respectively; AOR, 1.69; 99% CI, 1.53-1.87; P < .001). US medical graduates were slightly more likely to report GIM career plans than international medical graduates (22.0% vs 21.1%, respectively; AOR, 1.76; 99% CI, 1.50-2.06; P < .001). Within primary care programs, US medical graduates were much more likely to report GIM career plans than international medical graduates (57.3% vs 27.3%, respectively; AOR, 3.48; 99% CI, 2.58-4.70; P < .001). Compared with their counterparts, maintaining a first-year GIM career plan over the course of their training was more likely among primary care program residents (68.2% vs 52.3%; AOR, 1.81; 99% CI, 1.25-2.64; P < .001), women (62.4% vs 47.2%; AOR, 1.75; 99% CI, 1.34-2.29; P < .001), and US medical graduates (60.9% vs 49.2%; AOR, 1.48; 99% CI, 1.13-1.93; P < .001). Reported GIM career plans were markedly less common than subspecialty career plans among internal medicine residents, including those in primary care training programs, and differed according to resident sex, medical school location, and program type.

Gaps In Quality Of Diabetes Care In Internal Medicine Residency Clinics Suggest The Need For Better Ambulatory Care Training

To ensure that medical residents will be prepared to deliver consistently high-quality care, they should be trained in settings that provide such care. Residents in internal medicine, particularly, need to learn good care habits in order to meet the needs of patients with diabetes and other common chronic and high-impact illnesses. To assess the strength of such training, we compared the quality of medical care provided in sixty-seven US internal medicine residency ambulatory clinics with the quality of care provided by 703 practicing general internists. We found significant quality gaps in process, intermediate outcome, and patient-experience measures. These inadequacies in ambulatory training for internal medicine residents must be addressed by policy makers and educators-for example, by accelerating the movement toward new residency curricula that emphasize competency-based training.

Quality of Life, Burnout, Educational Debt, and Medical Knowledge Among Internal Medicine Residents

Physician distress is common and has been associated with negative effects on patient care. However, factors associated with resident distress and well-being have not been well described at a national level. To measure well-being in a national sample of internal medicine residents and to evaluate relationships with demographics, educational debt, and medical knowledge. Study of internal medicine residents using data collected on 2008 and 2009 Internal Medicine In-Training Examination (IM-ITE) scores and the 2008 IM-ITE survey. Participants were 16,394 residents, representing 74.1% of all eligible US internal medicine residents in the 2008-2009 academic year. This total included 7743 US medical graduates and 8571 international medical graduates. Quality of life (QOL) and symptoms of burnout were assessed, as were year of training, sex, medical school location, educational debt, and IM-ITE score reported as percentage of correct responses. Quality of life was rated "as bad as it can be" or "somewhat bad" by 2402 of 16,187 responding residents (14.8%). Overall burnout and high levels of emotional exhaustion and depersonalization were reported by 8343 of 16,192 (51.5%), 7394 of 16,154 (45.8%), and 4541 of 15,737 (28.9%) responding residents, respectively. In multivariable models, burnout was less common among international medical graduates than among US medical graduates (45.1% vs 58.7%; odds ratio, 0.70 [99% CI, 0.63-0.77]; P < .001). Greater educational debt was associated with the presence of at least 1 symptom of burnout (61.5% vs 43.7%; odds ratio, 1.72 [99% CI, 1.49-1.99]; P < .001 for debt >$200,000 relative to no debt). Residents reporting QOL "as bad as it can be" and emotional exhaustion symptoms daily had mean IM-ITE scores 2.7 points (99% CI, 1.2-4.3; P < .001) and 4.2 points (99% CI, 2.5-5.9; P < .001) lower than those with QOL "as good as it can be" and no emotional exhaustion symptoms, respectively. Residents reporting debt greater than $200,000 had mean IM-ITE scores 5.0 points (99% CI, 4.4-5.6; P < .001) lower than those with no debt. These differences were similar in magnitude to the 4.1-point (99% CI, 3.9-4.3) and 2.6-point (99% CI, 2.4-2.8) mean differences associated with progressing from first to second and second to third years of training, respectively. In this national study of internal medicine residents, suboptimal QOL and symptoms of burnout were common. Symptoms of burnout were associated with higher debt and were less frequent among international medical graduates. Low QOL, emotional exhaustion, and educational debt were associated with lower IM-ITE scores.

Pharmaceutical Industry Support and Residency Education

Interactions with the pharmaceutical industry are known to affect the attitudes and behaviors of medical residents; however, to our knowledge, a nationally representative description of current practices has not been reported. The Association of Program Directors in Internal Medicine surveyed 381 US internal medicine residency program directors in 2006-2007 regarding pharmaceutical industry support to their training programs. The primary outcome measure was program director report of pharmaceutical financial support to their residency. Demographic and performance variables were analyzed with regard to these responses. In all, 236 program directors (61.9%) responded to the survey. Of these, 132 (55.9%) reported accepting support from the pharmaceutical industry. One hundred seventy of the 236 program directors (72.0%) expressed the opinion that pharmaceutical support is not desirable. Residency programs were less likely to receive pharmaceutical support when the program director held the opinion that industry support was not acceptable (odds ratio [OR], 0.07; 95% confidence interval [CI], 0.02-0.22). Programs located in the southern United States were more likely to accept pharmaceutical support (OR, 8.45; 95% CI, 1.95-36.57). The American Board of Internal Medicine pass rate was inversely associated with acceptance of industry support: each 1% decrease in the pass rate was associated with a 21% increase in the odds of accepting industry support (OR, 1.21; 95% CI, 1.07-1.36). Although most of the program directors did not find pharmaceutical support desirable, more than half reported acceptance of industry support. Acceptance of pharmaceutical industry support was less prevalent among residency programs with a program director who considered support unacceptable and those with higher American Board of Internal Medicine pass rates.

Measuring primary care: the standard primary care year

Numerous reports highlight the problem of declining primary care capacity in the USA, especially in rural and remote areas. The reasons for declining primary care capacity are elusive. Little progress is likely without better definitions, tools, and approaches. The author proposes a standard primary care workforce year to adjust each primary care form for losses due to specialization, lower levels of practice activity, lower primary care volume, and shorter career length. The author reviewed studies to create a standard primary care year estimate representing the total primary care contribution for each of the five training forms of primary care over the career length of the graduate. The standard primary care year was the product of four factors: (1) the career length in years; (2) the percentage estimated to remain in primary care; (3) the percentage active in practice; and (4) the percentage of primary care volume compared with a family practitioner. A best determination was made regarding the value of each of the four factors for each primary care form. Because specialization rates increased substantially to decrease primary care contributions, the estimate for each form also had to be linked to each class year of graduates. Family practice is the best example of a permanent primary care training form with 29.3 standard primary care years expected over a 35 year career. Other training forms appear to be more flexible with graduates able to choose primary care or specialty care depending on policy and market forces. The 2008 pediatric residency graduates can be expected to serve 17.6 years of primary care. Internal medicine resident primary care contributions have been reduced by 50% in the past decade to 5.3 years with international medical graduate internal medicine contributions decreasing to 2.5 years. Physician assistant estimates have decreased to 6 years, while nurse practitioner estimates have declined below 3 years per graduate. Without changes in policy or training, the USA must graduate 11.7 international medical graduate internal medicine residents, or 10 nurse practitioners, or 5.5 US internal medicine residents, or 4.8 physician assistants, or 1.7 pediatric residents to equal the same primary care contributions as one family physician. With decreasing rural and underserved distribution levels in the flexible forms, the numbers of graduates needed to match the family practice rural primary care year and underserved primary care year contributions are even higher. The primary care year is a versatile tool that can help to estimate primary care contributions across different forms of primary care. Specialization takes a huge toll on primary care capacity. Progressive failure to retain primary care makes expansions of graduates an ineffective and costly intervention. Without graduating more who remain in primary care, the USA can expect consistently lower primary care levels. Primary care contributions of progressively shorter duration could explain the perceived rapid collapse of primary care, particularly when studies of primary care fail to involve the most recent months of changes.

A Self-instructional Model to Teach Systems-based Practice and Practice-based Learning and Improvement

When mandated as resident competencies in 1999, systems-based practice (SBP) and practice-based learning and improvement (PBLI) were new concepts to many. To describe and evaluate a 4-week clinical elective (Achieving Competence Today-ACT) to teach residents SBP and PBLI. ACT consisted of a four-week active learning course and follow-up teaching experience, guided and supported by web-based materials. The curriculum included readings, scheduled activities, work products including an improvement project, and weekly meetings with a non-expert preceptor. The evaluation used a before-after cross-comparison of ACT residents and their peers. Seventy-eight residents and 42 faculty in 18 US Internal Medicine residency programs participated between 2003 and 2005. RESULTS AND MAIN MEASUREMENTS: All residents and faculty preceptors responded to a knowledge test, survey of attitudes, and self-assessment of competency to do 15 tasks related to SBP/PBLI. All measures were normalized to a 100-point scale. Each program's principal investigator (PI) identified aspects of ACT that were most and least effective in enhancing resident learning. ACT residents' gains in knowledge (4.4 on a 100-point scale) and self-assessed competency (11.3) were greater than controls' (-1.9, -8.0), but changes in attitudes were not significantly different. Faculty preceptors' knowledge scores did not change, but their attitudes became more positive (15.8). PIs found a ready-to-use curriculum effective (rated 8.5 on a 10-point scale). ACT increased residents' knowledge and self-assessment of their own competency and raised faculty's assessment of the importance of residents' learning SBP/PBLI. Faculty content expertise is not required for residents to learn SBP/PBLI.

Transfers of Patient Care Between House Staff on Internal Medicine Wards

Transfer of responsibility for patient care between physicians is a key process in the care of hospitalized patients. Systems of transfer management and transfer frequency may affect clinical outcomes. To characterize the systems by which patient information is transferred ("signed out") between resident physicians in internal medicine residency programs and to determine the impact of recently enacted resident work-hour regulations on the frequency of transfers, we mailed a self-administered survey to chief residents at 324 accredited US internal medicine residency programs outside of New York State. The main outcome measures were sign-out practices, skills training, and transfer frequency. Surveys were returned from 202 programs (62%). Transfer systems varied among and within institutions: 55% did not consistently require both a written and an oral sign-out at transfers of care, 34% left sign-out to interns alone, and 59% had no means of informing nurses that a transfer had taken place. In addition, 60% of the programs did not provide any lectures or workshops on sign-out skills. After work-hour regulations were instituted, transfers of care for a hypothetical patient increased by a mean of 11% (from 7.0 to 7.8 transfers; P<.001) during a Monday-Friday hospitalization. A member of the primary team was in the hospital for 47% of the hospitalization. Although transfers of care are increasingly frequent, few internal medicine residency programs have comprehensive transfer of care systems in place, and most do not provide formal training in sign-out skills to all residents.

Assessing evidence-based dermatology and evidence-based internal medicine curricula in US residency training programs: a national survey.

To examine attitudes toward evidence-based medicine and evidence-based dermatology and to assess evidence-based training in US internal medicine and dermatology residency programs. A 1-page self-administered questionnaire was mailed to residency training directors and chief residents at 104 dermatology and 103 internal medicine residency programs from the same or affiliated medical centers. Questionnaires were returned by respondents from 70 (68%) of 103 internal medicine programs and 86 (83%) of 104 dermatology programs. Most respondents (91% internal medicine and 70% dermatology) strongly agreed or agreed that evidence-based internal medicine/dermatology is valuable and should be included in residency training (93% internal medicine and 70% dermatology). Respondents from internal medicine programs agreed more strongly with both statements than respondents from dermatology programs (P =.001). Dedicated evidence-based curricula were in place at significantly more internal medicine programs (50 [71%] of 70) than dermatology programs (20 [23%] of 86) (P<.001). Curricula at internal medicine programs offered significantly more evidence-based medicine training sessions (24 vs 6; P<.001) and biostatistics sessions (10 vs 2.3; P =.03), and internal medicine programs more frequently evaluated the curricula using clinical question applications (56% vs 30%; P =.04). Despite favorable attitudes toward evidence-based dermatology, compared with internal medicine programs, dedicated evidence-based training is underdeveloped in dermatology programs.

National survey of internal medicine residency program directors regarding problem residents.

Internal medicine residency training is demanding and residents can experience a wide variety of professional and personal difficulties. A problem resident is defined by the American Board of Internal Medicine as "a trainee who demonstrates a significant enough problem that requires intervention by someone of authority." Data are sparse regarding identification and management of such residents. To gain more understanding of the prevalence, identification, management, and prevention of problem residents within US internal medicine residency programs. Mailed survey of all 404 internal medicine residency program directors in the United States in October 1999, of whom 298 (74%) responded. Prevalence of problem residents; type of problems encountered; factors associated with identification and management of problem residents. The mean point prevalence of problem residents during academic year 1998-1999 was 6.9% (SD, 5.7%; range, 0%-39%), and 94% of programs had problem residents. The most frequently reported difficulties of problem residents were insufficient medical knowledge (48%), poor clinical judgment (44%), and inefficient use of time (44%). Stressors and depression were the most frequently identified underlying problems (42% and 24%, respectively). The most frequent processes by which problem residents were discovered included direct observation (82%) and critical incidents (59%). Chief residents and attending physicians most frequently identified problem residents (84% and 76%, respectively); problem residents rarely identified themselves (2%). Many program directors believed that residents who are from an underrepresented minority, are international medical graduates, or are older than 35 years are at increased risk of being identified as a problem resident (P<.05). Program directors believed that frequent feedback sessions (65%) and an assigned mentor for structured supervision (53%) were the most helpful interventions. Nearly all internal medicine residency programs in this sample had problem residents, whose presenting characteristics and underlying issues were diverse and complex. JAMA. 2000;284:1099-1104