American Board Of Family Medicine Research Articles

The Gender Wage Gap Among Early-Career Family Physicians.

Numerous studies have documented salary differences between male and female physicians. For many specialties, this wage gap has been explored by controlling for measurable factors that influence pay such as productivity, work-life balance, and practice patterns. In family medicine where practice activities differ widely between physicians, it is important to understand what measurable factors may be contributing to the gender wage gap, so that employers and policymakers and can address unjust disparities. We used data from the 2017 to 2020 American Board of Family Medicine (ABFM) National Graduate Survey (NGS) which is administered to family physicians 3 years after residency (n = 8608; response rate = 63.9%, 56.2% female). The survey collects clinical income and practice patterns. Multiple linear regression analysis was performed, which included variables on hours worked, degree type, principal professional activity, rural/urban, and region. Although early-career family physician incomes averaged $225,278, female respondents reported incomes that were $43,566 (17%) lower than those of male respondents (P = .001). Generally, female respondents tended toward lower-earning principal professional activities and US regions; worked fewer hours (2.9 per week); and tended to work more frequently in urban settings. However, in adjusted models, this gap in income only fell to $31,804 (13% lower than male respondents, P = .001). Even after controlling for measurable factors such as hours worked, degree type, principal professional activity, population density, and region, a significant wage gap persists. Interventions should be taken to eliminate gender bias in wage determinations for family physicians.

Machine Learning to Identify Clusters in Family Medicine Diplomate Motivations and Their Relationship to Continuing Certification Exam Outcomes: Findings and Potential Future Implications.

The potential for machine learning (ML) to enhance the efficiency of medical specialty boards has not been explored. We applied unsupervised ML to identify archetypes among American Board of Family Medicine (ABFM) Diplomates regarding their practice characteristics and motivations for participating in continuing certification, then examined associations between motivation patterns and key recertification outcomes. Diplomates responding to the 2017 to 2021 ABFM Family Medicine continuing certification examination surveys selected motivations for choosing to continue certification. We used Chi-squared tests to examine difference proportions of Diplomates failing their first recertification examination attempt who endorsed different motivations for maintaining certification. Unsupervised ML techniques were applied to generate clusters of physicians with similar practice characteristics and motivations for recertifying. Controlling for physician demographic variables, we used logistic regression to examine the effect of motivation clusters on recertification examination success and validated the ML clusters by comparison with a previously created classification schema developed by experts. ML clusters largely recapitulated the intrinsic/extrinsic framework devised by experts previously. However, the identified clusters achieved a more equal partitioning of Diplomates into homogenous groups. In both ML and human clusters, physicians with mainly extrinsic or mixed motivations had lower rates of examination failure than those who were intrinsically motivated. This study demonstrates the feasibility of using ML to supplement and enhance human interpretation of board certification data. We discuss implications of this demonstration study for the interaction between specialty boards and physician Diplomates.

Variation in Practice Patterns of Early- and Later-Career Family Physicians.

Understanding how physicians' practice patterns change over a career is important for workforce and medical education planning. This study examined trends in self-reported practice activity among early- and later-career stage family physicians (FPs). Data on early career FPs came from the American Board of Family Medicine's National Graduate Survey (NGS) and on later career FPs from its Continuous Certification Questionnaire (CCQ). Both cohorts could complete the Practice Demographic Survey (PDS) 3 years later. Longitudinal cohorts were from 2016 to 2019 and 2017 to 2020, respectively. All surveys included identical items on scope of practice, practice type, organization, and location. We characterized physicians as outpatient continuity only, outpatient and inpatient care (mixed practice), and no outpatient continuity (for example, hospitalist). We conducted repeated cross-sectional and longitudinal analysis of practice type. Our sample included 8,492 NGS and 30,491 CCQ FPs. In both groups, the vast majority provided outpatient continuity of care (77% to 81%). Approximately 25% of NGS had a mixed practice compared with approximately 16% of the CCQ group. The percent of FPs who had a mixed practice declined in both groups (34.21% to 27.10% and 23.88% to 19.33%). In both groups, physicians with higher odds of leaving mixed practice were in metropolitan counties or changed practice types. Although early-career FPs more frequently reported providing both inpatient and outpatient care and serving as hospitalists compared with later-career FPs, both groups had a decline in frequency of providing mixed practice. This change after only 3 years in practice has significant implications for patient care and medical education.

Impact of Service-Based Student Loan Repayment Program on the Primary Care Workforce.

As the average level of medical education indebtedness rises, physicians look to programs such as Public Service Loan Forgiveness (PSLF) and National Health Service Corps (NHSC) to manage debt burden. Both represent service-dependent loan repayment programs, but the requirements and program outcomes diverge, and assessing the relative uptake of each program may help to inform health workforce policy decisions. We sought to describe variation in the composition of repayment program participant groups and measure relative impact on patient access to care. In this bivariate analysis, we analyzed data from 10,677 respondents to the American Board of Family Medicine's National Graduate Survey to study differences in loan repayment program uptake as well as the unique participant demographics, scope of practice, and likelihood of practicing with a medically underserved or rural population in each program cohort. The rate of PSLF uptake tripled between 2016 and 2020, from 7% to 22% of early career family physicians, while NHSC uptake remained static at 4% to 5%. Family physicians reporting NHSC assistance were more likely than those reporting PSLF assistance to come from underrepresented groups, demonstrated a broader scope of practice, and were more likely to practice in rural areas (23.3% vs 10.8%) or whole-county Health Professional Shortage Areas (12.5% vs 3.7%) and with medically underserved populations (82.2% vs 24.2%). Although PSLF supports family physicians intending to work in public service, their peers who choose NHSC are much more likely to work in underserved settings. Our findings may prompt a review of the goals of service loan forgiveness programs with potential to better serve health workforce needs.

Maternity Access in Rural America: The Role of Family Physicians in Providing Access to Cesarean Sections.

As an increasing number of rural hospitals close their maternity care units, many of the approximately 28 million reproductive-age women living in rural America do not have local access to obstetric services. We sought to describe the characteristics and distribution of cesarean section-providing family physicians who may provide critical services in maintaining obstetric access in rural hospitals. Using a cross-sectional study design, we linked data from the 2017 to 2022 American Board of Family Medicine's Continuting Certification Questionnaire on provision of cesarean sections as primary surgeon and practice characteristics to geographic data. Logistic regression determined associations with provision of cesarean sections. Of 28,526 family physicians, 589 (2.1%) provided cesarean sections as primary surgeon. Those who provided cesarean sections were more likely to be male (odds ratio (OR) = 1.573, 95% confidence limits (CL) 1.246-1.986), and work in rural health clinics (OR = 2.157, CL 1.397-3.330), small rural counties (OR = 4.038, CL 1.887-8.642), and in counties without obstetrician/gynecologists (OR = 2.163, CL 1.440-3.250). Although few in number, family physicians who provide cesarean sections as primary surgeon disproportionately serve rural communities and counties without obstetrician/gynecologists, suggesting that they provide access to obstetric services in these communities. Policies that support family physician training in cesarean sections and facilitate credentialing of trained family physicians could reverse the trend of closing obstetric units in rural communities and reduce disparities in maternal and infant health outcomes.

Peer Reviewers for theJournal of the American Board of Family Medicinein 2022

Peer Reviewers for the<i>Journal of the American Board of Family Medicine</i>in 2022

Claiming APA and Psychiatry’s Role in the Future of Mental Health

Claiming APA and Psychiatry’s Role in the Future of Mental Health

Variation in Family Physicians' Experiences Across Different Electronic Health Record Platforms: a Descriptive Study.

Electronic health records (EHRs) have been connected to excessive workload and physician burnout. Little is known about variation in physician experience with different EHRs, however. To analyze variation in reported usability and satisfaction across EHRs. Internet-based survey available between December 2021 and October 2022 integrated into American Board of Family Medicine (ABFM) certification process. ABFM-certified family physicians who use an EHR with at least 50 total responding physicians. Self-reported experience of EHR usability and satisfaction. We analyzed the responses of 3358 physicians who used one of nine EHRs. Epic, athenahealth, and Practice Fusion were rated significantly higher across six measures of usability. Overall, between 10 and 30% reported being very satisfied with their EHR, and another 32 to 40% report being somewhat satisfied. Physicians who use athenahealth or Epic were most likely to be very satisfied, while physicians using Allscripts, Cerner, or Greenway were the least likely to be very satisfied. EHR-specific factors were the greatest overall influence on variation in satisfaction: they explained 48% of variation in the probability of being very satisfied with Epic, 46% with eClinical Works, 14% with athenahealth, and 49% with Cerner. Meaningful differences exist in physician-reported usability and overall satisfaction with EHRs, largely explained by EHR-specific factors. User-centric design and implementation, and robust ongoing evaluation are needed to reduce physician burden and ensure excellent experience with EHRs.

Analyzing trends in treatment of acne vulgaris in pregnancy: a retrospective study.

Analyzing trends in treatment of acne vulgaris in pregnancy: a retrospective study.

Differences in Physician Performance and Self-rated Confidence on High- and Low-Stakes Knowledge Assessments in Board Certification.

Evidence links assessment to optimal learning, affirming that physicians are more likely to study, learn, and practice skills when some form of consequence ("stakes") may result from an assessment. We lack evidence, however, on how physicians' confidence in their knowledge relates to performance on assessments, and whether this varies based on the stakes of the assessment. Our retrospective repeated-measures design compared differences in patterns of physician answer accuracy and answer confidence among physicians participating in both a high-stakes and a low-stakes longitudinal assessment of the American Board of Family Medicine. After 1 and 2 years, participants were more often correct but less confident in their accuracy on a higher-stakes longitudinal knowledge assessment compared with a lower-stakes assessment. There were no differences in question difficulty between the two platforms. Variation existed between platforms in time spent answering questions, use of resources to answer questions, and perceived question relevance to practice. This novel study of physician certification suggests that the accuracy of physician performance increases with higher stakes, even as self-reported confidence in their knowledge declines. It suggests that physicians may be more engaged in higher-stakes compared with lower-stakes assessments. With medical knowledge growing exponentially, these analyses provide an example of the complementary roles of higher- and lower-stakes knowledge assessment in supporting physician learning during continuing specialty board certification.

Academic Achievement and Competency in Rural and Urban Family Medicine Residents.

The quality of training in rural family medicine (FM) residencies has been questioned. Our objective was to assess differences in academic performance between rural and urban FM residencies. We used American Board of Family Medicine (ABFM) data from 2016-2018 residency graduates. Medical knowledge was measured by the ABFM in-training examination (ITE) and Family Medicine Certification Examination (FMCE). The milestones included 22 items across six core competencies. We measured whether residents met expectations on each milestone at each assessment. Multilevel regression models determined associations between resident and residency characteristics milestones met at graduation, FMCE score, and failure. Our final sample was 11,790 graduates. First-year ITE scores were similar between rural and urban residents. Rural residents passed their initial FMCE at a lower rate than urban residents (96.2% vs 98.9%) with the gap closing upon later attempts (98.8% vs 99.8%). Being in a rural program was not associated with a difference in FMCE score but was associated with higher odds of failure. Interactions between program type and year were not significant, indicating equal growth in knowledge. The proportions of rural vs urban residents who met all milestones and each of six core competencies were similar early in residency but diverged over time with fewer rural residents meeting all expectations. We found small, but persistent differences in measures of academic performance between rural- and urban-trained FM residents. The implications of these findings in judging the quality of rural programs are much less clear and warrant further study, including their impact on rural patient outcomes and community health.

The Association Between Length of Training and Family Medicine Residents’ Clinical Knowledge: A Report From the Length of Training Pilot Study

The associations between training length and clinical knowledge are unknown. We compared family medicine in-training examination (ITE) scores among residents who trained in 3- versus 4-year programs and to national averages over time. In this prospective case-control study, we compared the ITE scores of 318 consenting residents in 3-year programs to 243 who completed 4 years of training between 2013 through 2019. We obtained scores from the American Board of Family Medicine. The primary analyses involved comparing scores within each academic year according to length of training. We used multivariable linear mixed effects regression models adjusted for covariates. We performed simulation models to predict ITE scores after 4 years of training among residents who underwent only 3 years of training. At baseline postgraduate year-1 (PGY1), the estimated mean ITE scores were 408.5 for 4-year programs and 386.5 for 3-year programs, a 21.9 point difference (95% CI=10.1-33.8). At PGY2 and PGY3, 4-year programs scored 15.0 points higher and 15.6 points higher, respectively. When extrapolating an estimated mean ITE score for 3-year programs, 4-year programs would still score 29.4 points higher (95% CI=15.0-43.8). Our trend analysis revealed those in 4-year programs had a slightly lesser slope increase compared to 3-year programs in the first 2 years. Their drop-off in ITE scores is less steep in later years, though these differences were not statistically significant. While we found significantly higher absolute ITE scores in 4 versus 3-year programs, these increases in PGY2, PGY3 and PGY4 may be due to initial differences in PGY1 scores. Additional research is needed to support a decision to change the length of family medicine training.

Characteristics of Family Physicians Practicing Collaboratively With Behavioral Health Professionals.

Integrating behavioral health into primary care can improve access to behavioral health and patient health outcomes. We used 2017-2021 American Board of Family Medicine continuing certificate examination registration questionnaire responses to determine the characteristics of family physicians who work collaboratively with behavioral health professionals. With a 100% response rate, 38.8% of 25,222 family physicians reported working collaboratively with behavioral health professionals, with those working in independently owned practices and in the South having substantially lower rates. Future research exploring these differences could help develop strategies to support family physicians implement integrated behavioral health to improve care for patients in these communities.

Trends of Geriatric Certification and Practice Patterns of Family Physicians: 1988-2019.

Demand for geriatric care is increasing due to aging population. Trends in maintaining certification in geriatrics are unreported. Our objective was to describe the historic trend of family physicians who certified in geriatric medicine (FPs-GM) since 1988 and to assess differences in practice patterns between FPs-GM and family physicians (FPs). We performed a retrospective descriptive study using administrative data collected by the American Board of Family Medicine (ABFM). The study population was family physicians registering to continue their ABFM certification from 2017 to 2019. Medicare public use billing data was linked to ABFM administrative data on certification history. We used univariate analysis for descriptive analysis and logistic regression to identify contributors of recertification in geriatrics. We identified a total of 3,207 FPs-GM between 1988 and 2019. More than half maintained GM certification since 2009 (57%), with male gender, White race, and urban practice associated with maintaining GM certification; 61% of their patients were older adults. FPs-GM were more likely to be in an academic practice setting with nearly half (53%) also practicing in hospitals or nursing homes. In the adjusted regression model, younger FPs or FPs who treat more older patients were significantly more likely to be recertified in geriatrics whereas other demographics and practice characteristics were not significant. Most FPs who recently earned GM certification tended to retain certification since the required accredited fellowship started in 1995.

From Resident to Diplomate: The Purpose and Process of Becoming Board Certified

To All Family Medicine Residents: Welcome to the Journal of the American Board of Family Medicine ( JABFM )! With this issue, all family medicine residents who have taken the American Board of Family Medicine (ABFM) In-Training Examination become subscribers to the JABFM , which publishes 6 issues

Comparative Ethics of Modern Payment Models

Comparative Ethics of Modern Payment Models

Exploring the Association Between Physician Continuity of Care and Diagnosing Hypertension.

Context. The American Board of Family Medicine was funded by the Gordon Betty Moore Foundation to study the association between physician continuity of care, a clinical quality measure, and its impact on accurate, timely, efficient, and cost-effective diagnosis of target conditions that contribute to cardiovascular disease. In this exploratory analysis, we used electronic health records data from the PRIME registry to examine the association of continuity with factors leading to a hypertension diagnosis. Objective. 1) to determine the rate and timeliness of hypertension diagnosis, 2) to investigate the number of hypertension-level blood pressure (BP) readings in the 12 months prior to the diagnosis, and 3) to explore the association between physician continuity of care and these variables. Study Design and Population Studied. In this cohort study, we created two patient cohorts. Our prospective cohort consisted of patients who had 2 or more BP readings greater than SBP of 130 or DBP of 80 mm Hg in 2017-2018 and who did not have a hypertension diagnosis prior to the date of the second reading. Our retrospective cohort consisted of patients who had a hypertension diagnosis in 2018-2019. Dataset. Electronic health records extracted from the PRIME registry Outcome Measures. The rate of diagnosis was calculated by dividing the number of patients with a hypertension diagnosis by the number of patients whose BP readings exceeded the thresholds for hypertension per clinical guidelines. We investigated the timeliness of diagnosis by counting the average days between the second reading and the diagnosis dates. We also identified the number of hypertension-level BP readings in the past 12 months for patients diagnosed with hypertension. Results. Of 7,615 eligible patients from 4 pilot practices, the rate of hypertension diagnosis varied from 39.6% (solo practice) to 11.5% (large practice). The average days until diagnosis ranged from 142 days (solo practice) to 247 days (medium practice). Among patients diagnosed with hypertension (n=104,727), 25.7% had 0, 39.8% had 1, 14.7% had 2 and 19.7 had 3 or more hypertension-level BP readings in the 12 months prior to the diagnosis. We found no significant association between physician continuity of care and the rate or timeliness of the hypertension diagnosis. Conclusions. Factors leading to a hypertension diagnosis may be influenced more by other unobserved variables than by physician continuity of care.

APA Board Looks to Future of Psychiatry, Importance of Measurement-Based Care

APA Board Looks to Future of Psychiatry, Importance of Measurement-Based Care

Measuring the Value Functions of Primary Care: Physician-Level Continuity of Care Quality Measure.

Care continuity is foundational to the clinician/patient relationship; however, little has been done to operationalize continuity of care (CoC) as a clinical quality measure. The American Board of Family Medicine developed the Primary Care CoC clinical quality measure as part of the Measures That Matter to Primary Care initiative. Using 12-month Optum Clinformatics Data Mart claims data, we calculated the Bice-Boxerman Continuity of Care Index for each patient, which we rolled up to create an aggregate, physician-level CoC score. The physician quality score is the percent of patients with a Bice-Boxerman Index ≥0.7 (70%). We tested validity in 2 ways. First, we explored the validity of using 0.7 as a threshold for patient CoC within the Optum claims database to validate its use for reflecting patient-level continuity. Second, we explored the validity of the physician CoC measure by examining its association with patient outcomes. We assessed reliability using signal-to-noise methodology. Mean performance on the measure was 27.6%; performance ranged from 0% to 100% (n = 555,213 primary care physicians). Higher levels of CoC were associated with lower levels of care utilization. The measure indicated acceptable levels of validity and reliability. Continuity is associated with desirable health and cost outcomes as well as patient preference. The CoC clinical quality measure meets validity and reliability requirements for implementation in primary care payment and accountability. Care continuity is important and complementary to access to care, and prioritizing this measure could help shift physician and health system behavior to support continuity.

Spaced Repetition in a Cohort of Practicing Physicians: Methods and Preliminary Results.

Purpose: Spaced repeated testing over time results in better long-term knowledge retention than repeated study of the same material. It is particularly effective when feedback is provided, initial repetitions occur early, and answering questions requires application of knowledge through use of short-answer or context-rich multiple-choice questions. 1–4 American Board of Medical Specialties boards incorporate longitudinal knowledge assessments in their continuing certification programs, 5 but most have not yet systematically incorporated spaced repetition. The goal of this study is to compare the effect of 5 different spaced repetition strategies on American Board of Family Medicine (ABFM) Diplomate knowledge retention and transfer of knowledge from one clinical scenario to another. We report the study methods and will report preliminary results from this ongoing work. Approach: Physicians participating in the ABFM Continuing Knowledge Self-Assessment (CKSA) receive 25 questions per quarter. After answering each question, they rate their confidence in their answer on a 6-point scale before receiving feedback, an educational critique, and list of appropriate references. Twenty-six thousand two hundred fifty-five family physicians who completed the CKSA in the fourth quarter of 2020 (baseline period) were eligible for study inclusion. Participants were randomized to a control group or 1 of 5 spaced repetition conditions over the subsequent 5 calendar quarters (January 1, 2021, to March 31, 2022). Control group participants received no repeated questions during this time period. Participants in the other 5 groups received 6 questions repeated either once or twice; the interval between repetitions differed between each group. Incorrectly answered baseline questions were prioritized for spaced repetition—those answered extremely confidently received highest priority, with decreasing priority for those questions answered with lesser degrees of confidence. If necessary, correctly answered questions could then be selected for spaced repetition, with higher priority for questions not answered confidently (e.g., “guesses”) than those answered more confidently. Physicians remain in the study unless opting out or failing to complete all 25 CKSA questions in a quarter in which they were scheduled to receive repeated questions. In quarter 6 of the study, all remaining participants will receive their 6 repeated questions. The primary analysis will compare differences in enduring learning (the percentage of incorrectly answered baseline questions subsequently answered correctly during quarter 6) between physicians receiving any spaced repetition questions in quarters 1–5 compared with the control group, who will have gone 18 months without seeing repeated questions. Subgroup analyses will compare differences in learning between physicians receiving one repetition compared with those receiving 2, differences in learning between the 2 single-spaced repletion strategies, and differences in learning between the 3 double-spaced repetition strategies. Cloned questions emphasize the same learning points as the original (base) question and are designed to measure the transfer of knowledge from one clinical situation to another. In quarter 8 of the study, physicians in all groups will receive questions cloned from their selected baseline questions. We will then examine the effects of different numbers and intervals of spaced repetition on transfer of knowledge from one clinical scenario to another. Outcomes: We will present data on participant retention rates through the first 6 study quarters, and preliminary analysis of learning in the different groups. Significance: To date, spaced repetition has not been systematically evaluated in large cohorts of practicing physicians. This study can inform the development and utilization of spaced repetition strategies by health professions educators across the continuum. The results of this study will help ABFM determine a strategy for and the potential added value of spaced repetition in the lifelong learning and self-assessment component of continuous certification. Acknowledgments: The authors wish to thank Zachary Morgan, Emily Banik, Matt Wilhoite, and Prasad Chodavarapu for their assistance with data acquisition and analysis.