In-Service Training Examination Research Articles

Evaluating the Performance of ChatGPT, Gemini, and Bing Compared with Resident Surgeons in the Otorhinolaryngology In-service Training Examination.

Large language models (LLMs) are used in various fields for their ability to produce human-like text. They are particularly useful in medical education, aiding clinical management skills and exam preparation for residents. To evaluate and compare the performance of ChatGPT (GPT-4), Gemini, and Bing with each other and with otorhinolaryngology residents in answering in-service training exam questions and provide insights into the usefulness of these models in medical education and healthcare. Eight otorhinolaryngology in-service training exams were used for comparison. 316 questions were prepared from the Resident Training Textbook of the Turkish Society of Otorhinolaryngology Head and Neck Surgery. These questions were presented to the three artificial intelligence models. The exam results were evaluated to determine the accuracy of both models and residents. GPT-4 achieved the highest accuracy among the LLMs at 54.75% (GPT-4 vs. Gemini p=0.002, GPT-4 vs. Bing p<0.001), followed by Gemini at 40.50% and Bing at 37.00% (Gemini vs. Bing p=0.327). However, senior residents outperformed all LLMs and other residents with an accuracy rate of 75.5% (p<0.001). The LLMs could only compete with junior residents. GPT- 4 and Gemini performed similarly to juniors, whose accuracy level was 46.90% (p=0.058 and p=0.120, respectively). However, juniors still outperformed Bing (p=0.019). The LLMs currently have limitations in achieving the same medical accuracy as senior and mid-level residents. However, they outperform in specific subspecialties, indicating the potential usefulness in certain medical fields.

An Update on the Independent Plastic Surgery Match (2019-2022): Trends, Predictors, and Program Leaders' Perspectives.

A previous study by the authors noted a decline in independent plastic surgery residency programs and rising applicant participation. This study provides updates on match trends and influential predictors, and gathers program leaders' views on the future of the independent track. Match data (2019-2022) were obtained from the San Francisco match after American Council of Educators in Plastic Surgery approval. Variables influencing match success were analyzed, and program leaders were surveyed about desirable applicant traits and program trajectories. From 2019 to 2022, 243 of 428 applicants matched. Programs and positions declined by 10% and 9.5%, respectively. Applicants rose to 42.3%, but match rates fell from 82% to 56%. Osteopathic graduates doubled, whereas international graduates increased to 53.8%. Successful matches were associated with US allopathic medical school graduates, university-affiliated general surgery residencies, eight or more interviews, United States Medical Licensing Examination scores greater than 230, and high post graduate year (PGY)1-3 American Board of Surgery In-service Training Examination scores (PGY1-64.7%, PGY2-61.2%, PGY3-60.7%; P < 0.05). Of surveyed programs, 55.6% aimed to continue running the independent track in the next year. Conversely, 7.4% planned to discontinue in the next year, 22.2% within 2-5 years, 7.4% within the next decade, and 7.4% were unsure. Although support for the independent plastic surgery track remains, program participation diminishes as applicant interest increases, intensifying match challenges. Increasing number of interviews improves match potential. Program leaders display varied commitments, with looming plans for some programs to discontinue offering this track. Applicant evaluation pivots on strong recommendations, research, and test scores.

Unveiling the Potential of AI in Plastic Surgery Education: A Comparative Study of Leading AI Platforms' Performance on In-training Examinations.

Within the last few years, artificial intelligence (AI) chatbots have sparked fascination for their potential as an educational tool. Although it has been documented that one such chatbot, ChatGPT, is capable of performing at a moderate level on plastic surgery examinations and has the capacity to become a beneficial educational tool, the potential of other chatbots remains unexplored. To investigate the efficacy of AI chatbots in plastic surgery education, performance on the 2019-2023 Plastic Surgery In-service Training Examination (PSITE) was compared among seven popular AI platforms: ChatGPT-3.5, ChatGPT-4.0, Google Bard, Google PaLM, Microsoft Bing AI, Claude, and My AI by Snapchat. Answers were evaluated for accuracy and incorrect responses were characterized by question category and error type. ChatGPT-4.0 outperformed the other platforms, reaching accuracy rates up to 79%. On the 2023 PSITE, ChatGPT-4.0 ranked in the 95th percentile of first-year residents; however, relative performance worsened when compared with upper-level residents, with the platform ranking in the 12th percentile of sixth-year residents. The performance among other chatbots was comparable, with their average PSITE score (2019-2023) ranging from 48.6% to 57.0%. Results of our study indicate that ChatGPT-4.0 has potential as an educational tool in the field of plastic surgery; however, given their poor performance on the PSITE, the use of other chatbots should be cautioned against at this time. To our knowledge, this is the first article comparing the performance of multiple AI chatbots within the realm of plastic surgery education.

Does Game-Based Learning Promote Academic Engagement Among Millennial Oral and Maxillofacial Surgery Residents?

BackgroundHouse staff participating in surgical residency programs are often comprised of adult learners from the millennial generation (Gen Y). With the increasing gap in both age and learning styles between these residents and their educators, their educators are struggling to keep them academically engaged. PurposeThe purpose of this study was to measure the association between implementing a digital online Jeopardy!® (Sony Pictures Studios, Culver City, CA) style game (digital game) (Factile© Solace Creative, LLC, Melbourne Beach, FL) into oral maxillofacial surgery (OMS) resident didactic training and Oral and Maxillofacial Surgery In-service Training Examination (OMSITE) scores. Study Design, Setting, SampleThis study was a retrospective cohort study conducted at The New York Presbyterian Hospital/Weill Cornell Medicine (NYP/WCM). OMS residents who took the OMSITE exam were included in the study. Exclusion criteria included OMS residents who did not take the OMSITE in a given year. Independent VariableThe independent variable was the timing of the implementation of the digital game, divided into before and after implementation. Main Outcome VariablesThe primary outcome variable was OMSITE scores. CovariatesCovariates included demographics (age, gender, race), year of training, and number of examination attempts. AnalysesDescriptive and bivariate statistics included Fisher's exact test and Wilcoxon rank sum test. Linear mixed modeling was performed to take into account multiple observations per participants. ResultsThe sample composed of 14 resident subjects with a median age of 27.5 [27.0, 28.7]. Females represented 29% of the cohort. Seventy-one percent of the participants were PGY-1. The median (interquartile range [IQR]) OMSITE score pre-implementation: 61 (48,71) and post-implementation: 79 (68,87). On average, the OMSITE scores, improved significantly following the implementation of this study modality (p < 0.001). ConclusionsDigital games may be an effective learning tool to prepare residents for OMSITE by promoting academic engagement.

Disparities in Mentorship and Implications for US Surgical Resident Education and Wellness

Many surgeons cite mentorship as a critical component of training. However, little evidence exists regarding factors associated with mentorship and the influence of mentorship on trainee education or wellness. To evaluate factors associated with surgical trainees' perceptions of meaningful mentorship, assess associations of mentorship with resident education and wellness, and evaluate programmatic variation in mentorship. A voluntary, anonymous survey was administered to clinically active residents in all accredited US general surgery residency programs following the 2019 American Board of Surgery In-Service Training Examination. Data were analyzed from July 2019 to July 2022. Residents were asked, "Do you have a mentor who genuinely cares about you and your career?" Resident characteristics associated with report of meaningful mentorship were evaluated with multivariable logistic regression. Associations of mentorship with education (clinical and operative autonomy) and wellness (career satisfaction, burnout, thoughts of attrition, suicidality) were examined using cluster-adjusted multivariable logistic regression controlling for resident and program factors. Residents' race and ethnicity were self-identified using US census categories (American Indian or Alaska Native, Asian, Black or African American, Native Hawaiian or Other Pacific Islander, and White), which were combined and dichotomized as non-Hispanic White vs non-White or Hispanic. A total of 6956 residents from 301 programs completed the survey (85.6% response rate); 6373 responded to all relevant questions (2572 [40.3%] female; 2539 [39.8%] non-White or Hispanic). Of these, 4256 (66.8%) reported meaningful mentorship. Non-White or Hispanic residents were less likely than non-Hispanic White residents to report meaningful mentorship (odds ratio [OR], 0.81, 95% CI, 0.71-0.91). Senior residents (postgraduate year 4/5) were more likely to report meaningful mentorship than interns (OR, 3.06; 95% CI, 2.59-3.62). Residents with meaningful mentorship were more likely to endorse operative autonomy (OR, 3.87; 95% CI, 3.35-4.46) and less likely to report burnout (OR, 0.52; 95% CI, 0.46-0.58), thoughts of attrition (OR, 0.42; 95% CI, 0.36-0.50), and suicidality (OR, 0.47; 95% CI, 0.37-0.60) compared with residents without meaningful mentorship. One-third of trainees reported lack of meaningful mentorship, particularly non-White or Hispanic trainees. Although education and wellness are multifactorial issues, mentorship was associated with improvement; thus, efforts to facilitate mentorship are needed, especially for minoritized residents.

Comparing Graduating Plastic Surgery Residents' Case Logs With Accreditation Council for Graduate Medical Education Requirements, Content at National Meetings, and In-Service Examination Test Items.

The importance of adaptable and up-to-date plastic surgery graduate medical education (GME) has taken on new meaning amidst accelerating surgical innovation and increasing calls for competency-based training standards. We aimed to examine the extent to which the procedures plastic surgery residents perform, as represented in case log data, align with 2 core standardized components of plastic surgery GME: ACGME (Accreditation Council for Graduate Medical Education) minimum procedure count requirements and the PSITE (Plastic Surgery In-Service Training Examination). We also examined their alignment with procedural representation at 2 major plastic surgery meetings. Nine categories of reconstructive and aesthetic procedures were identified. Three-year averages for the number of procedures completed in each category by residents graduating in 2019-2021 were calculated from ACGME national case log data reports. The ACGME procedure count minimum requirements were also ascertained. The titles and durations of medical programming sessions scheduled for Plastic Surgery The Meeting (PSTM) 2022 and the Plastic Surgery Research Council (PSRC) Annual Meeting 2022 were retrieved from online data. Finally, test items from the 2020 to 2022 administrations of the PSITE were retrieved. Conference sessions and test items were assigned to a single procedure category when possible. Percent differences were calculated for comparison. The distribution of procedures on plastic surgery resident case logs differs from those of the major mechanisms of standardization in plastic surgery GME, in-service examination content more so than ACGME requirements. Meeting content at PSTM and PSRC had the largest percent differences with case log data, with PSTM being skewed toward aesthetics and PSRC toward reconstructive head and neck surgery. The criteria and standards by which plastic surgery residents are evaluated and content at national meetings differ from the procedures they actually complete during their training. Although largely reflecting heterogeneity of the specialty, following these comparisons will likely prove useful in the continual evaluation of plastic surgery residency training, especially in the preparation of residents for the variety of training and practice settings they pursue.

Hand Surgery Questions on the Plastic Surgery In-service Training Examination: Analysis of Content and References

Background: The Plastic Surgery In-service Training Examination (PSITE) provides residents and faculty with an objective evaluation of hand surgery knowledge during plastic surgery residency training. The purpose of this study was to understand tested hand surgery concepts and references to optimize study efforts during plastic surgery residency. Methods: We reviewed hand surgery questions on 6 consecutive PSITEs (2016-2021). Questions were classified by taxonomy and clinical subject area. Answer references were quantified by source and year of publication. Results: A total of 235 questions tested hand surgery (16% of all PSITE questions) and 60 questions had an associated image (26%). Questions required direct level I—recall (37%), level II—interpretation (28%), and level III—medical decision-making skills (35%). The most frequently tested hand surgery topics were trauma (31%), reconstruction (20%), and functional problems (17%). There were 667 references to 130 unique journals. Journal of Hand Surgery (American volume), 34% and Plastic and Reconstructive Surgery (17%) were the highest yield primary sources. The median lag from publication to PSITE was 7 years (interquartile range, 7 years) with a mode of 2 years. Green’s Operative Hand Surgery was the most referenced textbook (54% of textbook references). Conclusions: This study creates an objective benchmark for hand surgery knowledge training during plastic surgery residency. Efforts focused on the most commonly tested topics and references can enhance resident preparation in hand surgery.

Reply to commentary on GPT-4 and plastic surgery inservice training examination

Reply to commentary on GPT-4 and plastic surgery inservice training examination

Applying GPT-4 to the Plastic Surgery Inservice Training Examination

The recent introduction of Generative Pre-trained Transformer (GPT)-4 has demonstrated the potential to be a superior version of ChatGPT-3.5. According to many, GPT-4 is seen as a more reliable and creative version of GPT-3.5. In conjugation with our prior manuscript, we wanted to determine if GPT-4 could be exploited as an instrument for plastic surgery graduate medical education by evaluating its performance on the Plastic Surgery Inservice Training Examination (PSITE). Sample assessment questions from the 2022 PSITE were obtained from the American Council of Academic Plastic Surgeons website and manually inputted into GPT-4. Responses by GPT-4 were qualified using the properties of natural coherence. Incorrect answers were stratified into the consequent categories: informational, logical, or explicit fallacy. From a total of 242 questions, GPT-4 provided correct answers for 187, resulting in a 77.3% accuracy rate. Logical reasoning was utilized in 95.0% of questions, internal information in 98.3%, and external information in 97.5%. Upon separating the questions based on incorrect and correct responses, a statistically significant difference was identified in GPT-4's application of logical reasoning. GPT-4 has shown to be more accurate and reliable for plastic surgery resident education when compared to GPT-3.5. Users should look to utilize the tool to enhance their educational curriculum. Those who adopt the use of such models may be better equipped to deliver high-quality care to their patients.

Performance of ChatGPT on the Plastic Surgery Inservice Training Examination.

Developed originally as a tool for resident self-evaluation, the Plastic Surgery Inservice Training Examination (PSITE) has become a standardized tool adopted by Plastic Surgery residency programs. The introduction of large language models (LLMs), such as ChatGPT (OpenAI, San Francisco, CA), has demonstrated the potential to help propel the field of Plastic Surgery. The authors of this study wanted to assess whether or not ChatGPT could be utilized as a tool in resident education by assessing its accuracy on the PSITE. Questions were obtained from the 2022 PSITE, which was present on the American Council of Academic Plastic Surgeons (ACAPS) website. Questions containing images or tables were carefully inspected and flagged before being inputted into ChatGPT. All responses by ChatGPT were qualified utilizing the properties of natural coherence. Responses that were found to be incorrect were divided into the following categories: logical, informational, or explicit fallacy. ChatGPT answered a total of 242 questions with an accuracy of 54.96%. The software incorporated logical reasoning in 88.8% of questions, internal information in 95.5% of questions, and external information in 92.1% of questions. When stratified by correct and incorrect responses, we determined that there was a statistically significant difference in ChatGPT's use of external information (P < .05). ChatGPT is a versatile tool that has the potential to impact resident education by providing general knowledge, clarifying information, providing case-based learning, and promoting evidence-based medicine. With advancements in LLM and artificial intelligence (AI), it is possible that ChatGPT may be an impactful tool for resident education within Plastic Surgery.

Delaying the Fellowship Start Date in Obstetrics and Gynecology.

To evaluate residents planning fellowship, their preferences for fellowship start date, and the acceptability of resultant gaps in pay and insurance coverage. A survey was conducted during the 2022 in-service training examination querying obstetrics and gynecology residents about their desire to pursue fellowship, their preferred fellowship start date (understanding the salary gap), and the acceptability of a medical insurance gap. Survey analysis of respondents planning to pursue fellowship demonstrated that, acknowledging the pay gap that would occur, 93.9% preferred a fellowship start date after July 1, with the majority (65.1%, 593/911) preferring an August 1 fellowship start date. Most respondents (87.7%, 798/910) found the potential resultant gap in medical insurance coverage acceptable. Survey data showed that racial and ethnic identity was not a determining factor in either of these issues. The majority of current residents planning to pursue fellowship prefer a delayed fellowship start date, even if it means a gap in salary and insurance coverage. The results of this study, requested by a specialty-wide, consensus-building workgroup, informed a statement signed by the majority (88.9%) of workgroup constituents supporting an August 1 clinical fellowship start date.

Certification by the American Board of Oral and Maxillofacial Surgery: Residency to Retirement.

The American Board of Oral and Maxillofacial Surgery (ABOMS) has been serving the specialty since 1946. The ABOMS frequently reviews its strategic plan, mission, and vision. The board administers 4 examinations (the Oral and Maxillofacial Surgery In-service Training Examination, the Qualifying Examination, the Oral Certifying Examination, and Certificates of Added Qualifications in Head and Neck Oncologic and Reconstructive Surgery and Pediatric Craniomaxillofacial Surgery) and also oversees the Certification Maintenance process for diplomates. The members of the Examination Committee and directors are volunteers who create, validate, and deliver examination content for the various examinations by the ABOMS.

Creating a Spaced Repetition Model to Supplement Education in Plastic Surgery.

Summary:Plastic surgery encompasses a wide spectrum of material involving comprehensive anatomy, physiology, microbiology, biomaterials, complex surgical techniques, and many nonsurgical interventions. The core disciplines overlap extensively with the foundational knowledge of many other surgical specialties. With the ever-expanding knowledge base required to become a competent plastic surgeon, spaced repetition is a means to optimize learning in plastic surgery and help trainees master new concepts while retaining other facts that are easily forgotten. Platforms for spaced repetition are user-friendly and can be synchronized between devices to streamline progress and make efficient use of the limited free time that exists throughout the workday. Flashcard decks can be imported to these platforms to follow a spaced repetition algorithm. Currently, no publicly available comprehensive deck exists for education in plastic and reconstructive surgery. Creation of flashcard decks covering lectures, textbooks, or old examination questions can reinforce the foundational concepts of our field. Additionally, there is potential to improve resident performance on the Plastic Surgery In-service Training Examination. Once created, this comprehensive flashcard deck can be distributed to plastic surgery residency programs to pave the way for a uniform curriculum.

The Plastic Surgery In-service Training Examination: An In-depth Reference Analysis.

Background:The goal of this study was to characterize the references provided as supporting evidence of the Plastic Surgery In-service Training Examination (PSITE) syllabi, including those on the novel “core surgical principles” section.Methods:We analyzed the references from five consecutive PSITE Examination syllabi (2016–2020). We collected the following information from each question: question section, total number of references, and source of publication of each reference.Results:We analyzed 1250 questions and 3436 references. Plastic and Reconstruction Surgery was overall the most frequently referenced journal followed by Journal of Hand Surgery (American Volume) and Annals of Plastic Surgery. The most commonly referenced textbooks were Plastic Surgery (by Neligan), Green’s Operative Hand Surgery, and Grabb and Smith’s Plastic Surgery. Regarding the “core surgical principles” section, Plastic and Reconstruction Surgery remained the most frequently cited journal, followed by the Journal of the American Medical Association, New England Journal of Medicine, Annals, and Aesthetic Surgery Journal. “Core surgical principles” contained the largest number of unique journals (n = 209) among all test sections. Within the “core” section, Statistics in Medicine was the most frequently referenced textbook followed by Grabb and Smith’s Plastic Surgery.Conclusions:The main plastic surgery texts and literature were used to support approximately half of the answers within the “core surgical principles” section. The references within this section originated from the largest number of different journals, thus highlighting the breadth and variety of this content and the challenges in preparing for this section.

The Plastic Surgery In-service Training Examination: An In-depth Reference Analysis

INTRODUCTION: The “core surgical principles” section was added to the Plastic Surgery In-Service Training Exam (PSITE) in 2016. To our knowledge, assessment of the “core surgical principles” references has not been performed previously. The main objective is to characterize the references provided as supporting evidence of the PSITE syllabi, including those on the novel “core surgical principles” section. In addition to analyzing the newly instituted “core principle section,” the secondary aims of this study are to determine (1) the most frequently referenced journal and textbooks, (2) the publication lag of journal and textbook references, and (3) the impact factors for referenced journal articles in five consecutive PSITE syllabi. It is our hope that such an analysis will allow for better preparation for the examination and more relevant focus of educational efforts on the part of residents, fellows, and program directors. METHODS: We analyzed the references from five consecutive PSITE syllabi (2016–2020). We collected the following information from each question: year of the examination, question section, the total number of references per question, source of publication of each reference, and year of publication of each reference. We assessed the top journals and textbooks that provided supporting references for the questions. Mean and median were used to summarize continuous variables, while percentages and proportions were used to present categorical data. To compare the JIF and publication lag among the sections and examination years, we used the Kruskal–Wallis one-way analysis of variance test. A P value of <0.05 was considered statistically significant. RESULTS: We analyzed 1250 questions and 3436 references. Plastic and Reconstruction Surgery (PRS) was overall the most frequently referenced journal followed by Journal of Hand Surgery (American Volume) and Annals of Plastic Surgery. The most commonly referenced textbooks were Plastic Surgery (by Neligan), Green’s Operative Hand Surgery, and Grabb and Smith’s Plastic Surgery. Regarding the “core surgical principles” section, PRS remained the most frequently cited journal, followed by the Journal of the American Medical Association (JAMA), New England Journal of Medicine (NEJM), Annals, and Aesthetic Surgery Journal. “Core surgical principles” contained the largest number of unique journals (n = 209) among all test sections. Within the “core” section, Statistics in Medicine was the most frequently referenced textbook followed by Grabb and Smith’s Plastic Surgery, Guyton and Hall Textbook of Medical Physiology, Plastic Surgery (by Neligan), Principles and Practice of Pediatric Plastic Surgery, and Essential Medical Statistics. There were significant differences in JIF between the sections (P < 0.0001) with references in “core surgical principles” having the highest mean JIF (9.6 ± 19.5). The median journal publication lag for the all references was 6 years (IQR, 3–10). CONCLUSIONS: The main plastic surgery texts and literature were used to support approximately half of the answers within the “core surgical principles” section. The references within this section originated from the largest number of different journals, thus highlighting the breadth and variety of this content and the challenges in preparing for this section.

Imposter Syndrome in Surgical Trainees: Clance Imposter Phenomenon Scale Assessment in General Surgery Residents

Imposter syndrome occurs when high-achieving individuals have a pervasive sense of self-doubt combined with fear of being exposed as a fraud, despite objective measures of success. This threatens mental health and well-being. The prevalence and severity of imposter syndrome has not been studied among general surgery residents on a large scale. The primary outcomes of this study were the prevalence and severity of imposter syndrome. The Clance Impostor Phenomenon Scale was administered to residents at 6 academic general surgery residency programs. Multivariable analysis was performed to identify significant differences among groups and predictive characteristics of imposter syndrome. One hundred and forty-four residents completed the assessment (response rate 46.6%; 47.2% were male). Only 22.9% had "none to mild" or "moderate" imposter syndrome. A majority (76%) had "significant" or "severe" imposter syndrome. There were no significant differences in mean scores among male and female residents (p= 0.69). White residents had a mean score of 71.3 and non-White residents had a mean score of 68.3 (p= 0.24). There was no significant difference between PGY1 to PGY5 or research residents (p= 0.72). There were no significant differences based on US Medical Licensing Examination or American Board of Surgery In-Service Training Examination scores (p= 0.18 and p= 0.37, respectively). Imposter syndrome is prevalent among general surgery residents, with 76% of residents reporting either significant or severe imposter syndrome. There were no predictive characteristics based on demographics or academic achievement, suggesting that there is something either inherent to those choosing general surgery training or the general surgery training culture that leads to such substantive levels of imposter syndrome.

The RITE of Passage: Learning Styles and Residency In-Service Training Examination (RITE) Scores.

IntroductionThe objective of the pilot study was to determine the association between learning preferences and improvement in the American Academy of Neurology Residency In-Service Training Examination (RITE) scores from postgraduate year 2 (PGY-2) to postgraduate year 3 (PGY-3) in neurology residents.MethodsNeurology residents at the University of Florida were approached to participate, and their consent was obtained. VARK inventory, representing four modalities (visual, aural, read/write, kinesthetic) of learning preferences, was completed by participants. Participants could pick more than one modality. The number of responses in each sensory domain was recorded, with higher numbers indicating stronger preference. Residents’ performance on the RITE was recorded for PGY-2 and PGY-3.ResultsSeventeen residents completed the VARK inventory and 16 had data for RITE. Residents demonstrated overall positive change in RITE from PGY-2 to PGY-3 (mean change = 6%; 95%CI: 4%, 9%). The median number of responses was highest for the kinesthetic domain (median = 7, range = 1-12), followed by visual (median = 6, range = 2-12), aural (median = 4, range = 1-10), and read/write (median = 4, range = 1-10). Among VARK domains, the number of responses in read/write had the strongest correlation with mean change in RITE performance from PGY-2 to PGY-3 (r = 0.45; 95%CI: -0.08, 0.78); residents in the high read/write group (number of response above median) had greater mean change in RITE performance (9%; 95%CI: 6%, 12%) while those in the low read/write group showed little to no increase in RITE from PGY-2 to PGY-3 (2%; 95%CI: -1%, 6%).ConclusionsHigher VARK survey responses in the read/write domain were related to greater change in RITE scores from PGY-2 to PGY-3. These findings seem intuitively obvious considering the format of the RITE. These pilot data permit further investigation of individual resident learning preference and how it relates to test performance. By understanding a resident’s learning style, both educators and the resident will have an awareness of areas that need to be improved to be successful, which may be via remedial curricula and self-study activities.

How Are Residents Trained in Neuropathology? A Survey of Neurology Program Directors in the United States.

To understand the current state of neurology residents training in neuropathology, we electronically distributed a 16-item survey to 150 adult and 70 child neurology program directors (PDs). The survey inquired about their program characteristics, neuropathology curriculum and assessment methods, trainee performance, and attitudes. Descriptive analysis was used to summarize categorical variables as frequencies and percentages and continuous as means and standard deviations. We conducted a series of Mann-Whitney U and Fisher's exact tests to evaluate differences between various program characteristics. Sixty-four (29%) PDs responded to the survey, including 45 (30%) adult and 19 (27%) child neurology PDs. Thirty-one programs required a dedicated neuropathology rotation. The majority (92%) used the Residency In-Service Training Examination (RITE) to assess trainee's knowledge. Approximately 86% of the PDs agreed that neuropathology is essential and a defined curriculum is necessary during residency training. There was no difference in the RITE scores between programs. We conclude that a neuropathology rotation was felt to be essential even though the RITE scores did not differ between programs with and without a dedicated rotation. Alternative evaluation and training methods may need consideration. A future survey of all the stakeholders may be required to thoroughly understand and disseminate the neuropathology education well.

Milestones on the Plastic Surgery In-Service Training Examination

The Plastic Surgery Milestones Project was implemented in 2014 to establish standards for competency based resident education. In restructuring educational activities under the Milestones, various pedagogical tools have been revised. However, these standards have not yet been applied to the Plastic Surgery In-Service Training Examination. The purpose of this study was to determine the representation of the various components of the Plastic Surgery Milestones Project, on the In-Service Training Examination. All questions from the 2014 - 2018 In-Service Examinations were evaluated within the framework of the current Plastic Surgery Milestones. Using content analysis, each Examination question was mapped to a single Milestone. Descriptive analysis of Milestone subject area and Core Competency breakdown, as well as year to year trends, were performed. Of the 1,150 questions analyzed, there was an unequal representation of individual Milestones (0-7.4%). Of the 36 Plastic Surgery Milestones, 10 represented more than 50% of the PSITEs while 8 Milestones had less than 1% representation. The most common subject area was Head and Neck (12.7%) and least common was Reconstruction of the Trunk and Perineum. Among Core Competencies, more than half (50.4%) tested Patient Care while Interpersonal and Communication Skills was the lowest represented, 0.2%. The Plastic Surgery In-Service Examination tests a variable proportion of Milestones. Currently, the PSITE is not well integrated with competency based education in spite of a shift towards such a training model. Going forward, the PSITE may include an associated Milestone with each question in order to better incorporate Competencies into this important annual evaluation metric.

Education Research: Neuroradiology curriculum in neurology residency training programs: How we teach neuroimaging.

To better understand how the essential skill of interpreting various neuroimaging studies is taught to neurology residents in Accreditation Council for Graduate Medical Education (ACGME)-accredited training programs. A 22-question survey was sent electronically to 150 ACGME adult neurology program directors. We collected data regarding the presence of a neuroimaging curriculum, frequency of review sessions and testing, resource availability, and program director confidence in neuroimaging skills of graduating residents. We collected average scores on the neuroimaging section of the Resident In-service Training Examination of graduating residents for the past 3 years, which we attempted to correlate with resource availability. One-third of neurology residency programs do not have a neuroimaging curriculum, and half of training programs do not require a neuroimaging rotation. On average, trainees spend 1 hour per week reviewing imaging with radiologists. Program directors believed trainees receive insufficient neuroimaging training, with a median satisfaction rating on a Likert scale (0-100) of 35 (interquartile range 27-47). Few programs take advantage of online training resources. Opportunities exist to improve neuroimaging education in neurology resident education. This can be done by closer adherence to the American Academy of Neurology neuroimaging curriculum guidelines, especially by expanding access to online resources and additional emphasis on imaging review with neurology subspecialists.