Surgery Resident Performance Research Articles

Concurrent Validity Evidence for Entrustable Professional Activities in General Surgery Residents.

A subset of Entrustable Professional Activities (EPAs) has been developed for general surgery. We aim to contribute validity evidence for EPAs as an assessment framework for general surgery residents, including concurrent validity compared to ACGME milestones, the current gold standard for evaluating competency. This is a cross-sectional study in a general surgery training program within a tertiary academic medical center. EPA assessments were submitted using a mobile app and scored on a numerical scale, mirroring milestones. EPA score distribution was analyzed with respect to post-graduate year (PGY) level and phase of care. Proportional odds logistic regression identified significant predictors. Spearman rank and Wilcoxon rank tests were used for comparisons with milestone ratings. From August 2018 to December 2019, 320 assessments were collected. EPA scores increased by PGY level. Operative phase EPA scores were significantly lower than nonoperative phase scores. PGY level, operative phase, and case difficulty significantly influenced entrustment scoring. EPA scores demonstrated strong correlation with nonoperative milestones patient care-1, medical knowledge-1, interpersonal and communication skills-2, interpersonal and communication skills-3, professionalism-1, professionalism-3, and practice-based learning and improvement-2 (ρ > 0.5, p < 0.05) and a weaker correlation with operative milestones patient care-3 and medical knowledge-2 (ρ < 0.5, p < 0.05). The influence of PGY level and operative phase on entrustment scoring supports the validity of EPAs as a formative evaluation framework for general surgery resident performance. In addition, evident correlations between EPA scores and respective milestone ratings provide concurrent validity evidence.

Analysis of driving simulator performance for post-call orthopaedic surgery residents

PurposeDespite the associations between workhours, fatigue and motor vehicle accidents, driving abilities for residents post-call have been infrequently analysed. Our purpose was to compare orthopaedic surgery resident performance on a...

General Surgery Resident Use of Electronic Resources: 15 Minutes a Day

General surgery resident performance on the American Board of Surgery In-Service Training Exam (ABSITE) has been used to predict American Board of Surgery (ABS) passage rates, selection for remediation programs, and ranking of fellowship applicants. We sought to identify electronic resource study habits of general surgery residents associated with successful test scores. A single-institution, retrospective review of general surgery resident use of 2 electronic study resources, Surgical Council on Resident Education (SCORE) and TrueLearn (TL), were evaluated for the 7 months before the 2019 ABSITE. Metrics included TL question performance, SCORE use, and a survey about other reading sources. These metrics were evaluated in 3 ABSITE percentile groupings: ≥80th, 31st to 79th, and ≤30th. The ≥80th and 31st to 79th percentile groups scored higher on TL questions, at 69% and 67.7%, respectively, compared with 61.4% for the ≤30th percentile group (p < 0.03). The ≥80th percentile group spent on average 14.6 minutes/day on SCORE compared with 5.0 minutes/day and 4.7 minutes/day for the 31st to 79th and ≤30th percentile groups, respectively (p < 0.04). The ≥80th percentile group spent 34.8 minutes/session (77 sessions) compared with 19.2 minutes/session (49 sessions) and 20.7 minutes/session (43 sessions) in the 31st to 79th and ≤30th percentile groups, respectively (p= 0.009). Our nomogram incorporates time spent accessing an electronic content-based resource, SCORE, and performance on an electronic question-based resource as a novel method to provide individualized feedback and predict future ABSITE performance.

A cadaveric procedural anatomy simulation course improves video-based assessment of operative performance

BackgroundInadequate anatomic knowledge has been cited as a major contributor to declining surgical resident operative competence. We analyzed the impact of a comprehensive, procedurally oriented cadaveric procedural anatomy dissection laboratory on the operative performance of surgery residents, hypothesizing that trainees’ performance of surgical procedures would improve after such a dissection course. Materials and methodsMidlevel general surgery residents (n = 9) participated in an 8 wk, 16-h surgery faculty-led procedurally oriented cadaver simulation course. Both before and after completion of the course, residents participated in a practical examination, in which they were randomized to perform one of nine Surgical Council on Resident Education–designated “essential” procedures. The procedures were recorded using wearable video technology. Videos were deidentified before evaluation by six faculty raters blinded to examinee and whether performances occurred before or after an examinee had taken the course. Raters used the validated Operative Performance Rating System and Objective Structured Assessment of Technical Skill scales. ResultsAfter the course residents had higher procedure-specific scores (median, 4.0 versus 2.4, P < 0.0001), instrument-handling (4.0 versus 3.0, P = 0.006), respect for tissue (4.0 versus 3.0, P = 0.0004), time and motion (3.0 versus 2.0, P = 0.0007), operation flow (3.0 versus 2.0, P = 0.0005), procedural knowledge (4.0 versus 2.0, P = 0.0001), and overall performance scores (4.0 versus 2.0, P < 0.0001). Operative Performance Rating System and Objective Structured Assessment of Technical Skill scales averaged by number of items in each were also higher (3.2 versus 2.0, P = 0.0002 and 3.1 versus 2.2, P = 0.002, respectively). ConclusionsA cadaveric procedural anatomy simulation course covering a broad range of open general surgery procedures was associated with significant improvements in trainees’ operative performance.

Personality Factors Associated With Resident Performance: Results From 12 Accreditation Council for Graduate Medical Education Accredited Orthopaedic Surgery Programs

To understand the personality factors associated with orthopedic surgery resident performance. A prospective, cross-sectional survey of orthopedic surgery faculty that assessed their perceptions of the personality traits most highly associated with resident performance. Residents also completed a survey to determine their specific personality characteristics. A subset of faculty members rated the performance of those residents within their respective program on 5 dimensions. Multiple regression models tested the relationship between the set of resident personality measures and each aspect of performance; relative weights analyses were then performed to quantify the contribution of the individual personality measures to the total variance explained in each performance domain. Independent samples t-tests were conducted to examine differences between the personality characteristics of residents and those faculty identified as relevant to successful resident performance. Data were collected from 12 orthopedic surgery residency programs1 throughout the United States. The level of clinical care provided by participating institutions varied. Data from 175 faculty members and 266 residents across 12 programs were analyzed. The personality features of residents were related to faculty evaluations of resident performance (for all, p < 0.01); the full set of personality measures accounted for 4%-11% of the variance in ratings of resident performance. Particularly, the characteristics of agreeableness, neuroticism, and learning approach were found to be most important for explaining resident performance. Additionally, there were significant differences between the personality features that faculty members identified as important for resident performance and the personality features that residents possessed. Personality assessments can predict orthopedic surgery resident performance. However, results suggest the traits that faculty members value or reward among residents could be different from the traits associated with improved resident performance.

Relationships between study habits, burnout, and general surgery resident performance on the American Board of Surgery In-Training Examination

BackgroundThe American Board of Surgery In-Training Examination (ABSITE) is used by programs to evaluate the knowledge and readiness of trainees to sit for the general surgery qualifying examination. It is often used as a tool for resident promotion and may be used by fellowship programs to evaluate candidates. Burnout has been associated with job performance and satisfaction; however, its presence and effects on surgical trainees' performance are not well studied. We sought to understand factors including burnout and study habits that may contribute to performance on the ABSITE examination. MethodsAnonymous electronic surveys were distributed to all residents at 10 surgical residency programs (n = 326). Questions included demographics as well as study habits, career interests, residency characteristics, and burnout scores using the Oldenburg Burnout Inventory, which assesses burnout because of both exhaustion and disengagement. These surveys were then linked to the individual's 2016 ABSITE and United States Medical Licensing Examination (USMLE) step 1 and 2 scores provided by the programs to determine factors associated with successful ABSITE performance. ResultsIn total, 48% (n = 157) of the residents completed the survey. Of those completing the survey, 48 (31%) scored in the highest ABSITE quartile (≥75th percentile) and 109 (69%) scored less than the 75th percentile. In univariate analyses, those in the highest ABSITE quartile had significantly higher USMLE step 1 and step 2 scores (P < 0.001), significantly lower burnout scores (disengagement, P < 0.01; exhaustion, P < 0.04), and held opinions that the ABSITE was important for improving their surgical knowledge (P < 0.01). They also read more frequently to prepare for the ABSITE (P < 0.001), had more disciplined study habits (P < 0.001), were more likely to study at the hospital or other public settings (e.g., library, coffee shop compared with at home; P < 0.04), and used active rather than passive study strategies (P < 0.04). Gender, marital status, having children, and debt burden had no correlation with examination success. Backward stepwise multiple regression analysis identified the following independent predictors of ABSITE scores: study location (P < 0.0001), frequency of reading (P = 0.0001), Oldenburg Burnout Inventory exhaustion (P = 0.02), and USMLE step 1 and 2 scores (P = 0.007 and 0.0001, respectively). ConclusionsResidents who perform higher on the ABSITE have a regular study schedule throughout the year, report less burnout because of exhaustion, study away from home, and have shown success in prior standardized tests. Further study is needed to determine the effects of burnout on clinical duties, career advancement, and satisfaction.

Association Between Flexible Duty Hour Policies and General Surgery Resident Examination Performance: A Flexibility in Duty Hour Requirements for Surgical Trainees (FIRST) Trial Analysis

Concerns persist about the effect of current duty hour reforms on resident educational outcomes. We investigated whether a flexible, less-restrictive duty hour policy (Flexible Policy) was associated with differential general surgery examination performance compared with current ACGME duty hour policy (Standard Policy). We obtained examination scores on the American Board of Surgery In-Training Examination, Qualifying Examination (written boards), and Certifying Examination (oral boards) for residents in 117 general surgery residency programs that participated in the Flexibility in Duty Hour Requirements for Surgical Trainees (FIRST) Trial. Using bivariate analyses and regression models, we compared resident examination performance across study arms (Flexible Policy vs Standard Policy) for 2015 and 2016, and 1 year of the Qualifying Examination and Certifying Examination. Adjusted analyses accounted for program-level factors, including the stratification variable for randomization. In 2016, FIRST trial participants were 4,363 general surgery residents. Mean American Board of Surgery In-Training Examination scores for residents were not significantly different between study groups (Flexible Policy vs Standard Policy) overall (Flexible Policy: mean [SD] 502.6 [100.9] vs Standard Policy: 502.7 [98.6]; p= 0.98) or for any individual postgraduate year level. There was no difference in pass rates between study arms for either the Qualifying Examination (Flexible Policy: 90.4% vs Standard Policy: 90.5%; p= 0.99) or Certifying Examination (Flexible Policy: 86.3% vs Standard Policy: 88.6%; p= 0.24). Results from adjusted analyses were consistent with these findings. Flexible, less-restrictive duty hour policies were not associated with differences in general surgery resident performance on examinations during the FIRST Trial. However, more years under flexible duty hour policies might be needed to observe an effect.

Quality Metrics in Surgery Resident Performance of Screening Colonoscopy

In an attempt to further standardize surgical training, the American Board of Surgery now requires that residents provide evidence that they are certified in flexible endoscopy. This prospective study was designed to determine whether, through a structured curriculum, junior level residents could learn to conduct competent and safe screening colonoscopy (SC). An Institutional Review Board-approved prospective analysis of SC performed by five postgraduate year-2 residents during the 2012-2013 academic year was completed. All SC were performed under direct supervision of one of the two surgical endoscopists after each resident passed a structured endoscopy simulation curriculum. The following metrics of the American Society for Gastrointestinal Endoscopy and the American College of Gastroenterology were recorded: bowel prep quality; cecal intubation; withdrawal time; number of visualized polyps; procedural duration; final pathology; adenoma detection rate (ADR); and, complications. Power analysis revealed that 108 procedures were required for an 80 per cent probability of data analysis accuracy. (American Society for Gastrointestinal Endoscopy ASGE/American College of Gastroenterology benchmark values in parentheses): 166 colonoscopies were performed, of which 149 met inclusion criteria. Bowel prep was considered "excellent" or "good" in 90 per cent of cases. The cecum was reached in 96 per cent of cases. Mean withdrawal time was 12 minutes (≥6 minute). Average procedure time was 30 minutes (≤ 30 minute). Polyp(s) were visualized and removed in 30 per cent of patients. The overall adenoma detection rate was 22.8 per cent (>20%). The ADR for males was 29.5 per cent (>25%). The ADR for females was 18.2 per cent (>15%). Average polyp size was 7.7 mm (range: 2-25 mm). No patients were readmitted for bleeding or perforation. Within a structured learning environment, trained surgical endoscopists can teach junior level surgery residents to perform safe and competent screening colonoscopy.

Informed consent training improves surgery resident performance in simulated encounters with standardized patients

BackgroundAlthough informed consent is vital to patient–physician communication, little training is provided to surgical trainees. We hypothesized that highlighting critical aspects of informed consent would improve resident performance. MethodsEighty (out of 88) surgical postgraduate year 1 surgical residents were randomly assigned to one of the 2 cases (laparoscopic cholecystectomy or ventral herniorrhaphy) and instructed to obtain and document informed consent with a standardized patient (SP) followed by a didactic training session. The residents then obtained and documented informed consent with the other case with the other SP. SPs graded encounters (“Checklist”); trained raters graded notes. Repeated measures multivariate analysis of variance (MANOVA) was used to determine differences between pre- and post-training and Checklist versus “Note” scores. ResultsStatistically significant pre- to post differences for Note (P < .01) and Checklist (P < .01) along with significant differences between Note and Checklist (P < .01) were noted. ConclusionsTraining improved surgery residents’ ability to discuss and document informed consent. Despite this improvement, significant differences between discussion and documentation persisted. Documentation training is a future area for improvement.

Association of the 2011 ACGME resident duty hour reform with general surgery patient outcomes and with resident examination performance.

In 2011, the Accreditation Council for Graduate Medical Education (ACGME) restricted resident duty hour requirements beyond those established in 2003, leading to concerns about the effects on patient care and resident training. To determine if the 2011 ACGME duty hour reform was associated with a change in general surgery patient outcomes or in resident examination performance. Quasi-experimental study of general surgery patient outcomes 2 years before (academic years 2009-2010) and after (academic years 2012-2013) the 2011 duty hour reform. Teaching and nonteaching hospitals were compared using a difference-in-differences approach adjusted for procedural mix, patient comorbidities, and time trends. Teaching hospitals were defined based on the proportion of cases at which residents were present intraoperatively. Patients were those undergoing surgery at hospitals participating in the American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP). General surgery resident performance on the annual in-training, written board, and oral board examinations was assessed for this same period. National implementation of revised resident duty hour requirements on July 1, 2011, in all ACGME accredited residency programs. Primary outcome was a composite of death or serious morbidity; secondary outcomes were other postoperative complications and resident examination performance. In the main analysis, 204,641 patients were identified from 23 teaching (n = 102,525) and 31 nonteaching (n = 102,116) hospitals. The unadjusted rate of death or serious morbidity improved during the study period in both teaching (11.6% [95% CI, 11.3%-12.0%] to 9.4% [95% CI, 9.1%-9.8%], P < .001) and nonteaching hospitals (8.7% [95% CI, 8.3%-9.0%] to 7.1% [95% CI, 6.8%-7.5%], P < .001). In adjusted analyses, the 2011 ACGME duty hour reform was not associated with a significant change in death or serious morbidity in either postreform year 1 (OR, 1.12; 95% CI, 0.98-1.28) or postreform year 2 (OR, 1.00; 95% CI, 0.86-1.17) or when both postreform years were combined (OR, 1.06; 95% CI, 0.93-1.20). There was no association between duty hour reform and any other postoperative adverse outcome. Mean (SD) in-training examination scores did not significantly change from 2010 to 2013 for first-year residents (499.7 [ 85.2] to 500.5 [84.2], P = .99), for residents from other postgraduate years, or for first-time examinees taking the written or oral board examinations during this period. Implementation of the 2011 ACGME duty hour reform was not associated with a change in general surgery patient outcomes or differences in resident examination performance. The implications of these findings should be considered when evaluating the merit of the 2011 ACGME duty hour reform and revising related policies in the future.

Clinical Assessment and Management Examination—Outpatient (CAMEO): Its Validity and Use in a Surgical Milestones Paradigm

Clinical Assessment and Management Examination--Outpatient (CAMEO) is a metric for evaluating the clinical performance of surgery residents. The aim of this study was to investigate the measurement characteristics of CAMEO and propose how it might be used as an evaluation tool within the general surgery milestones project. A total of 117 CAMEO evaluations were gathered and used for analysis. Internal consistency reliability was estimated, and item characteristics were explored. A Kruskal-Wallis procedure was performed to discern how well the instrument discriminated between training levels. An exploratory factor analysis was also conducted to understand the dimensionality of the evaluation. CAMEO evaluations were collected from 2 departments of surgery geographically located in the Midwestern United States. Combined, the participating academic institutions graduate approximately 18 general surgery residents per year. In this retrospective data analysis, the number of evaluations per resident ranged from 1 to 7, and evaluations were collected from 2006 to 2013. For the purpose of data analysis, residents were classified as interns (postgraduate year 1 [PGY1]), juniors (PGY2-3), or seniors (PGY4-5). CAMEO scores were found to have high internal consistency (Cronbach's α = 0.96), and all items were highly correlated (≥ 0.86) to composite CAMEO scores. Scores discriminated between senior residents (PGY4-5) and lower level residents (PGY1-3). Per an exploratory factor analysis, CAMEO was revealed to measure a single dimension of "clinical competence." The findings of this research aligned with related literature and verified that CAMEO scores have desirable measurement properties, making CAMEO an attractive resource for evaluating the clinical performance of surgery residents.

Communication Skills Training in Surgical Residency: A Needs Assessment and Metacognition Analysis of a Difficult Conversation Objective Structured Clinical Examination

The objective structured clinical examination (OSCE) can be used to evaluate the Accreditation Council for Graduate Medical Education Core Competencies of Professionalism and Interpersonal and Communication Skills. The aim of this study was to describe general surgery resident performance on a "difficult conversation" OSCE. In this prospective study, junior and senior residents participated in a 2-station OSCE. Junior stations involved discussing operative risks and benefits and breaking bad news. Senior stations involved discussing goals of care and discussing transition to comfort measures only status. Residents completed post-OSCE checklist and Likert-based self-evaluations of experience, comfort, and confidence. Trained standardized patients (SPs) evaluated residents using communication skill-based checklists and Likert-based assessments. Pearson correlation coefficients were determined between self-assessment and SP assessment. Mann-Whitney U tests were conducted between junior and senior resident variables, using α = 0.05. There were 27 junior residents (age 28.1 ± 1.9 years [29.6% female]) and 27 senior residents (age 32.1 ± 2.5 years [26.9% female]). The correlation of self-assessment and SP assessment of overall communication skills by junior residents was -0.32 on the risks and benefits case and 0.07 on the breaking bad news case. The correlation of self-assessment and SP assessment of overall communication skills by senior residents was 0.30 on the goals of care case and 0.26 on the comfort measures only case. SP assessments showed that junior residents had higher overall communication skills than senior residents (p = 0.03). Senior residents perceived that having difficult conversations was more level appropriate (p < 0.001), and they were less nervous having difficult conversations (p < 0.01) than junior residents. We found that residents perform difficult conversations well, that subjective and objective skills are correlated, and that skills-based training is needed across all residency levels. This well-received method may be used to observe, document, and provide resident feedback for these important skills.

A Prospective Randomized Controlled Blinded Study to Evaluate the Effect of Short-Term Focused Training Program in Laparoscopy on Operating Room Performance of Surgery Residents (CTRI /2012/11/003113)

Laparoscopic surgery requires certain specific skills. There have been several attempts to minimize the learning curve with training outside the operation room. Although simulators have been well validated as tools to teach technical skills, their integration into comprehensive curricula is lacking. Several randomized controlled trials and systematic reviews have demonstrated that the technical skills learned on these simulators transfer to the operating room. Currently, however, the integration of these simulated models into formal residency training curricula is lacking. In our institute, we have adopted the Tuebingen Trainer devised by Professor GF Buess from Germany. The purpose of this study was to evaluate the training of surgical residents on an ex vivo phantom model for basic laparoscopic skill acquisition and its transferability to the OR performance. Seventeen general surgery residents were randomized into 2 groups: Laparoscopic Training Group (n = 9, Group A) and Standard Training Group (n = 8, Group B). Group A underwent training in the Minimally Invasive Surgery Training Centre on the porcine phantom model and did 10 laparoscopic cholecystectomies, whereas Group B did not undergo training in the Minimally Invasive Surgery Training Centre. All the participants performed a laparoscopic cholecystectomy in the operation theater in the presence of a consultant who was blinded to the training status of the participants. The performance of the residents in both groups in the operation theater was assessed using GOALS criteria, surgical performance assessment parameters, task-specific checklists, and visual analog scale for gallbladder perforation difficulty and overall competence. The Laparoscopic Training Group had better performance than the Standard Training Group regarding operation time, GOALS criteria, and Task-specific checklists. Although the surgical performance assessments, i.e. cystic duct and artery identification scores, gallbladder perforation scores, and liver injury scores, were better in the Laparoscopic Training Groups, they were not statistically significant. The overall difficulty of the surgery was comparable in both the groups. The Laparoscopic Training Group exhibited significant overall competence on visual analog scale scores. Our study has clearly shown that training on the Tuebingen Trainer with integrated porcine organs results in a statistically significant improvement in the operating room performance of surgical residents as compared with the nontrained residents, thereby indicating a transfer of skills from training to the operating room.

The Predictive Value of General Surgery Application Data for Future Resident Performance

The predictive value of application data for future general surgery resident performance and attrition are poorly understood. We sought to determine what variables obtained in the application process might predict future resident success. We performed an 18-year review (1990-2008) of all matched residents (n = 101) to a university program. Both categorical graduates (CG) and nongraduates (CNG) and nondesignated preliminaries matching (PM) and preliminaries nonmatching (PNM) were evaluated. We also screened for previous high-performance accomplishments outside of the medical field such as in the performing arts or collegiate athletics (SKILL). Outcome data include graduation or match status, American Board of Surgery In-service Training Examination (ABSITE), and faculty Accreditation Council for Graduate Medical Education (ACGME) core competency evaluations. Background data from the Electronic Residency Application Service (ERAS) application between the various groups was compared with univariate analysis and logistic regression. There were significant differences between the groups on the measures of USMLE step 1 (STEP1) (p = 0.001), medical school grade point average (GPA) (p = 0.023), interview data (INTERVIEW) (p < 0.001), and ABSITE (p < 0.001). The variable of INTERVIEW had an odds ratio of 188.27 (95% confidence interval, 3.757-9435.405). Overall attrition was 23.7% (n = 24) and was evenly divided between those who left for lifestyle reasons and those who were encouraged to leave. Within our system, INTERVIEW, USMLE STEP1, and SKILL predict successful completion of a general surgery residency. In contrast to prior reports, female sex, ethnicity, medical school grades, or Alpha Omega Alpha Honor Society (AOA) status were not significant. The variable SKILL is novel and highlights the importance of nonacademic background data. Our data indicate STEP1 is an independent predictor of resident success in general surgery and should maintain an important role in general surgery applicant screening. The ideal screening threshold is likely > 215.

Correlating Application Data To General Surgery Residency Competency Based Success

Introduction: The predictive value of application data between General Surgery resident performance and attrition is poorly understood. We sought to determine what variables obtained in the application process might predict outcome. Methods: An eighteen year review (1990-2008) of all residents (n=101) to a university program. Categorical graduates and non-graduates (CG, CNG) and non-designated preliminaries matching and non-matching (PM, PNM) were evaluated. Among CNG, those leaving for lifestyle reasons (CNG-L) and performance issues or “encouraged” (CNG-E) were analyzed as subgroups.

Enabling, Implementing, and Validating Training Methods in Laparoscopic Surgery

The challenges of teaching and learning technical skills for laparoscopic surgery have limited the use of laparoscopy for complex abdominal surgery. In an attempt to facilitate learning these skills, surgical educators are using simulators, but there is little conclusive evidence that simulators can predict improved performance by surgical trainees receiving training on them (predictive validity). In the present study the results of three attempts to establish predictive validity for a virtual laparoscopic simulator were reviewed. In each study, the performance of surgery residents before and after training on the simulator was documented by means of a validated assessment tool, and then the results were compared. Some task performance was improved by training on the simulator, but predictive validity could not be established for the simulator in any of the three attempts to do so. Although predictive validity for the virtual simulator was not conclusively established, reasons for this failure are discussed. Based on the evidence that training on simulators results in some task performance improvement, future studies are justified to better define more effective use of the simulator.

The nature of general surgery resident performance problems

Residents with performance problems are challenging to program directors and complicate the work of other residents and health care providers. Having an effective, targeted remediation process to address these problems is dependent on being able to diagnose their nature. The purpose of this study was to identify residents who had serious, substantive, and recurring academic, clinical, and/or professional behavior problems, and to describe and classify their nature. Raters performed a retrospective record review of general surgery categorical residents in one program over 30 years. Residents with substantial problems were reviewed, described, and classified independently by 3 raters. Seventeen residents had serious enough performance problems to be included. Four had only 1 class of problem (3 were professional behavior problems). Eight residents had 2 problems each (5 academic and clinical performance problems; 3 clinical performance and professional behavior problems). Five residents had 3 problems. The number of performance problem facets per case varied from 11 to 2 with an average of 5.9 facets. Relations with health care workers was identified most frequently, followed closely by insufficient knowledge. Poor communication was third. Performance problems of 14 residents (82%) were identified in their first year. For 15 cases, the resident had unresolved performance problems at the end of the program. There are 2 possible explanations for our findings: (1) resident problems similar to these are refractory to remediation; (2) treatments used historically are not well designed for the problems. Choosing among the 2 explanations will require developing remediation strategies targeted to specific patterns of performance problems.

Psychologic well-being of surgery residents after inception of the 80-hour workweek: A multi-institutional study

The 80-hour workweek was adopted by US residency programs on July 1, 2003. Our published data from the preceding year indicated significant impairment in psychologic well-being among surgery residents. The purpose of this study was to determine whether psychologic well-being and academic performance of surgery residents improved after inception of the 80-hour workweek. A single-blinded survey of general surgery residents (n=130) across 4 US training programs was conducted after July 1, 2003, with the use of validated psychometric surveys (Symptom Checklist-90-R and Perceived Stress Scale) and the American Board of Surgery In-Training Examination; comparison was done with preceding year and societal data. Primary outcomes were "psychologic distress" and "perceived stress." Secondary outcomes were "somatization," "depression," "anxiety," "interpersonal sensitivity," "hostility," "obsessive-compulsive behavior," "phobic anxiety," "paranoid ideation," "psychoticism." and "academic performance." The impact of demographic variables was assessed. Mean psychologic distress improved from the preceding year (P < .01) but remained elevated, compared with societal norms (P < .001). The proportion of residents meeting the criteria for clinical psychologic distress (>or=90th percentile) decreased from 38% before, to 24% after, July 2003. Mean perceived stress remained elevated, compared with norms (P < .0001) without improvement from the preceding year. Overall academic performance was unchanged. Previously elevated secondary psychologic outcomes improved after July 2003 (P < .05), although obsessive-compulsive behavior, depression, interpersonal sensitivity, hostility, and anxiety failed to normalize. Male gender and single status were independent risk factors for psychologic distress. Inception of the 80-hour workweek is associated with reduced psychologic distress among surgery residents. The perception of stress and academic performance remains unchanged.

Laparoscopic training on bench models: better and more cost effective than operating room experience?

Background: Developing technical skill is essential to surgical training, but using the operating room for basic skill acquisition may be inefficient and expensive, especially for laparoscopic operations. This study determines if laparoscopic skills training using simulated tasks on a video-trainer improves the operative performance of surgery residents. Study Design: Second- and third-year residents (n = 27) were prospectively randomized to receive formal laparoscopic skills training or to a control group. At baseline, residents had a validated global assessment of their ability to perform a laparoscopic cholecystectomy based on direct observation by three evaluators who were blinded to the residents’ randomization status. Residents were also tested on five standardized video-trainer tasks. The training group practiced the video-trainer tasks as a group for 30 minutes daily for 10 days. The control group received no formal training. All residents repeated the video-trainer test and underwent a second global assessment by the same three blinded evaluators at the end of the 1-month rotation. Within-person improvement was determined; improvement was adjusted for differences in baseline performance. Results: Five residents were unable to participate because of scheduling problems; 9 residents in the training group and 13 residents in the control group completed the study. Baseline laparoscopic experience, video-trainer scores, and global assessments were not significantly different between the two groups. The training group on average practiced the video-trainer tasks 138 times (range 94 to 171 times); the control group did not practice any task. The trained group achieved significantly greater adjusted improvement in video-trainer scores (five of five tasks) and global assessments (four of eight criteria) over the course of the four-week curriculum, compared with controls. Conclusions: Intense training improves video-eye-hand skills and translates into improved operative performance for junior surgery residents. Surgical curricula should contain laparoscopic skills training.