Surgical Council On Resident Education Research Articles

Structured Textbook Review and Individualized Learning Plans Successfully Remediate Underperforming Residents and Improve General Surgery Program Performance on the ABSITE.

We endeavored to create an evidence-based curriculum to improve general surgery resident fund of knowledge. Global and resident-specific interventions were employed to this end. These interventions were monitored via multiple choice question results on a weekly basis and American Board of Surgery In-Training Examination (ABSITE) performance. This study was performed in a prospective manner over a 2-year period. A structured textbook review with testing was implemented for all residents. A focused textbook question-writing assignment and a Surgical Council on Resident Education (SCORE)-based individualized learning plan (ILP) were implemented for residents scoring below the 35th percentile on the ABSITE. Curriculum implementation resulted in a statistically significant reduction in the number of residents scoring below the 35th percentile, from 50% to 30.8% (P = .023). One hundred percent of residents initially scoring below the 35th percentile were successfully remediated over the study period. Average overall program ABSITE percentile scores increased from 38.5% to 51.4% over a 2-year period. Structured textbook review and testing combined with a question-writing assignment and a SCORE-focused ILP successfully remediated residents scoring below the 35th percentile and improved general surgery residency ABSITE performance.

Audience Response System (ARS) Use in the SCORE (Surgical Council on Resident Education) Surgery Training Curriculum: A Mixed Methodology Study.

Background Audience Response Systems (ARS) could help overcome the limitations of traditional lectures by providing interactivity, engagement, and assessment. The perception of ARS use in surgical education is not well documented. Objective Examine the use of an ARS in teaching This Week In SCORE (Surgical Council on Resident Education)sessions to general surgery residents and medical students. Methods ARS was used at weekly SCORE question sessions in a new general surgery residency program by four residents, 97 medical students, and 20 faculty. The study employed a mixed quantitative and qualitative method: two separate 10-question surveys for faculty and trainees (49% response rate) and a focus group discussion that included one faculty member, two residents, and two students. Results In 85 (85%) responses, the faculty favored the use of ARS in SCORE. Among the total of 510 responses from 51 residents and students, 57% agreed with the favorable use of ARS, while 28% were neutral and, in 14% of cases, negative. A greater proportion of faculty and learners preferred ARS over traditional lectures.The focus group content analysis showed a positive effect and preference from learners and faculty. Engagement, thinking stimulation, and group participation were the most common positive comments. No significant negative influence on ARS use was reported. Conclusions The use of an ARS inThis Week In SCORE​​​sessions were preferred by most of the faculty and a majority of learners. The benefits are ease of use and stimulation of discussion. ARS has the potential for more widespread utilization in additional educational settings.

Course Design and Learning Outcomes of a Practical Online Ergonomics Course for Surgical Residents

Course content was designed and the learning outcomes assessed for an online ergonomics course for surgical residents. This course could fulfill an optional Surgical Council on Resident Education (SCORE) curriculum on Surgical Ergonomics. The online course included five 5-minute modules within the residents' learning system, each ending with an ungraded knowledge question, and a final 5-question multiple-choice retention quiz that allowed infinite attempts. The course was designed by ergonomists and surgeons at a quaternary academic hospital system. Participants were given two weeks to complete the modules. An electronic survey with questions assessing ergonomics knowledge and understanding on a 5-point Likert scale (strongly disagree - strongly agree) was distributed both before and after the course. The post-course survey included three additional questions to elicit feedback regarding learning experience and course design. Descriptive statistics and nonparametric paired comparisons were used to evaluate learning outcomes. General surgery residency program at an academic medical center in the U.S. Twenty-two general surgery post graduate year 1 residents (PGY1s) were recruited to participate and completed the pre-course survey. Eight out of the 22 participants (36%) completed the online course and quiz; seven (32%) completed the course, quiz, and the post-course survey. Participants had high pre-course awareness of the importance of surgical ergonomics, benefits of work-related musculoskeletal disorder (WMSD) prevention, as well as awkward intraoperative postures being an WMSD risk factor. Participants' confidence increased significantly from pre- to post-course in ability to assess risk (p = 0.021), but not in ability or willingness to mitigate risky surgical postures. Participants who completed the quiz answered a median of 4 (IQR: [4, 5]) questions correctly. All participants indicated that they would recommend this course to other residents. These short practical ergonomics online learning modules increased surgical residents' confidence in assessing surgical WMSD risks.

Learning to Read: Successful Program-Based Remediation Using the Surgical Council on Resident Education (SCORE) Curriculum

The Surgical Council on Resident Education (SCORE) curriculum is aligned with the American Board of Surgery (ABS) objectives. Our program adopted the SCORE curriculum in 2015 after poor ABS In-Training Examination (ABSITE) performance and lowest quartile ABS Certifying Exam (CE) and Qualifying Exam (QE) first-time pass rates. We examined the association of SCORE use with ABSITE performance and ABS board exam first-time pass rate. At a single institution, a retrospective review of surgery residents' SCORE metrics and ABSITE percentile was conducted for academic years 2015 to 2019. Metrics analyzed on the SCORE web portal were mean total minutes and total visits per resident for all residents using SCORE that year. First-time pass rates of the ABS QE and CE were examined from 2013 to 2019. Chi-square and linear regression analysis were performed, and a 95% level of confidence was assumed (alpha= 0.05). Yearly data from categorical general surgery residents showed a significant increase in total minutes, total visits, and ABSITE percentile. Combined first time pass rates for the ABS QE and CE significant increased from 70.8% in 2013 to 2015 to 93.9% in 2016 to 2019 (p= 0.018). Increased longitudinal use of the SCORE curriculum was associated with programmatic improvements in ABSITE performance and ABS board exam first-time pass rate.

Multi-institutional Collaborative Surgery Education Didactics: Virtual Adaptations During a Global Pandemic

ObjectiveThe COVID-19 pandemic has disrupted graduate medical education, impacting Accreditation Council for Graduate Medical Education (ACGME)-mandated didactics. We aimed to study the utility of 2 methods of virtual learning: the daily National Surgery Resident Lecture Series (NSRLS), and weekly “SCORE School” educational webinars designed around the Surgical Council on Resident Education (SCORE) curriculum.Design and Setting: NSRLSThe National Surgery Resident Lecture Series was a daily virtual educational session initially led by faculty at an individual surgical residency program. Thirty-eight lectures were assessed for number of live viewings (March 23, 2020-May 15, 2020).SCORE SchoolAttendance at eleven weekly SCORE educational webinars was characterized into live and asynchronous viewings (May 13, 2020-August 5, 2020). Each 1-hour live webinar was produced by SCORE on a Wednesday evening and featured nationally recognized surgeon educators using an online platform that allowed for audience interaction.Results: NSRLSThere were a mean of 71 live viewers per NSRLS session (range 19-118). Participation began to decline in the final 2 weeks as elective case volumes increased, but sessions remained well-attended.SCORE SchoolThere were a range of 164-3889 live viewers per SCORE School session. Sessions have most commonly been viewed asynchronously (89.8% of viewings). Live viewership decreased as the academic year ended and then rebounded with the start of the new academic year (range 4.9%-27%). Overall, the eight webinars were viewed 11,135 times. Each webinar continues to be viewed a mean of 43 times a day (range 0-102). Overall, the eleven webinars have been viewed a total of 22,722 times.ConclusionsVirtual didactics aimed at surgical residents are feasible, well-attended (both live and recorded), and have high levels of viewer engagement. We have observed that careful coordination of timing and topics is ideal. The ability for asynchronous viewing is particularly important for attendance. As the COVID-19 pandemic continues to disrupt healthcare systems, training programs must continue to adapt to education via virtual platforms.

A National Obstetrics and Gynecology Residency Education Curriculum Inspired by the Surgical Council on Resident Education (SCORE) Portal: Pilot Needs Assessment

Mutter, Olga MD; Hylton, Jordan DO; Jeronis, Stacey MD; Jaspan, David DO; Rose, Marisa MD Author Information

Where Has All the Complexity Gone? An Analysis of the Modern Surgical Resident Operative Experience

The operative experience of today's general surgery (GS) residents are changing. The Surgical Council on Resident Education (SCORE) was founded to provide a standardized, competency-based curriculum. We set out to evaluate resident operative experience in core and advanced operations. Accreditation Council for Graduate Medical Education (ACGME) national operative log reports from 2010 to 2018 were reviewed. Operative volume data for 344 operations were extracted and analyzed. Operations were designated as core, advanced, or undefined as listed by SCORE, and stratified as GS or subspecialty. National analysis utilizing ACGME operative log reports. All graduating general surgery residents between 2010 and 2018. A total of 10,118 residents completed GS training with an average of 1121.5 ± 29.3 total cases. Core operations comprised 80.5% of total volume while advanced comprised only 8.0%. The total core experience increased (+7.0 cases/year), while total advanced experience decreased (-1.4 cases/year) (p < 0.01 each). Compositional analysis among core operations revealed an increase in 9/13 GS domains and a decrease in 8/10 subspecialty domains (all p < 0.05). There has been an increase in core operative experience with a concurrent decrease in advanced operative experience of graduating GS residents. These findings highlight the continued narrowing of the operative experience for trainees, with increasing focus on GS and less on subspecialty domains. Ongoing efforts to look beyond operative volume to ensure competency of graduates will prove beneficial.

Practical Techniques to Adapt Surgical Resident Education to the COVID-19 Era.

Practical Techniques to Adapt Surgical Resident Education to the COVID-19 Era.

General Surgery Resident Use of Electronic Resources: 15 Minutes a Day

General surgery resident performance on the American Board of Surgery In-Service Training Exam (ABSITE) has been used to predict American Board of Surgery (ABS) passage rates, selection for remediation programs, and ranking of fellowship applicants. We sought to identify electronic resource study habits of general surgery residents associated with successful test scores. A single-institution, retrospective review of general surgery resident use of 2 electronic study resources, Surgical Council on Resident Education (SCORE) and TrueLearn (TL), were evaluated for the 7 months before the 2019 ABSITE. Metrics included TL question performance, SCORE use, and a survey about other reading sources. These metrics were evaluated in 3 ABSITE percentile groupings: ≥80th, 31st to 79th, and ≤30th. The ≥80th and 31st to 79th percentile groups scored higher on TL questions, at 69% and 67.7%, respectively, compared with 61.4% for the ≤30th percentile group (p < 0.03). The ≥80th percentile group spent on average 14.6 minutes/day on SCORE compared with 5.0 minutes/day and 4.7 minutes/day for the 31st to 79th and ≤30th percentile groups, respectively (p < 0.04). The ≥80th percentile group spent 34.8 minutes/session (77 sessions) compared with 19.2 minutes/session (49 sessions) and 20.7 minutes/session (43 sessions) in the 31st to 79th and ≤30th percentile groups, respectively (p= 0.009). Our nomogram incorporates time spent accessing an electronic content-based resource, SCORE, and performance on an electronic question-based resource as a novel method to provide individualized feedback and predict future ABSITE performance.

SCORE – Leveling the Playing Field for Surgical Training Programs

The Surgical Council on Resident Education (SCORE) web portal provides a uniform, comprehensive, competency-based curriculum for general surgery residents. One of SCORE's principal founding goals was to provide equal opportunity for access of educational resources at programs across the United States which reported having a range of resources. We aimed to determine if there was a difference in portal usage by trainees in independent versus university programs, and across geographic areas. Using analytic software, we measured SCORE usage by trainees in 246 subscribing programs from August 2015 to March 2017. The primary outcome was the average duration of SCORE use per login. Secondary outcomes were the geographic region of each program, and university versus independent designation. Encounters lasting >8 hours (comprising 7% of the data set) were excluded to eliminate the likelihood of failure to log off the portal. Over the study period, there were 669,501 SCORE sessions with 22% of these lasting 1 to 5 minutes, 33% lasting 6 to 30 minutes, and 28% lasting 31 to 120 minutes. Between the university (64.4% of encounters) and independent (35.6% of encounters) program types, there was no significant difference in average visit length overall, or in the normally-distributed designated time categories (t test -1.0, p = 0.3). When mean encounter length per program was compared by geographic regions, there was also no difference in the three time categories (ANOVA p = 0.9, 0.2, and 0.5, respectively). Most (50%) of SCORE encounters lasted 30 minutes of less, confirming prior work that shows trainees use the portal in relatively short bursts of activity. While there were more encounters from university program trainees (proportional with their greater numbers), the mean duration of an individual encounter did not significantly differ by program type as a whole or by region. These results suggest that SCORE is an equally accessible educational resource and is used by surgical trainees, regardless of program type or geographic region.

P 021 – Hip-knee and knee-ankle interjoint coordination during short-track speed skating

The Surgical Council on Resident Education (SCORE) has presented a workshop annually at the annual meeting of the Association of Program Directors (APDS) to discuss the evolution of the SCORE portal and best practices for implementation within residency training programs.A review of the literature was undertaken, along with a summation of discussion at these several workshops. A history of the SCORE project and a summary of its organizational framework and content are presented. In addition, best practices for use of SCORE within programs are described.The SCORE portal is now a decade old, and is used ubiquitously in US surgical training programs. With this experience, there is data to show the utility of SCORE to support trainee learning and programmatic didactics.

Best Practice for Implementation of the SCORE Portal in General Surgery Residency Training Programs

The Surgical Council on Resident Education (SCORE) has presented a workshop annually at the annual meeting of the Association of Program Directors (APDS) to discuss the evolution of the SCORE portal and best practices for implementation within residency training programs. A review of the literature was undertaken, along with a summation of discussion at these several workshops. A history of the SCORE project and a summary of its organizational framework and content are presented. In addition, best practices for use of SCORE within programs are described. The SCORE portal is now a decade old, and is used ubiquitously in US surgical training programs. With this experience, there is data to show the utility of SCORE to support trainee learning and programmatic didactics.

What Can SCORE Web Portal Usage Analytics Tell Us About How Surgical Residents Learn?

The Surgical Council on Resident Education (SCORE) was established in 2004 with 2 goals: to develop a standardized, competency-based curriculum for general surgery residency training; and to develop a web portal to deliver this content. By 2012, 96% of general surgery residency programs subscribed to the SCORE web portal. Surgical educators have previously described the myriad ways they have incorporated SCORE into their curricula. The aim of this study was to analyze user data to describe how and when residents use SCORE. Using analytic software, we measured SCORE usage from July, 2013 to June, 2016. Data such as IP addresses, geo-tagging coordinates, and operating system platforms were collected. The primary outcome was the median duration of SCORE use. Secondary outcomes were the time of day and the operating system used when accessing SCORE. Descriptive statistics were performed, and a p < 0.05 was deemed statistically significant. There were 42,743 total SCORE subscribers during the study period (75% resident and 25% faculty) with a mean of 14,248 subscribers per year. The overall median duration of SCORE use was 11.9minute/session (interquartile range [IQR]: 6.8). Additionally, there was a significant increase in session length over the 3 academic years; 10.1 (IQR: 6.4), 11.9 (IQR: 7.2), and 13.2minute/session (IQR: 5.4) in 2013 to 2014, 2014 to 2015, and 2015 to 2016, respectively (p < 0.001). SCORE usage was highest in November to February at 21.0minute/session (14.2) compared to July to October and March to June (12.3 [IQR: 3.2] and 9.6minute/session [IQR: 2.2]), respectively (p < 0.001). This seasonal trend continued for all 3 years. We observed an increased number of sessions per day over the 3 years: median of 1500 sessions/d (IQR: 1115) vs 1706 (IQR: 1334) vs 1728 (IQR: 1352), p < 0.001. (Fig.). Most SCORE sessions occurred at night: 38,011 (IQR: 4532) vs 17,529 (IQR: 19,850) during the day (p < 0.001). Windows was the most frequently used operating system at 48.9% (p < 0.001 vs others). SCORE usage has increased significantly over the last 3 years, when measured by number of sessions per day and length of time per session. There are predictable daily, diurnal, and seasonal variations in SCORE usage. The annual in-training examination is a prominent factor stimulating SCORE usage.

The relationship between maternal body mass index and exosomal concentration across gestation

Junior surgical resident education at academic institutions is traditionally focused to preoperative and postoperative patient management. Our objective was to investigate the number and type of surgical procedures performed by junior general surgery residents in comparison with the American Board of Surgery requirements and the Surgical Council on Resident Education (SCORE) curriculum.This was a retrospective study using the Accreditation Counsel for Graduate Medical Education (ACGME) operative case logs of junior surgical residents.The Ohio State University Wexner Medical Center, Columbus, OH; a tertiary academic medical center.We performed, an institutional review board approved, retrospective review of logged surgical cases from general surgical residents during postgraduate year (PGY) 1 and 2 from 2009 to 2015 at an academic medical center. Summary case logs were accessed from the ACGME. Procedures were extracted from the SCORE curriculum and correlated to corresponding ACGME defined procedures for total cases, major cases, and endoscopy. Minor cases and patient care cases were excluded as they were not clearly defined on the category report. SCORE procedures were excluded if there was not a corresponding ACGME procedure on the summary report. SCORE procedures and ACGME procedures were combined with each other if there was overlap with correlation. Statistics were performed on individual and total resident data. One-sample student’s t-test was used to compare total number of cases logged with the 250 case log ABS requirement and to compare the total major cases and endoscopy performed with those represented on SCORE.Overall, 26 residents completed both PGY-1 and 2 years from 2009 to 2015, and remained at the same institution for case logs to be accessed during the study period. A total of 21 residents (80.76%) completed 250 cases or more after their first 2 years of residency. Across all years, the mean case log was 349 cases (p = 0.20), and was statistically more than than 250 cases in 3 of the 5 class years. Junior residents completed a total mean of 312 major and endoscopy cases (89%) at the end of 2 years, which was statistically higher than the 75% testing hypothesis across all years (p < 0.01). Of major and endoscopy cases performed in total by the completion of the PGY-2 year, a mean of 275 cases (88%) were included in the SCORE curriculum. Using one-sample t-test, SCORE procedures represented more than 85% of the major and endoscopy cases logged (p < 0.01). Of all major and endoscopy cases logged that correlate to a SCORE procedure, 95% were found to be “core” and 5% were “advanced.”Our study demonstrates that junior surgical residents meet the 250 case log requirement put forth by the ABS, and most major procedures and endoscopy performed correspond with the core cases of the SCORE curriculum at our institution. This study aid in the confirmation of the SCORE curriculum for junior residents, and those procedures which should be designated as core.

Utilizing the American Board of Surgery in-training exam in a Rwandan surgical residency program: Alignment of exam topics with the University of Rwanda general surgery curriculum

Background: University of Rwanda (UR) increased postgraduate surgery training and assessment strategies are needed. We compared American Board of Surgery In-Training Exam (ABSITE) topics with UR surgery curriculum to determine the applicability of ABSITE in Rwanda. Methods: Topics are outlined in the Surgical Council on Resident Education (SCORE) curriculum whereas the UR utilizes a modular system. Diseases and conditions in SCORE were compared with UR surgery module content. Operation and procedures in SCORE were compared with operative procedures in UR surgery curriculum. Results: Overall, 72% of diseases and conditions from SCORE were covered in UR curriculum. Of this, 76% of medical knowledge and 71% of patient care content was covered in UR curriculum. 41% of operations and procedures from SCORE were identified in UR curriculum. 55% of core operations and 16% of advanced operations from SCORE were included in UR general surgery curriculum. Content identified in UR curriculum and not SCORE included infectious and tropical diseases, orthopedics, urology and neurosurgery. Conclusions: There is alignment between ABSITE topics and UR general surgery curriculum suggesting that the ABSITE can be used as an in-training examination for Rwandan residents. Understanding the limitations of the ABSITE exam can help utilization of this examination. Keywords: internship and residency, curriculum, Rwanda, global health

YouTube is the Most Frequently Used Educational Video Source for Surgical Preparation

The purpose of this study was to evaluate surgical preparation methods of medical students, residents, and faculty with special attention to video usage. Following Institutional Review Board approval, anonymous surveys were distributed to participants. Information collected included demographics and surgical preparation methods, focusing on video usage. Participants were questioned regarding frequency and helpfulness of videos, video sources used, and preferred methods between videos, reading, and peer consultation. Statistical analysis was performed using SAS. Surveys were distributed to participants in the Department of Surgery at the University of Iowa Hospitals and Clinics, a tertiary care center in Iowa City, Iowa. Survey participants included fourth-year medical students pursuing general surgery, general surgery residents, and faculty surgeons in the Department of Surgery. A total of 86 surveys were distributed, and 78 surveys were completed. This included 42 learners (33 residents, 9 fourth-year medical students) and 36 faculty. The overall response rate was 91%; 90% of respondents reported using videos for surgical preparation (learners = 95%, faculty = 83%, p = NS). Regarding surgical preparation methods overall, most learners and faculty selected reading (90% versus 78%, p = NS), and fewer respondents reported preferring videos (64% versus 44%, p = NS). Faculty more often use peer consultation (31% versus 50%, p < 0.02). Among respondents who use videos (N = 70), the most used source was YouTube (86%). Learners and faculty use different video sources. Learners use YouTube and Surgical Council on Resident Education (SCORE) Portal more than faculty (YouTube: 95% versus 73%, p < 0.02; SCORE: 25% versus 7%, p < 0.05). Faculty more often use society web pages and commercial videos (society: 67% versus 38%, p < 0.03; commercial: 27% versus 5%, p < 0.02). Most respondents reported using videos to prepare for surgery. YouTube was the preferred source. Posting surgical videos to YouTube may allow for maximal access to learners who are preparing for surgical cases.

A Sensitivity Analysis and Opportunity Cost Evaluation of the Surgical Council on Resident Education Curriculum

The study purpose is to evaluate the Surgical Council on Resident Education (SCORE) Curriculum regarding American Board of Surgery Qualifying Examination (ABS QE) outcomes. The goal is to perform effect size analyses, sensitivity analyses, and sample size analyses with opportunity cost estimates required to favor the SCORE Curriculum subscription regarding ABS QE outcomes. Published data were used to construct 2 × 2 matrices regarding ABS QE outcome (pass/fail) and SCORE subscription status (subscriber/nonsubscriber). Post hoc analyses of effect sizes and sample sizes, with opportunity cost estimates, were performed to evaluate ABS QE outcomes favoring SCORE subscription (2-tailed and 1-tailed tests) using an α = 0.05. The absolute risk increase of SCORE subscription on ABS QE outcome was 1.6% (number needed to treat = 63). Sensitivity analyses showed that a pass rate difference of 4.9% to 7.5% was required to favor SCORE subscription (all p < 0.05). Sample size analyses required an 8- to 18-fold increase to favor SCORE subscription to achieve statistical significance with an opportunity cost of $6.0 to $13.5 million ($30,000-$67,000/program), not adjusting for inflation. The number needed to treat and pass rate differences required to favor SCORE subscription are large. The opportunity costs of SCORE subscription are substantial. Residency programs with more limited resources should determine if the subscription costs are financially sound.

Surgical subspecialization: escape route for surgeons or added benefit for patients?

Surgical subspecialization: escape route for surgeons or added benefit for patients?

Smartphones, trainees, and mobile education: implications for graduate medical education.

Smartphones are one of the fastest-growing sectors in the technology industry, and they continue to evolve to combine faster processors, better memory, and more efficient operating systems into a compact handheld device. Smartphones also offer a dynamic tool for use in personal and professional environments.1 The role of smartphones in medicine continues to expand as additional uses and applications emerge. An estimated 80% of physicians, trainees, and medical students use smartphones, and this percentage is expected to increase.2–,4 Smartphones provide a multifaceted platform for mobile health care, allowing users to access a vast amount of information and interact with resources conveniently and quickly.5 Applications range from patient monitoring to use as a tool for diagnosis, to communication and medical education. Recent advances in smartphone technology have led many educators to extend their teaching methods into the mobile learning environment, providing an “anytime, anywhere” approach to learning. Mobile learning has been shown to have efficacy within the traditional classroom environment, and brief communications via short message service (SMS) supplement interactive classroom sessions, resulting in enhanced interest in and attention to classroom activity.6 Given the nature of graduate medical education (GME), where trainees are expected to assimilate a vast amount of information that is constantly evolving, and often are away from traditional classroom settings, the benefits of mobile learning with its uninterrupted access to educational resources can be particularly advantageous. In this perspective, we characterize the current and potential uses of smartphone technology in GME and provide recommendations for future studies on incorporating smartphone technology as an educational platform.

Subscription to the Surgical Council on Resident Education Web Portal and Qualifying Examination Performance

The Surgical Council on Resident Education (SCORE) curriculum for general surgery was developed to guide surgery residents in the acquisition of knowledge for patient care. We hypothesized that residents in programs that subscribed to the SCORE web portal would perform better on the American Board of Surgery (ABS) Surgery Qualifying Examination (QE). Scaled scores and the percent passing the 2011 ABS Surgery QE for individual residents and programs were compared between programs that subscribed to the SCORE portal in 2010 to 2011 and those that did not subscribe. Regression analyses were performed to control for program QE percent passing from 2004 to 2008 (baseline performance), as well as demographic factors known to affect examination results. There were 200 programs and 893 residents that subscribed to the SCORE web portal and 33 programs with 139 residents that did not subscribe. Regression analysis comparing predicted 2011 mean program QE scores based on 2004 to 2008 results showed that subscribing programs had a substantial increase in mean scaled scores of 1.4 points (adjusted means of 81.5 and 80.1, respectively), controlling for the percentage of international medical graduates and program size (p = 0.048). Residents from SCORE portal subscribing programs had a QE percent passing that was 1.6% higher than nonsubscribing residents, and the mean percent passing was higher for subscribing programs (86.4% vs 82.7%), but neither difference was statistically significant. The SCORE subscription status did not correlate with program size, percent of international medical graduates, or baseline scale scores. There was a considerable improvement in mean QE scaled scores for residents in programs that initially subscribed to the SCORE web portal. The percent passing the QE showed a trend toward improvement for subscribing programs and their residents. This association is promising and deserves additional investigation.