Evaluating the effectiveness of a 2-year curriculum in a surgical skills center

Abstract

Background This study was a formative evaluation of a 2-year Surgical Skills Center Curriculum (SSCC) using objective measures of surgical performance and self-reported process-oriented evaluations. Methods Fifty postgraduate third-year (PGY-3) residents participated in an Objective Structured Assessment of Technical Skills (OSATS) examination. Nineteen residents underwent the SSCC and 31 residents did not. During the SSCC, self-reported student and faculty evaluations were completed after each session. Results For the OSATS examination, scores were not significantly different between treatment and control groups, on either the checklist (66.4 ± 6.1 versus 64.1 ± 10.8) or global rating scale scores (66.9 ± 6.9 versus 68.0 ± 9.6). Further comparisons between groups on individual OSATS stations revealed no significant differences between groups. The majority of student and faculty evaluation remarks were highly positive. Conclusions The OSATS results failed to support our hypothesis that training on a core procedure in a single session during a SSCC would have an appreciable and sustained effect after 2 years. Self-reported process-oriented evaluations support the utility of our SSCC.