Utility of a Validated Rating Scale for Self-Assessment in Microsurgical Training

Abstract

The purpose of this study is to determine the utility of self-assessment in microsurgical training using a previously validated rating scale. A prospective study of surgical residents taking a hands-on 5-day microsurgical training course. Learners completed multiple self-assessments of their technical skills using the University of Western Ontario Microsurgical Acquisition/Assessment instrument. Simultaneously, preceptors assessed the learners using the same scale. Self-assessment and preceptor scores were compared using the Pearson correlation coefficient (PCC). There was a significant agreement noted between the 32 preceptor assessments and 36 self-assessments that were completed. Correlation between scores for the knot-tying (PCC = 0.62) and anastomosis modules (PCC = 0.77) was good and excellent, respectively. Preceptor scores and self-scores improved over the duration of the course: for preceptors, knot-tying scores increased from 58% on day 1 to 78% on day 5 (p = 0.02) and anastomosis scores improved from 56% to 82% (p = 0.004); for self-scores, knot-tying scores increased from 44% to 81% (p = 0.001) and anastomosis scores from 49% to 84% (p = 0.001). Learners with greater experience (higher postgraduate year level) tended to have higher self as well as preceptor ratings, albeit not statistically significant. Self-assessment using the University of Western Ontario Microsurgical Acquisition/Assessment instrument has good to excellent agreement with preceptor-assessment scores suggesting good interrater reliability. Self-assessment using such tools may, therefore, be used along with preceptor supervision and assessment to potentially improve self-directed learning during these courses.