A review of prevocational medical trainee assessment in New South Wales

Abstract

Listen

Translate article

To evaluate the effectiveness of formal assessments of prevocational medical trainees (ie, interns, first-year residents and international medical graduates undergoing supervised training). Retrospective review of structured assessment forms that are completed by all prevocational trainees and their supervisors in New South Wales public hospitals. We reviewed the first 3390assessment forms, representing assessments of 1072trainees at 43training sites (83% of all prevocational trainees in NSW) since January 2009. (i) Trainee ratings on 19assessment items by self-assessment and by supervisor assessment; and (ii) quantity and quality of written comments provided in assessments. At the end of term, 43% of trainees assessed themselves as performing "at expected level" on all 19rating items. Nearly 99% of trainees were assessed by their supervisors as performing at or above the expected level on all assessment items. Written comments by supervisors were generally short and encouraging, but lacked specific feedback that trainees might use to guide improvements in performance. As currently used by trainees and supervisors, the assessment forms may underreport trainee underperformance, do not discriminate strongly between different levels of performance of trainees or the training system, and do not provide trainees with enough specific feedback to guide their professional development.