An evaluation of using multi-source feedback (MSF) among junior hospital pharmacists

Abstract

The mini Peer Assessment Tool (mini-PAT) for pharmacists was introduced in 2006 as a formative method of assessing junior hospital pharmacists in the workplace and is the first widespread application of multi-source feedback (MSF) specifically within a pharmacy setting. The aim of this study was to evaluate the feasibility and measurement characteristics of the assessment method, in order to guide its future application. At the time of the study (September 2008) the assessment had been in place for 3 years. All assessment data from the first 3 years were analysed retrospectively. We evaluated 633 mini-PAT assessments. Over the study period, the assessor response rate remained relatively consistent at 77% and compared favourably with applications of MSF within medicine. Members of the pharmacy team (pharmacists and pharmacy technicians) dominated the assessor nomination lists. It was encouraging to see completed assessment forms returned from nominated doctors and nurses with whom the junior pharmacist had been working. Differences were found between how different occupational groups rated the junior pharmacists against the 16 items on the assessment form (Kruskal-Wallis, df=3, P<0.001). Pharmacist assessors rated the junior pharmacists lowest against all 16 items on the mini-PAT assessment form, whereas nominated doctors rated them the highest. This study demonstrates that an MSF assessment method can successfully be applied to a wide range of junior hospital pharmacists, and that the majority of junior hospital pharmacists assessed meet expectations.