The assessment accuracy of GP preceptors in mini-CEX workshops

Abstract

Objective To evaluate the validity of GP proceptors in mini-CEX workshop. Methods Three mini-cex workshops for GP proceptors of standardized training of general practitioners in Shanghai were held during November 2009 to September 2012. In the workshops 82 GP proceptors gave the complete rating scores for the training videotapes and the assessment accuracy was analyzed. Results The accurate rates of all items including history taking, physical examination, communication, clinical judgement, consulting skills, organisation and overall clinical perfomance were lower than 50% in 9-point scale and the completely accurate rate and completely error rate were 1.2% and 30.5%, respectively. The accurate rates of 5 items were more than 50% in 3-rank system and the completely accurate rate and completely error rate were 3.7% and 9.8%, respectively. The accurate rates of 4 items were more than 50% in standard score±1 system and the completely accurate rate and completely error rate were 8.5% and 2.4%, respectively. Comparing with 9-point scale, 3-rank system had higher accurate rate in 5 items(P<0.05)and standard score±1 system had higher accurate rate in all 7 items(P<0.05). Abnomal rating scores were found more common in medical interview (41, 50.0%), clinical judgement (32, 39.0%) and physical examination (13, 20.7%). GP proceptors with more than five years teaching experience were more likely to give error scores than those with five or less years teaching experience in 9-point scale(OR=6.993) and 3-rank system(OR=4.902). Leniency and halo effects occurred in 11(13.4%) and 8(9.8%) GP proceptors, respectively; and 14 (17.1%) GP proceptors gave written feedback. Conclusions The rater accuracy of GP proceptors in mini-CEX workshop should be improved further. Key words: General practioner; Teach; Mini clinical evaluation exercise