A Closer Look at Checklist Scoring and Global Rating for Four OSCE Stations: Do the Scores Correlate Well?

Abstract

Introduction: In the marking of objective structured clinical examination (OSCE), checklist scoring and global rating are two commonly used scoring systems. Objective: The purpose of this study was to examine correlations between checklist scores and global ratings for four OSCE stations of different station type. Method: Data for this study was obtained from the Final Year OSCE (n=185). Each station’s score sheet consisted of a detailed checklist of items examined. A global rating scale was also included for the examiner to indicate the global assessment for the station. Spearman’s rho correlation coefficients between checklist scores and global ratings were computed for four stations of different station type. For each station, correlations between checklist scores and global ratings were also checked across the three parallel circuits running concurrently and throughout the four rounds. Result: Spearman’s rho correlation coefficients (ρ) between checklist scores and global ratings for the four stations ranged between 0.62 to 0.88, at p<0.01. Correlation for communication skills station was the highest while correlation for procedural skills station was the lowest. For all stations, ρ ranged between 0.50 to 0.92, at p<0.01 across the circuits and between 0.57 to 0.89, at p<0.01 throughout the rounds. Conclusion: Checklist scores and global ratings correlated well for the station as a whole, as well as across the circuits and also throughout the rounds. Although findings of the study showed both checklist and global rating scale could be used as assessment tools in OSCE, it is suggested that for procedural skills station, checklist is preferred.