Limitations of student evaluations of curriculum

Abstract

Medical student surveys are used extensively in the development and modification of curriculum. The purpose of this study was to look at medical student surveys of a radiology lecture series, evaluating the accuracy of student perceptions of learning and factors affecting them. After a "Case of the Week" lecture series, 156 3rd-year medical students returned a survey evaluating the experience with 10 questions on a four-point scale (1 = disagree, 4 = agree very much) and took a clinical competency assessment (CCA) examination with a radiology substation. Survey responses were compared with actual examination performance, analyzed for how overall learning was characterized in specific educational objectives, and evaluated for factors affecting perceived learning. The mean response for perceived CCA examination preparedness was 1.83. The mean radiology station test score was 90.43%. Correlations between student perception of learning and the scoring of focused learning objectives ranged from 0.33 to 0.48 (P < .01). Students responding 1 to items assessing perceived lecture organization, stimulation to read, and interest in the field of radiology had mean scores for perception of overall learning of 2.09-2.44 and mean scores for recommendation of course continuation of 1.68-2.46. Students responding 4 had means of 3.25-3.81 and 3.06-4.0, respectively. Student perceptions of the value of curriculum were inaccurate compared with external measures of performance, and students poorly related their general impressions to specific learning objectives. Perceived lecture organization, stimulation to read, and interest in radiology as a specialty affected perceived overall learning and perceived value of the lecture series.