Impact of adopting a newly developed blueprinting method and relating it to item analysis on students’ performance

Abstract

Background: In order to achieve validity of assessment results in the basic imaging module, an integrated assessment practice was introduced. The purpose of this article is to evaluate the impact of utilizing the created exam blueprint and relating its results to item analysis on students’ achievement of the learning objectives as reflected in their overall performance scores and satisfaction.Methods: A simple blueprint method was created by the authors. Cross-sectional study was performed on two groups of students: one did not utilize blueprinting while the other did. Data were retrieved from the results of two questionnaires evaluating the students’ satisfaction of the course and of their perception of ILO; students’ scores; and from item analysis results. The adopted assessment practice was evaluated using the modified and expanded version of Kirkpatrick’s model.Results: Group B results outperformed group A reflected as statistically higher students’ scores, satisfaction, perceived and actual achievement of the assessed learning outcomes, and higher psychometric indices of the exams.Conclusion: The method adopted by using the newly developed blueprinting method and relating it to item analysis results has positive impact on the validity and reliability of students’ performance results and their satisfaction in relation to intended learning outcomes.