EXAMINING THE ADEQUACY OF AN EXIT EXAM TO MEASURE DIPLOMA STUDENTS' ACHIEVEMENT: RASCH ANALYSIS

Abstract

Purpose of the study: This paper examines the adequacy of an exit exam using the Rasch Model. It also addresses the students' achievement on the exam items according to Learning Outcomes (LOs) i.e. what LOs have been achieved and have not been achieved.
 Main Findings: The Rasch analyses showed‎ that there were issues related to the adequacy of the exit exam in terms of the items' validity and items' distribution along the interval scale. The items' qualitative investigation revealed that the stems and options of some items have problems. Overall, the exam was easy for the students, and students scored different achievement according to Learning Outcomes (LOs). These findings highlight the importance of using measurement ‎models to validate exams as well as to provide a more accurate interpretation of ‎students' achievement; Rasch Model is an example.
 Methodology: The descriptive quantitative research design was utilized to achieve the research objectives. An exam comprises 100 Multiple choice items/questions administered to 322 students taking Professional Diploma in Teaching at a College of Education. The items cover eight 8 Learning Outcomes that students were expected to achieve when completed all the Professional Diploma courses. The collected data were analyzed using the Rasch Model for dichotomous data, and Winsteps software 4.1.0 (2018).
 Applications of this study: The study provides insightful information to higher institutions in general and to colleges of education to revamp the implementation of diploma teaching programs, mainly the assessment methods.
 Novelty/Originality of this study: This paper extends the evidence of providing academic staff at higher institutions with necessary information and training on measurement to come out with more informed decisions.