Abstract

This study aimed to examine the effect of using items from previous exams on students’ pass-fail rates and on the psychometric properties of the tests and items.
 
 The study included data from 115 tests and 11,500 items used in the midterm and final exams of 3,910 students in the preclinical term at the Faculty of Medicine from 2014 to 2019. Data were analyzed using descriptive statistics related to the total test scores, item difficulty and item discrimination values, and internal consistency values for reliability. The Shapiro-Wilks test was used to evaluate the distribution structure, and t test were used to analyze the differences between groups.
 
 The findings showed that the mean item repetition rate from 2014 to 2019 ranged from 16.98% to 39.00%. The total score variance decreased significantly as the percentage of test items increased. There was a significant, moderately positive relationship between the percentage of repeated test items and the number of students eligible to pass their grades. Item difficulty values obtained from initial item use were significantly lower than those obtained from repeated item use.
 
 We conclude that test items and answer keys should not be published by test makers unless they have the means such as the infrastructure, budget, and personnel to develop new items in place of the ones previously published in test banks.

Highlights

  • Cognitive skills that are tried to be gained to individuals by education and should be measured are listed by Krathwohl (2002) as the levels of remembering, understanding, applying, analyzing, evaluating and creating from the lowest level to the highest level

  • To present meaningful discussions for countries and institutions concerned about the outcomes of using previously used items and publishing test items, this study aimed to examine the effect of repeating test items on students‟ pass-fail rates and on the psychometric properties of tests and items

  • This study was planned as a basic research because it aimed to examine whether the repeated use of test items in subsequent exams had significant effects on students‟ pass-fail rates and on the psychometric properties of items and tests (Royce, Straits, & Straits, 1993)

Read more

Summary

Introduction

Cognitive skills that are tried to be gained to individuals by education and should be measured are listed by Krathwohl (2002) as the levels of remembering, understanding, applying, analyzing, evaluating and creating from the lowest level to the highest level. This ranking shows that the simplest skill group is found at the level of remembering. As doing so could push students to merely memorize information only This may cause the skills that are tried to be gained to individuals by education not to go beyond the level of remembering (Erkuş, 2006)

Objectives
Methods
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call