Score Equivalence, Gender Difference, and Testing Mode Preference in a Comparative Study between Computer- Based Testing and Paper-Based Testing

Mohammad Reza Ebrahimi,Vahide Shahbazi,Seyyed Morteza Hashemi Toroujeni

doi:10.3991/ijet.v14i07.10175

Abstract

Abstract—Score equivalency of two Computer-Based Testing (henceforth CBT) and Paper-and-Pencil-Based Testing (henceforth PBT) versions has turned into a controversial issue during the last decade in Iran. The comparability of mean scores obtained from two CBT and PBT formats of test should be investigated to see if test takers’ testing performance is influenced by the effects of testing administration mode. This research was conducted to examine score equivalency across modes as well as the relationship of gender, and testing mode preference with test takers’ performance on computerized testing. The information of testing mode preference and attitudes towards CBT and its features was supported by a focus group interview. Findings indicated that the scores of test takers were not different in both modes and there was no statistically significant relationship between moderator above variables and CBT performance.

Highlights

Sometimes technological developments have such great influences on human life that some scholars and sociologists categorize mankind history based on the produced technological tools
The received results and two sets of scores of test takers have been analyzed by the statistical package to find out any statistically significant difference between the two modes
Several researchers have concluded that CBT version of the test resulted in lower scores than paper-based tests on participants’ achievement (e.g. [34]), analysis of participants’ testing performance in both PBT and CBT revealed that there was not any significant difference between the two sets of scores obtained from two formats of the test, and the test scores of participants were not different in paperbased and computer-based versions of the test

Summary

Introduction

Sometimes technological developments have such great influences on human life that some scholars and sociologists categorize mankind history based on the produced technological tools. According to the assessment researcher, Stuart Bennett- a quite committed and enthusiastic proponent of technology- who is interested in researching measurement, new technology’s transformative impacts on assessment domain makes it possible to impel someone manages something well and satisfactorily by building some tests based on the conceptualization of preconditions and qualifications. He declared that by enjoying technological assessment tools to create tests, test takers’ performance could be practically assessed through computerbased simulations, item, and item bank creation and scoring process. It is highly likely that teachers utilize computers in administering tests as they are readily available [4]

Methods

Results

Conclusion