Abstract
This study employed a mixed-design approach and the Many-Facet Rasch Measurement (MFRM) framework to investigate whether rater bias occurred between the onscreen scoring (OSS) mode and the paper-ba...
Highlights
With the continual advances in information technology and the widespread use of the Internet, many test development agencies have replaced traditional paper-based scoring (PBS) with onscreen scoring (OSS), known as onscreen marking (OSM; Bennett, 2003; Chen, White, McCloskey, Soroui, & Chun, 2011; Coniam, 2011b; Hunsu, 2015)
The paper scripts are marked more leniently than scanned counterparts. This tendency indicates that the composite score of the 250 testees for the paper scripts is unfairly higher than that given for the scanned scripts
It must be noted that the scanned scripts are marked more harshly overall, it does not imply that all nine raters exhibit identical bias patterns
Summary
With the continual advances in information technology and the widespread use of the Internet, many test development agencies have replaced traditional paper-based scoring (PBS) with onscreen scoring (OSS), known as onscreen marking (OSM; Bennett, 2003; Chen, White, McCloskey, Soroui, & Chun, 2011; Coniam, 2011b; Hunsu, 2015). In OSS mode, the handwritten essays are scanned and saved as PDF (or other image files) within the test administrators’ servers, and raters retrieve, read, and mark the scanned scripts from computer screens in OSS centers or remotely via the Internet. In 2007, this mode was first implemented in Hong Kong; in 2011, Taiwan applied it to the General Scholastic Ability Test (GSAT)—a nationwide, mandatory, and high-stakes test for college admission. In other countries, such as China, Australia, India, and the United Kingdom, OSS mode has been introduced into their testing systems (Coniam, 2011a). As OSS mode allows raters to mark scanned handwritten scripts at any time and location with an online connection and permission to access the OSS servers, this significantly increases assessment efficiency by reducing any constraints of time and location
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
