The Validation Process in Developing a Web-based English Speaking and Writing Test

Abstract

This article summarizes findings from investigations into the development and use of a Web-based English speaking and writing test for local use as a low-stakes test. The study focused on the validation process in language test development of the test following Kim’s (2006a) testing model. Two research questions were proposed to examine test validity and task difficulty of the test. 53 test takers at a Korean university participated in the test implementation and a post-survey. Validity arguments were gathered from design and validation implications in test development, test results, and survey data, which built validity evidence in the Usefulness Analysis Table (Bachman & Palmer, 1996). They evidenced validity of the test and its development. Research findings from the statistical analysis of the test results and survey reported that test takers need more preparation time and response time on writing and familiarity enhancement with task content. The findings on task difficulty across proficiency levels indicated that both groups showed similar perceptions of task difficulty while the test takers in the low level group revealed that their difficulty perceptions were inappropriate for overall and writing scores.