Reflections on the Application and Validation of Technology in Language Testing

Abstract

ABSTRACT This paper highlights as issues of concern the rapid changes in technology and the tendency to report on partial validation efforts where the work is not identified as forming part of a larger validation project. With close human supervision emerging technologies can have a significant and positive impact on language testing. While technology seems to be constantly changing and improving, there is still a lot to learn in the approaches these papers take in identifying aspects of the constructs of interest amenable to operationalization and measurement through technology. In terms of validation, the paper suggests a number of important things to consider. These include presenting assessment arguments in a form that meets the needs of the stakeholder groups most clearly affected by the claims being made; working towards an interactive communication-based argument approach, ideally involving validators who are independent of the developer; and ensuring that any “partial” validation is explicitly linked to a broader argument. The paper ends by predicting that technology will see the practice of language testing changing radically from where it is today and while fairness, justice and validation will always be primary concerns, the challenges associated with establishing evidence of these will only increase.