Abstract
The present study focuses on the integration of an automatic question generation (AQG) system and a computerised adaptive test (CAT). We conducted two experiments. In the first experiment, we administered sets of questions to English learners to gather their responses. We further used their responses in the second experiment, which is a simulation-based experiment of the AQG and CAT integration. We proposed a method to integrate them with a predetermined item difficulty that enables to integrate AQG and CAT without administering the items in a pretesting. The result showed that all CAT simulations performed better than the baseline, a linear test, in estimating the test taker’s true proficiency.
Highlights
One of the prominent research in the computer-assisted language testing field is an effective measurement of the test taker’s proficiency
We generated the question items using the automatic question generation (AQG) system explained in the ‘Automatic question generation (AQG)’ section and administered them to the English learners
We propose the use of predetermined item difficulty for conducting the computerised adaptive test (CAT) simulation to demonstrate the feasibility of integrating AQG with CAT without item calibration
Summary
One of the prominent research in the computer-assisted language testing field is an effective measurement of the test taker’s proficiency. CAT aims at a precise and reliable measure of test taker’s proficiency by presenting items that are appropriate to their proficiency (van der Linden and Glas 2000). A high-proficiency test taker would receive items that are more difficult compared to low-proficiency test takers. CAT evaluates the test taker’s proficiency after the response of each item and updates the estimated proficiency to select the item to present to the test taker. This can subside the drawback of the conventional linear test where all test takers answer the same set of items in the same order regardless of the difference in their proficiency
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callMore From: Research and Practice in Technology Enhanced Learning
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
