Abstract

This study seeks to analyze the construct validity of the mock TOEIC test by utilizing corpus analysis indicators. A commercial corpus program extracted key indicators related to vocabulary and syntax on a mock TOEIC test. A correlation analysis examined the relationship between these indicators and test results. It was possible to observe the causal relationship between corpus indices and variations in test scores when the test was taken two times. The regression analysis showed that the usefulness of the mock TOEIC test was lowered if the coefficient values of the corpus factors that had a significant effect on the change in grades in the first and second tests did not show a constant pattern in one direction (positive or negative). The results demonstrate that each indicator is complex and their influence on test grades varies depending on test types. Overall, most corpus indices used in this study showed poor predictive power of changes in test scores, and it was revealed that the mock TOEIC test is an evaluation tool lacking in authenticity. This paper contributes to the academic literature by demonstrating the possibility of using a corpus index as a usefulness verification tool. Usefulness verification can be established by examining the causal relationship between the repeated actual scores of the mock TOEIC test and the corpus index.

Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call