Abstract

Computer-based testing (CBT), which refers to delivering assessments with computers, has been widely used in large English proficiency tests worldwide. Despite an increasing CBT in China, limited research is available concerning whether CBT can be used for the Test for English Majors-Band 4 (TEM 4). The current study investigated whether testing mode impacted TEM 4 score and factors (i.e., computer familiarity level and attitude towards CBT) that might correlate with performance on CBT of TEM 4. Overall 92 Chinese undergraduate students were randomly assigned to one of the groups, i.e., CBT or paper-based testing (PBT), and took the test. A mixed method was employed, including (1) quantitative and qualitative analysis of test performance in two modes, as well as CBT group participants’ computer familiarity and attitudes towards the mode; and (2) thematic analysis of semi-structured interviews. The results revealed that (1) test scores in CBT and PBT were comparable; (2) two items in the computer familiarity questionnaire, i.e., comfort level of reading articles on the computer and forgetting time when using computers, positively correlated with CBT scores; and (3) participants’ attitude towards CBT did not impact test performance.

Highlights

  • BackgroundThe history of exams and tests in China can be traced back to the imperial period some 2000 years ago (202 BC–220 AD) (Bai, 2020)

  • Before running the multivariate analysis of variance (MANOVA) analysis, the figures of Kurtosis and Skewness showed that the assumption of univariate normality was satisfied, and the results of Levene's test of homogeneity of variances indicated that the assumption of homogeneity of variances was satisfied

  • In response to the increasing adoption of computer technology in China, this study investigated the comparability of Computer-based testing (CBT) and paper-based testing (PBT) in Test for English Majors (TEM) 4 and two learner factors which might have affected the test performance

Read more

Summary

Introduction

BackgroundThe history of exams and tests in China can be traced back to the imperial period some 2000 years ago (202 BC–220 AD) (Bai, 2020). As China has seen growing participation in the international community, English is increasingly significant for English as a Foreign Language (EFL) learners at all stages of education (Jin, 2010). The Chinese Ministry of Education (MOE) has organized many different Fan examinations at both provincial and national levels, including the College English Test (CET) and Test for English Majors (TEM) (Li, 2019). Test for English Majors-Band 4 Test for English Majors-Band 4 (TEM 4) is a national English proficiency test intended for English-majored undergraduate students in tertiary education in China (Fan et al, 2020), and the annual test is used to evaluate students’ English proficiency and achievement in listening, reading, and writing (Jin & Yan, 2017)

Methods
Results
Discussion
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call