Investigating Effects of Tasks on Examinee Performance in a Computer-Delivered Speaking Test

Abstract

With growing interest in test tasks to define language ability, numerous task effects have been examined in second language speaking assessment, especially in semi-direct tests. Due to the nature of semi-direct tests, where real interaction is missing, tasks play a crucial role in eliciting examinee language for evaluation. However, task effects have rarely been investigated separately for different proficiency levels based on both statistical and qualitative analyses. To this end, the current study examined the effects of independent and integrated speaking tasks on the test performance at two proficiency levels of examinees. Twelve examinees (six intermediate and six advanced) responded to five speaking tasks (two independent and three integrated) in a computer-delivered, semi-direct speaking test. A many-facet Rasch measurement analysis of examinee scores on five scoring criteria found that the two groups of examinees did not have the same level of difficulty with independent and integrated tasks. The following qualitative analysis of actual responses showed that both intermediate and advanced examinees were influenced by listening texts of integrated tasks, but for different reasons and at varying degrees. The findings contribute to a better understanding of task effects that vary across different speaking levels.