Empirical CALL evaluation

Abstract

CALL evaluation is important because it is the most efficient means to prove CALL effectiveness. While both learning process and learning outcome should be investigated in empirical evaluation, the precise relationship between the two needs to be examined closely. Only by doing so can we identify useful CALL design features that facilitate relevant user-computer interaction which can lead to an improved learning outcome. This study examined how certain user actions can affect or predict receptive/productive vocabulary retention in a computer-assisted vocabulary learning (CAVL) program. Results showed that only the user actions which contributed to identifiable levels of vocabulary processing--those at which (a) the initial meaning-form mappings of the vocabulary items are established and (b) the vocabulary items are practiced in different contexts--significantly accounted for vocabulary retention. In addition, user actions accounted for receptive vocabulary retention better than for productive vocabulary retention.