Applying computer-based language test to young children.

Abstract

This study aims at exploring the feasibility of applying a computer-based language test to young children aged 2-4 years. Thirty-two Cantonese-speaking children, aged 2-4 years, were recruited from local kindergartens. All participants underwent assessment using both the computer-based and paper-pencil versions of the Macau Cantonese Language Screening Scale for Preschool Children, following a crossover study design. A short break of 15-30 minutes was provided between the two assessments. The data were analysed at three levels: the overall test, subcategory, and individual item levels. At the overall test and subcategory levels, data were analysed using the paired samples t-test and ICC. At the item level, the percentage of agreement and Cohen's kappa value were selected to assess the agreement of the two test formats. Excellent agreement was found for the overall test level, and good agreement was observed for four of the five subcategories. At the individual item level, 28 of the 35 items showed more than 80% agreement, and 16 items showed substantial to almost perfect agreement. These results suggest that the two test formats give similar total scores and subcategory scores for children aged 2-4. For children older than 2 years, 6 months, the agreement for matching items is as high as 83.68% (1318/1575). The computer-based test is thus highly recommended for this group of children. For children younger than 2 years, 6 months, a modified computer-based test is suggested to accommodate their needs.