Dependency distance measures in assessing L2 writing proficiency

Abstract

Syntactic complexity is one of the key research foci in writing assessment. This study combines traditional syntactic complexity (SC) measures with newly-proposed dependency distance measures to better assess second language (L2) SC development. Based on a syntactically-annotated corpus of 400 compositions, we aim to investigate the extent to which the traditional SC measures and dependency distance measures can differentiate the writing proficiency of beginner, intermediate, and advanced learners. In terms of traditional SC measures, length-based measures fare better when pinpointing the different writing proficiency levels, but none of these can significantly differentiate all adjacent levels. As for dependency distance measures, the overall mean dependency distance can significantly discriminate all pairs of adjacent proficiency levels, serving as the best metric explored in our study. Moreover, dependency distance measures can further explain the findings of the traditional SC measures from the perspective of language processing.