The effect of speech degradation on the ability to track and predict turn structure in conversation

Abstract

Conversation represents a considerable amount of the daily language usage and plays an important role in language acquisition. In conversation, listeners simultaneously process their interlocutor's turn and prepare their own next turn. As such the turn-taking dynamics heavily relies on prediction. In other words, listeners avail prior knowledge to constrain both speech perception and production. Here we explored the relation between prediction and comprehension while watching two interlocutors having a conversation. We capitalize on gaze switch as a proxy of predictive behaviour to class dialogue turns as more or less well predicted and explore how this affects dialogue comprehension. Moreover, we study the extent to which speech degradation, by increasing the global uncertainty of the context, affects the relation between predictions, brain correlates of prediction errors (N400) and global comprehension. Results show that 1) listeners direct gaze to the current speaker, in particular in challenging conditions, 2) gaze behaviour possibly affects the semantic processing of the upcoming turn (N400), 3) participants with a more efficient gaze predictive behaviour better solve semantic uncertainties at the turn onset, in particular in the most challenging listening condition. Our findings contribute to a better understanding of the relation between predictions, neural predictions errors and speech comprehension under challenging conditions.