You good?: Examining the role of intonation and eyebrow movements in sentence type distinction

Abstract

By analyzing the pitch accents, edge tones, and eyebrow movements of African American English (AAE) speakers, this study examines the coordination of prosody and co-speech gestures. Twelve self-identified AAE speakers engaged in scripted dialogues with an AAE-speaking confederate via Zoom. Half of the dialogues contained the polysemous AAE idiomatic phrase “you good” which has declarative and interrogative forms hypothesized to be distinguished by various eyebrow and intonation patterns. The other dialogues included non-idiomatic phrases semantically related to their “you good” equivalents. These dialogues were designed to explore whether the coordination patterns for the idioms occur with non-idiomatic utterances of the same sentence type. Acoustic data is prosodically annotated using the MAE-ToBI transcription system and visual eyebrow data is tracked using OpenFace 2.0, a facial landmark detection toolkit. The derived eyebrow movement trajectories are time-aligned with the pitch trajectories for the semi-automatic labeling of multimodal signals. The temporal relationship between eyebrow movement landmarks, pitch accents, and edge tones is examined to investigate how different meanings and sentence types are created through their coordination. Preliminary examination indicates intonationally similar contours for the idiomatic and non-idiomatic interrogative phrases, but shared and consistent intonational contours are not evident in the declarative data.