The effect of spectral manipulations on the identification of affective and linguistic prosody

Abstract

We investigated the effect of various spectral manipulations on the identification of sentential prosody. Two main categories of prosody— affective (happy, angry, sad) and linguistic (statement, question, continuation)—were studied. Thirty-six subjects were presented with stimuli that were recorded by a female native speaker of American English. The stimuli were digitally manipulated to create synthesized, band-pass filtered (F0-range and F2/F3-range) and re-entrant (pitch only version of stimulus is convolved with a steady-state signal) conditions. Results of a forced-choice discrimination paradigm showed that, in general, performance is remarkably robust despite spectral manipulation, even when there is relatively little spectral information. However, performance was significantly degraded in the low band-pass and re-entrant conditions. These observations are discussed in light of the relevance of the fundamental frequency as well as syllabification for the analysis of prosodic information.