Deciphering phonemes from syllables in blood oxygenation level-dependent signals in human superior temporal gyrus.

Abstract

Linguistic units such as phonemes and syllables are important for speech perception. How the brain encodes these units is not well understood. Many neuroimaging studies have found distinct representations of consonant-vowel syllables that shared one phoneme and differed in the other phoneme (e.g. /ba/ and /da/), but it is unclear whether this discrimination ability is due to the neural coding of phonemes or syllables. We combined functional magnetic resonance imaging with multivariate pattern analysis to explore this question. Subjects listened to nine Mandarin syllables in a consonant-vowel form. We successfully decoded phonemes from the syllables based on the blood oxygenation level-dependent signals in the superior temporal gyrus (STG). Specifically, a classifier trained on the cortical patterns elicited by a set of syllables, which contained two phonemes, could distinguish the cortical patterns elicited by other syllables that contained the two phonemes. The results indicated that phonemes have unique representations in the STG. In addition, there was a categorical effect, i.e. the cortical patterns of consonants were similar, and so were the cortical patterns of vowels. Further analysis showed that phonemes exhibited stronger encoding specificity in the mid-STG than in the anterior STG.