Pitch-shifted Auditory Feedback Research Articles

Experience-dependent neural substrates involved in vocal pitch regulation during singing

Proper singing requires the integration of auditory feedback mechanisms with the vocal motor system, such that vocal pitch can be precisely controlled. To determine the neural substrates involved in audio-vocal integration, non-musicians and experienced singers underwent fMRI scanning while they sang a single tone with either unaltered (“simple”) or pitch-shifted auditory feedback; in pitch-shifted trials, subjects were instructed either to ignore or compensate for the shifted feedback. We hypothesized that the anterior cingulate cortex (ACC), superior temporal gyrus (STG), and anterior insula may be involved in audio-vocal integration due to their functional roles during singing and their anatomical connectivity. Although singers were more accurate than non-musicians in simple singing, both groups recruited similar functional networks. Singers ignored the shifted feedback better than non-musicians, and both groups also displayed different patterns of neural activity for this task: singers recruited bilateral auditory areas and left putamen, while non-musicians recruited the left supramarginal gyrus and primary motor cortex. While there were no significant group differences in performing the compensate task, singers displayed enhanced activity in the ACC, superior temporal sulcus, and putamen, whereas non-musicians exhibited increased activity in the dorsal premotor cortex, a region involved with sensorimotor interactions. We propose two neural substrates for audio-vocal integration: the dorsal premotor cortex may act as a basic interface, but with vocal training and practice, the ACC, auditory cortices, and putamen may be increasingly recruited as people learn to monitor their auditory feedback and adjust their vocal output accordingly.

Compensatory responses to loudness-shifted voice feedback during production of Mandarin speech

Previous studies have demonstrated that perturbations in voice pitch or loudness feedback lead to compensatory changes in voice F(0) or amplitude during production of sustained vowels. Responses to pitch-shifted auditory feedback have also been observed during English and Mandarin speech. The present study investigated whether Mandarin speakers would respond to amplitude-shifted feedback during meaningful speech production. Native speakers of Mandarin produced two-syllable utterances with focus on the first syllable, the second syllable, or none of the syllables, as prompted by corresponding questions. Their acoustic speech signal was fed back to them with loudness shifted by +/-3 dB for 200 ms durations. The responses to the feedback perturbations had mean latencies of approximately 142 ms and magnitudes of approximately 0.86 dB. Response magnitudes were greater and latencies were longer when emphasis was placed on the first syllable than when there was no emphasis. Since amplitude is not known for being highly effective in encoding linguistic contrasts, the fact that subjects reacted to amplitude perturbation just as fast as they reacted to F(0) perturbations in previous studies provides clear evidence that a highly automatic feedback mechanism is active in controlling both F(0) and amplitude of speech production.

Compensation for pitch-shifted auditory feedback during the production of Mandarin tone sequences.

Recent research has found that while speaking, subjects react to perturbations in pitch of voice auditory feedback by changing their voice fundamental frequency (F0) to compensate for the perceived pitch-shift. The long response latencies (150-200 ms) suggest they may be too slow to assist in on-line control of the local pitch contour patterns associated with lexical tones on a syllable-to-syllable basis. In the present study, we introduced pitch-shifted auditory feedback to native speakers of Mandarin Chinese while they produced disyllabic sequences /ma ma/ with different tonal combinations at a natural speaking rate. Voice F0 response latencies (100-150 ms) to the pitch perturbations were shorter than syllable durations reported elsewhere. Response magnitudes increased from 50 cents during static tone to 85 cents during dynamic tone productions. Response latencies and peak times decreased in phrases involving a dynamic change in F0. The larger response magnitudes and shorter latency and peak times in tasks requiring accurate, dynamic control of F0, indicate this automatic system for regulation of voice F0 may be task-dependent. These findings suggest that auditory feedback may be used to help regulate voice F0 during production of bi-tonal Mandarin phrases.

Voice F0 responses to pitch-shifted auditory feedback: a preliminary study.

Auditory feedback has been suggested to be important for voice fundamental frequency (F0) control. The present study featured a new technique for testing this hypothesis by which the pitch of a subject's voice was modulated, fed back over earphones, and the resultant change in the emitted voice F0 was measured. The responses of 67 normal, healthy young adults were recorded as they attempted to ignore intermittent upward or downward shifts in pitch feedback while they sustained steady vowel sounds (/a/) or sang musical scales. Ninety-six percent of subjects increased their F0 when the feedback pitch was decreased, and 78% of subjects decreased their F0 when the pitch feedback was increased. Latencies of responses ranged from 104 to 223 ms. Results indicate people normally rely on pitch feedback to control voice F0.

Selective vocal effects of delayed auditory feedback.

Selective vocal effects of delayed auditory feedback.