Altered Auditory Feedback Research Articles

Sensorimotor adaptation across the speech production workspace in response to a palatal perturbation.

Talkers have been shown to adapt the production of multiple vowel sounds simultaneously in response to altered auditory feedback. The present study extends this work by exploring the adaptation of speech production to a physical alteration of the vocal tract involving a palatal prosthesis that impacts both somatosensory and auditory feedback during the production of a range of consonants and vowels. Acoustic and kinematic measures of the tongue were used to examine the impact of the physical perturbation across the various speech sounds, and to assess learned changes following 20 min of speech practice involving the production of complex, variable sentences. As in prior studies, acoustic analyses showed perturbation and adaptation effects primarily for sounds directly involving interaction with the palate. Analyses of tongue kinematics, however, revealed systematic, robust effects of the perturbation and subsequent motor learning across the full range of speech sounds. The results indicate that speakers are able to reconfigure oral motor patterns during the production of multiple speech sounds spanning the articulatory workspace following a physical alteration of the vocal tract.

Perception of One's Own Voice After Hearing-Aid Fitting for Naive Hearing-Aid Users and Hearing-Aid Refitting for Experienced Hearing-Aid Users.

Dissatisfaction with the sound of one’s own voice is common among hearing-aid users. Little is known regarding how hearing impairment and hearing aids separately affect own-voice perception. This study examined own-voice perception and associated issues before and after a hearing-aid fitting for new hearing-aid users and refitting for experienced users to investigate whether it was possible to differentiate between the effect of (unaided) hearing impairment and hearing aids. Further aims were to investigate whether First-Time and Experienced users as well as users with dome and mold inserts differed in the severity of own-voice problems. The study had a cohort design with three groups: First-Time hearing-aid users going from unaided to aided hearing (n = 70), Experienced hearing-aid users replacing their old hearing aids (n = 70), and an unaided control group (n = 70). The control group was surveyed once and the hearing-aid users twice; once before hearing-aid fitting/refitting and once after. The results demonstrated that own-voice problems are common among both First-Time and Experienced hearing-aid users with either dome- or mold-type fittings, while people with near-normal hearing and not using hearing aids report few problems. Hearing aids increased ratings of own-voice problems among First-Time users, particularly those with mold inserts. The results suggest that altered auditory feedback through unaided hearing impairment or through hearing aids is likely both to change own-voice perception and complicate regulation of vocal intensity, but hearing aids are the primary reason for poor perceived sound quality of one’s own voice.

Does passive sound attenuation affect responses to pitch-shifted auditory feedback?

The role of auditory feedback in vocal production has mainly been investigated by altered auditory feedback (AAF) in real time. In response, speakers compensate by shifting their speech output in the opposite direction. Current theory suggests this is caused by a mismatch between expected and observed feedback. A methodological issue is the difficulty to fully isolate the speaker's hearing so that only AAF is presented to their ears. As a result, participants may be presented with two simultaneous signals. If this is true, an alternative explanation is that responses to AAF depend on the contrast between the manipulated and the non-manipulated feedback. This hypothesis was tested by varying the passive sound attenuation (PSA). Participants vocalized while auditory feedback was unexpectedly pitch shifted. The feedback was played through three pairs of headphones with varying amounts of PSA. The participants' responses were not affected by the different levels of PSA. This suggests that across all three headphones, PSA is either good enough to make the manipulated feedback dominant, or differences in PSA are too small to affect the contribution of non-manipulated feedback. Overall, the results suggest that it is important to realize that non-manipulated auditory feedback could affect responses to AAF.

The Relationship Between Speech Perceptual Discrimination and Speech Production in Parkinson's Disease.

Purpose We recently demonstrated that individuals with Parkinson's disease (PD) respond differentially to specific altered auditory feedback parameters during speech production. Participants with PD respond more robustly to pitch and less robustly to formant manipulations compared to control participants. In this study, we investigated whether differences in perceptual processing may in part underlie these compensatory differences in speech production. Methods Pitch and formant feedback manipulations were presented under 2 conditions: production and listening. In the production condition, 15 participants with PD and 15 age- and gender-matched healthy control participants judged whether their own speech output was manipulated in real time. During the listening task, participants judged whether paired tokens of their previously recorded speech samples were the same or different. Results Under listening, 1st formant manipulation discrimination was significantly reduced for the PD group compared to the control group. There was a trend toward better discrimination of pitch in the PD group, but the group difference was not significant. Under the production condition, the ability of participants with PD to identify pitch manipulations was greater than that of the controls. Conclusion The findings suggest perceptual processing differences associated with acoustic parameters of fundamental frequency and 1st formant perturbations in PD. These findings extend our previous results, indicating that different patterns of compensation to pitch and 1st formant shifts may reflect a combination of sensory and motor mechanisms that are differentially influenced by basal ganglia dysfunction.

Abnormal Sensorimotor Integration in Adults Who Stutter: A Behavioral Study by Adaptation of Delayed Auditory Feedback.

Stuttering is a fluency disorder, partially alleviated during altered auditory feedback, suggesting abnormal sensorimotor integration in adults who stutter (AWS). As weighting of multiple integrating-information sources would be decided based on their reliabilities, the use of external (auditory feedback) and internal information (prediction of sensory consequences) could correlate with speech processing. We hypothesized that abnormal auditory-feedback processing in AWS could be related to decrease in internal processing precision. We used a perceptual-adaptation experiment of delayed auditory feedback (DAF) to verify the hypothesis. Seventeen AWS and 17 adults who do not stutter (ANS) were required to say “ah” and judge the simultaneity between their motor sensations and vocal sounds in each stimulus onset asynchrony (SOA) (0, 25, 50, 75, 100, 125, or 150 ms) after inducing adaptation of DAF (three conditions with 0-, 66-, or 133-ms delay). While no adaptation occurred during the 0 ms condition, perceptual change in simultaneity judgment (adaptation effect) occurred during the 66 and 133 ms conditions. The simultaneity judgments following exposure in each SOA were fitted to the psychometric function in each condition for the AWS and ANS groups. We calculated the μ (signifying the point of subjective simultaneity and adaptation-effect degree) and σ (signifying the detecting precision) of each function and analyzed them by parametric analyses. For the μ, participant groups and adaptation conditions showed a significant interaction; the adaptation effect was greater in the AWS than in the ANS group. Additionally, the μ and σ were only positively correlated in the AWS group. The point of subjective simultaneity for auditory delay by inducing DAF was higher in AWS than in ANS, indicating that perception of simultaneity in AWS was influenced by DAF to a greater extent. Moreover, the significant positive correlation between the μ and σ in AWS showed that the more imprecise the internal auditory processing, the more AWS relied on auditory feedback. It is suggested that the reliability of internal information differed within the AWS group, and AWS with reduced internal reliability appeared to compensate by relying to a great extent on auditory feedback information.

Rapid modulations of the vocal structure in marmoset monkeys

Humans and some animal species show flexibility in vocal production either voluntarily or in response to environmental cues. Studies have shown rapid spectrotemporal changes in speech or vocalizations during altered auditory feedback in humans, songbirds and bats. Non-human primates, however, have long been considered lacking the ability to modify spectrotemporal structures of their vocalizations. Here we tested the ability of the common marmoset (Callithrix jacchus), a highly vocal New World primate species to alter spectral and temporal structures of their species-specific vocalizations in the presence of perturbation signals. By presenting perturbation noises while marmosets were vocalizing phee calls, we showed that they were able to change in real-time the duration or spectral trajectory of an ongoing phee phrase by either terminating it before its completion, making rapid shifts in fundamental frequency or in some cases prolonging the duration beyond the natural range of phee calls. In some animals, we observed fragmented phee calls which were not produced by marmosets in their natural environment. Interestingly, some perturbation-induced changes persisted even in the absence of the perturbation noises. These observations provide further evidence that marmoset monkeys are capable of rapidly modulating their vocal structure and suggested potential voluntary vocal control by this non-human primate species.

The lexical bias in older adults’ compensation to altered auditory feedback

The lexical bias in older adults’ compensation to altered auditory feedback

Recalibration of auditory perception of speech due to orofacial somatosensory inputs during speech motor adaptation.

Speech motor control and learning rely on both somatosensory and auditory inputs. Somatosensory inputs associated with speech production can also affect the process of auditory perception of speech, and the somatosensory-auditory interaction may play a fundamental role in auditory perception of speech. In this report, we show that the somatosensory system contributes to perceptual recalibration, separate from its role in motor function. Subjects participated in speech motor adaptation to altered auditory feedback. Auditory perception of speech was assessed in phonemic identification tests before and after speech adaptation. To investigate a role of the somatosensory system in motor adaptation and subsequent perceptual change, we applied orofacial skin stretch in either a backward or forward direction during the auditory feedback alteration as a somatosensory modulation. We found that the somatosensory modulation did not affect the amount of adaptation at the end of training, although it changed the rate of adaptation. However, the perception following speech adaptation was altered depending on the direction of the somatosensory modulation. Somatosensory inflow rather than motor outflow thus drives changes to auditory perception of speech following speech adaptation, suggesting that somatosensory inputs play an important role in tuning of perceptual system.NEW & NOTEWORTHY This article reports that the somatosensory system works not equally with the motor system, but predominantly in the calibration of auditory perception of speech by speech production.

Partial compensation to delayed auditory feedback: An analysis of syllable duration.

Altered feedback perturbation studies have shown that speakers only partially compensate for shifts in vocal pitch, intensity, or spectral content. The partial compensation generally plateaus around 30%-40% of the non-shifted, baseline production and is proposed to reflect the integrated effect of altered (auditory) and non-altered (somatosensory) sensory feedback. The authors hypothesized that the same pattern should hold for changes in syllable duration with delayed auditory feedback. To test this, the authors calculated average syllable duration from 21 young adults who read a standard passage as auditory feedback was delayed by 0, 10, 50, 100, 200, 300, and 600 ms. Given the complex nature of speech errors elicited under delayed auditory feedback, the authors compared durational effects across two broad error categories: prolongations and repetitions. Average syllable duration increased non-linearly and reached a peak near 40% of baseline durations. Separated by error type, prolongations, and distortions made up 89% of perceived errors. Only 9% of perceived errors were identified as repetitions. Unlike prolongations, however, the duration of repeated tokens ranged from 74% to 110% of the target syllable and compensated fully for the delay. These results are consistent with the notion that increasing syllable duration compensates partially for delays in auditory feedback. The compensation pattern resembles that of responses to other forms of altered auditory feedback, which suggests that this may be a general attribute of low-level, sensorimotor compensation. The higher frequency of prolongation occurrences further suggests that these may be the primary means of compensation for delayed auditory feedback. Repetitions, on the other hand, likely reflect compensatory mechanisms of higher-level motor planning or sequencing processes.

Hand Shape Familiarity Affects Guitarists’ Perception of Sonic Congruence

ABSTRACTMusical performance depends on the anticipation of the perceptual consequences of motor behavior. Altered auditory feedback (AAF) has previously been used to investigate auditory-motor coupling but studies to date have predominantly used MIDI piano in experimental tasks. In the present study, we extend the AAF paradigm to the guitar, which differs from the piano both motorically and in its pitch-to-place mapping, allowing further investigation into the nature of this coupling. Guitarists played chords on a MIDI guitar in response to tablature diagrams. In half of the trials, one of the notes in the heard chord was artificially altered. Participants judged whether the feedback was altered or not, responding as quickly and accurately as possible by pressing one of two buttons on a footswitch. Participants ranked the familiarity of the chord shapes and the hand shapes of the stimuli. Judgement of sonic congruence was faster when the chord and hand shape were familiar, and when feedback was congruent, though there was no interaction between these factors. Our findings suggest that guitarists’ auditory-motor coupling is heterogenous with respect to their technique, and that perception-action coupling operates at the abstract level of the gesture. We discuss implications of these findings with regard to forward models and embodiment.

Consistency influences altered auditory feedback processing.

Previous research on the effect of perturbed auditory feedback in speech production has focused on two types of responses. In the short term, speakers generate compensatory motor commands in response to unexpected perturbations. In the longer term, speakers adapt feedforward motor programmes in response to feedback perturbations, to avoid future errors. The current study investigated the relation between these two types of responses to altered auditory feedback. Specifically, it was hypothesised that consistency in previous feedback perturbations would influence whether speakers adapt their feedforward motor programmes. In an altered auditory feedback paradigm, formant perturbations were applied either across all trials (the consistent condition) or only to some trials, whereas the others remained unperturbed (the inconsistent condition). The results showed that speakers' responses were affected by feedback consistency, with stronger speech changes in the consistent condition compared with the inconsistent condition. Current models of speech-motor control can explain this consistency effect. However, the data also suggest that compensation and adaptation are distinct processes, which are not in line with all current models.

Effect of deep brain stimulation on vocal motor control mechanisms in Parkinson's disease

IntroductionDeep brain stimulation (DBS) of the subthalamic nucleus (STN) is an effective treatment for limb motor symptoms in Parkinson's disease (PD); however, its effect on vocal motor function has yielded conflicted and highly variable results. The present study investigated the effects of STN-DBS on the mechanisms of vocal production and motor control. MethodsA total of 10 PD subjects with bilateral STN-DBS implantation were tested with DBS ON and OFF while they performed steady vowel vocalizations and received randomized upward or downward pitch-shift stimuli (±100 cents) in their voice auditory feedback. ResultsData showed that the magnitude of vocal compensation responses to pitch-shift stimuli was significantly attenuated during DBS ON vs. OFF (p = 0.012). This effect was direction-specific and was only observed when subjects raised their voice fundamental frequency (F0) in the opposite direction to downward stimuli (p = 0.019). In addition, we found that voice F0 perturbation (i.e. jitter) was significantly reduced during DBS ON vs. OFF (p = 0.022), and this DBS-induced modulation was positively correlated with the attenuation of vocal compensation responses to downward pitch-shift stimuli (r = +0.57, p = 0.028). ConclusionsThese findings provide the first data supporting the role of STN in vocal F0 motor control in response to altered auditory feedback. The DBS-induced attenuation of vocal compensation responses may result from increased inhibitory effects of the subcortical hyperdirect (fronto-subthalamic) pathways on the vocal motor cortex, which can help stabilize voice F0 and ameliorate vocal motor symptoms by impeding PD subjects’ abnormal (i.e. overshooting) vocal responses to alterations in the auditory feedback.

The Role of Auditory Feedback at Vocalization Onset and Mid-Utterance.

Auditory feedback plays an important role in monitoring and correcting for errors during speech production. Previous research suggests that at vocalization onset, auditory feedback is compared to a sensory prediction generated by the motor system to ensure the desired fundamental frequency (F0) is produced. After vocalization onset, auditory feedback is compared to the most recently perceived F0 in order to stabilize the vocalization. This study aimed to further investigate whether after vocalization onset, auditory feedback is used strictly to stabilize speakers’ F0, or if it is also influenced by the sensory prediction generated by the motor system. Event-related potentials (ERP) were recorded while participants produced vocalizations and heard the F0 of their auditory feedback perturbed suddenly mid-utterance by half a semitone. For half of the vocalizations, at vocalization onset, participants’ F0 was also raised by half a semitone. Thus, half of the perturbations occurred while participants heard their unaltered auditory feedback, and the other half occurred in auditory feedback that had also been perturbed 50 cents at vocalization onset. If after vocalization onset auditory feedback is strictly used to stabilize speakers’ F0, then similarly sized vocal and ERP responses would be expected across all trials, regardless of whether the perturbation occurred while listening to altered or unaltered auditory feedback. Results indicate that the perturbations to the participants’ unaltered auditory feedback resulted in larger vocal and N1 and P2 ERP responses than perturbations to their altered auditory feedback. These results suggest that after vocalization onset auditory feedback is not strictly used to stabilize speakers’ F0, but is also used to ensure the desired F0 is produced.

Sensorimotor Control of Speech and Children’s Reading Ability

ABSTRACTStudies of the role of phonological representations in learning to read have almost exclusively focused on speech perception. In the current study, we examined links between sensorimotor control of speech, reading, and reading-related abilities. We studied two languages, English and Dutch, which vary in the regularity of their spelling-to-sound mappings. There were 236 American and Dutch children, 4 to 8 years old, who performed an altered auditory feedback task in which the first formant of the /ɛ/ vowel was altered. A stronger response to altered feedback for literate relative to preliterate children was observed, and this was particularly the case for the Dutch children. Moreover, the magnitude of the responses was related to precursors of reading in preliterate children and to reading skill in literate children. We propose that these findings could be related to changes in children’s speech production skills that facilitate the integration of orthographic and phonemic information.

Self-monitoring in the cerebral cortex: Neural responses to small pitch shifts in auditory feedback during speech production

Speaking is a complex motor skill which requires near instantaneous integration of sensory and motor-related information. Current theory hypothesizes a complex interplay between motor and auditory processes during speech production, involving the online comparison of the speech output with an internally generated forward model. To examine the neural correlates of this intricate interplay between sensory and motor processes, the current study uses altered auditory feedback (AAF) in combination with magnetoencephalography (MEG). Participants vocalized the vowel/e/and heard auditory feedback that was temporarily pitch-shifted by only 25 cents, while neural activity was recorded with MEG. As a control condition, participants also heard the recordings of the same auditory feedback that they heard in the first half of the experiment, now without vocalizing. The participants were not aware of any perturbation of the auditory feedback. We found auditory cortical areas responded more strongly to the pitch shifts during vocalization. In addition, auditory feedback perturbation resulted in spectral power increases in the θ and lower β bands, predominantly in sensorimotor areas. These results are in line with current models of speech production, suggesting auditory cortical areas are involved in an active comparison between a forward model's prediction and the actual sensory input. Subsequently, these areas interact with motor areas to generate a motor response. Furthermore, the results suggest that θ and β power increases support auditory-motor interaction, motor error detection and/or sensory prediction processing.

Auditory prediction during speaking and listening

In the present EEG study, the role of auditory prediction in speech was explored through the comparison of auditory cortical responses during active speaking and passive listening to the same acoustic speech signals. Two manipulations of sensory prediction accuracy were used during the speaking task: (1) a real-time change in vowel F1 feedback (reducing prediction accuracy relative to unaltered feedback) and (2) presenting a stable auditory target rather than a visual cue to speak (enhancing auditory prediction accuracy during baseline productions, and potentially enhancing the perturbing effect of altered feedback). While subjects compensated for the F1 manipulation, no difference between the auditory-cue and visual-cue conditions were found. Under visually-cued conditions, reduced N1/P2 amplitude was observed during speaking vs. listening, reflecting a motor-to-sensory prediction. In addition, a significant correlation was observed between the magnitude of behavioral compensatory F1 response and the magnitude of this speaking induced suppression (SIS) for P2 during the altered auditory feedback phase, where a stronger compensatory decrease in F1 was associated with a stronger the SIS effect. Finally, under the auditory-cued condition, an auditory repetition-suppression effect was observed in N1/P2 amplitude during the listening task but not active speaking, suggesting that auditory predictive processes during speaking and passive listening are functionally distinct.

The potential use of Forbrain® in stuttering: A single-case study

We present a single-case study on the potential clinical relevance of a new altered auditory feedback (AAF) device (Forbrain®) in stuttering. One adult who stutter was tested in an appropriately-controlled single-case time-series (A-B-A) study. On each of six consecutive working days, the stuttering adult was instructed to read aloud during three different experimental phases: Baseline, Test and Post-test, while wearing a Forbrain® headset. During the Test phase the device was turned on, whereas it was off during Baseline and Post-test phases. This way the transient effects of Forbrain® could be analyzed. Six quantitative measures of voice quality were retrieved from the participant's voice recordings during his readings over each phase of the experiment. Data was statistically analyzed through the single-case d-statistic. A clear transient effect of Forbrain®, when turned on, was observed on voice quality, supported by significant differences between Baseline and Test, and Test and Post-test in the tilt of the trendline of the long term average spectrum (tLTAS) of the voice. The present single-case study support the effectiveness of Forbrain® in modifying the voice during stuttering, supporting its role as an AAF device.

Neural bases of sensorimotor adaptation in the vocal motor system.

The present study used event-related potential (ERP) recordings to investigate the neural mechanisms of sensorimotor adaptation in response to altered auditory feedback (AAF) during vocal production. 12 healthy speakers were tested under a vocal motor adaptation paradigm in which the fundamental frequency (F0) of their voice auditory feedback was pitch-shifted downward by one semi-tone (- 100 cents) during vowel vocalizations. Behavioral results revealed that subjects adapted to AAF by producing opposing (upward) responses to pitch-shift stimuli, and this adaptive behavior persisted after feedback alteration was removed (washout). We found that adaptation to AAF was accompanied by a significant increase in the amplitude of a parietal ERP activityelicited after the onset of vocalization. However, no such effect was observed for pre-motor ERPs elicited before vocalization onset. Moreover, we found that adaptive vocal responses were negatively correlated with ERPs over the parietal and positively correlated with those over the fronto-central areas after vocalization onset. These findings suggest that vocal motor adaptation is mediated by sensorimotor reprogramming of feedforward motor commands through incorporating auditory feedback, which is indexed by modulation of behavioral and ERP responses to AAF. We suggest that modulation of neural activities in the parietal cortex highlights its significance as a neural interface for sensorimotor integration and indicates its critical role in vocal motor adaptation. Our findings support the notion that the parietal mechanisms are involved in driving adaptive motor behavior to cope with unexpected changes in the sensory environment to accomplish communication goals during vocal production and motor control.

The Potential Effect of Forbrain as an Altered Auditory Feedback Device

The purpose of this study was to run a proof of concept on a new commercially available device, Forbrain® (Sound For Life Ltd/Soundev, Luxemburg, model UN38.3), to test whether it can modulate the speech of its users. Participants were instructed to read aloud a text of their choice during 3 experimental phases: baseline, test, and posttest, while wearing a Forbrain® headset. Critically, for half of the participants (Forbrain group), the device was turned on during the test phase, whereas for the other half (control group), the device was kept off. Voice recordings were analyzed to derive 6 quantitative measures of voice quality over each of the phases of the experiment. A significant Group × Phase interaction was obtained for the smoothed cepstral peak prominence, a measure of voice harmony, and for the trendline of the long-term average spectrum, a measure of voice robustness, this latter surviving Bonferroni correction for multiple comparisons. The results of this study indicate the effectiveness of Forbrain® in modifying the speech of its users. It is suggested that Forbrain® works as an altered auditory feedback device. It may hence be used as a clinical device in speech therapy clinics, yet further studies are warranted to test its usefulness in clinical groups.

Online Adaptation to Altered Auditory Feedback Is Predicted by Auditory Acuity and Not by Domain-General Executive Control Resources.

When a speaker's auditory feedback is altered, he adapts for the perturbation by altering his own production, which demonstrates the role of auditory feedback in speech motor control. In the present study, we explored the role of auditory acuity and executive control in this process. Based on the DIVA model and the major cognitive control models, we expected that higher auditory acuity, and better executive control skills would predict larger adaptation to the alteration. Thirty-six Spanish native speakers performed an altered auditory feedback experiment, executive control (numerical Stroop, Simon and Flanker) tasks, and auditory acuity tasks (loudness, pitch, and melody pattern discrimination). In the altered feedback experiment, participants had to produce the pseudoword “pep” (/pep/) while perceiving their auditory feedback in real time through earphones. The auditory feedback was first unaltered and then progressively altered in F1 and F2 dimensions until maximal alteration (F1 −150 Hz; F2 +300 Hz). The normalized distance of maximal adaptation ranged from 4 to 137 Hz (median of 75 ± 36). The different measures of auditory acuity were significant predictors of adaptation, while individual measures of cognitive function skills (obtained from the executive control tasks) were not. Better auditory discriminators adapted more to the alteration. We conclude that adaptation to altered auditory feedback is very well-predicted by general auditory acuity, as suggested by the DIVA model. In line with the framework of motor-control models, no specific claim on the implication of executive resources in speech motor control can be made.