Improve Pitch Perception Research Articles

Enhanced neural phase locking through audio-tactile stimulation.

Numerous studies have underscored the close relationship between the auditory and vibrotactile modality. For instance, in the peripheral structures of both modalities, afferent nerve fibers synchronize their activity to the external sensory stimulus, thereby providing a temporal code linked to pitch processing. The Frequency Following Response is a neurological measure that captures this phase locking activity in response to auditory stimuli. In our study, we investigated whether this neural signal is influenced by the simultaneous presentation of a vibrotactile stimulus. Accordingly, our findings revealed a significant increase in phase locking to the fundamental frequency of a speech stimulus, while no such effects were observed at harmonic frequencies. Since phase locking to the fundamental frequency has been associated with pitch perceptual capabilities, our results suggests that audio-tactile stimulation might improve pitch perception in human subjects.

The burst gap is a peripheral temporal code for pitch perception that is shared across audition and touch

When tactile afferents were manipulated to fire in periodic bursts of spikes, we discovered that the perceived pitch corresponded to the inter-burst interval (burst gap) in a spike train, rather than the spike rate or burst periodicity as previously thought. Given that tactile frequency mechanisms have many analogies to audition, and indications that temporal frequency channels are linked across the two modalities, we investigated whether there is burst gap temporal encoding in the auditory system. To link this putative neural code to perception, human subjects (n = 13, 6 females) assessed pitch elicited by trains of temporally-structured acoustic pulses in psychophysical experiments. Each pulse was designed to excite a fixed population of cochlear neurons, precluding place of excitation cues, and to elicit desired temporal spike trains in activated afferents. We tested periodicities up to 150 Hz using a variety of burst patterns and found striking deviations from periodicity-predicted pitch. Like the tactile system, the duration of the silent gap between successive bursts of neural activity best predicted perceived pitch, emphasising the role of peripheral temporal coding in shaping pitch. This suggests that temporal patterning of stimulus pulses in cochlear implant users might improve pitch perception.

Pitch Perception With the Temporal Limits Encoder for Cochlear Implants.

The temporal-limits-encoder (TLE) strategy has been proposed to enhance the representation of temporal fine structure (TFS) in cochlear implants (CIs), which is vital for many aspects of sound perception but is typically discarded by most modern CI strategies. TLE works by computing an envelope modulator that is within the temporal pitch limits of CI electric hearing. This paper examines the TFS information encoded by TLE and evaluates the salience and usefulness of this information in CI users. Two experiments were conducted to compare pitch perception performance of TLE versus the widely-used Advanced Combinational Encoder (ACE) strategy. Experiment 1 investigated whether TLE processing improved pitch discrimination compared to ACE. Experiment 2 parametrically examined the effect of changing the lower frequency limit of the TLE modulator on pitch ranking. In both experiments, F0 difference limens were measured with synthetic harmonic complex tones using an adaptive procedure. Signal analysis of the outputs of TLE and ACE strategies showed that TLE introduces important temporal pitch cues that are not available with ACE. Results showed an improvement in pitch discrimination with TLE when the acoustic input had a lower F0 frequency. No significant effect of lower frequency limit was observed for pitch ranking, though a lower limit did tend to provide better outcomes. These results suggest that the envelope modulation introduced by TLE can improve pitch perception for CI listeners.

Electro-Tactile Stimulation Enhances Cochlear-Implant Melody Recognition: Effects of Rhythm and Musical Training.

Electro-acoustic stimulation (EAS) enhances speech and music perception in cochlear-implant (CI) users who have residual low-frequency acoustic hearing. For CI users who do not have low-frequency acoustic hearing, tactile stimulation may be used in a similar fashion as residual low-frequency acoustic hearing to enhance CI performance. Previous studies showed that electro-tactile stimulation (ETS) enhanced speech recognition in noise and tonal language perception for CI listeners. Here, we examined the effect of ETS on melody recognition in both musician and nonmusician CI users. Nine musician and eight nonmusician CI users were tested in a melody recognition task with or without rhythmic cues in three testing conditions: CI only (E), tactile only (T), and combined CI and tactile stimulation (ETS). Overall, the combined electrical and tactile stimulation enhanced the melody recognition performance in CI users by 9% points. Two additional findings were observed. First, musician CI users outperformed nonmusicians CI users in melody recognition, but the size of the enhancement effect was similar between the two groups. Second, the ETS enhancement was significantly higher with nonrhythmic melodies than rhythmic melodies in both groups. These findings suggest that, independent of musical experience, the size of the ETS enhancement depends on integration efficiency between tactile and auditory stimulation, and that the mechanism of the ETS enhancement is improved electric pitch perception. The present study supports the hypothesis that tactile stimulation can be used to improve pitch perception in CI users.

Association Between Flat-Panel Computed Tomographic Imaging–Guided Place-Pitch Mapping and Speech and Pitch Perception in Cochlear Implant Users

Cochlear implant users generally display poor pitch perception. Flat-panel computed tomography (FPCT) has recently emerged as a modality capable of localizing individual electrode contacts within the cochlea in vivo. Significant place-pitch mismatch between the clinical implant processing settings given to patients and the theoretical maps based on FPCT imaging has previously been noted. To assess whether place-pitch mismatch is associated with poor cochlear implant-mediated pitch perception through evaluation of an individualized, image-guided approach toward cochlear implant programming on speech and music perception among cochlear implant users. A prospective cohort study of 17 cochlear implant users with MED-EL electrode arrays was performed at a tertiary referral center. The study was conducted from June 2016 to July 2017. Theoretical place-pitch maps using FPCT secondary reconstructions and 3-dimensional curved planar re-formation software were developed. The clinical map settings (eg, strategy, rate, volume, frequency band range) were modified to keep factors constant between the 2 maps and minimize confounding. The acclimation period to the maps was 30 minutes. Participants performed speech perception tasks (eg, consonant-nucleus-consonant, Bamford-Kowal-Bench Speech-in-Noise, vowel identification) and a pitch-scaling task while using the image-guided place-pitch map (intervention) and the modified clinical map (control). Performance scores between the 2 interventions were measured. Of the 17 participants, 10 (58.8%) were women; mean (SD) was 59 (11.3) years. A significant median increase in pitch scaling accuracy was noted when using the experimental map compared with the control map (4 more correct answers; 95% CI, 0-8). Specifically, the number of pitch-scaling reversals for notes spaced at 1.65 semitones or greater decreased when an image-based approach to cochlear implant programming was used vs the modified clinical map (4 mistakes; 95% CI, 0.5-7). Although there was no observable median improvement in speech perception during use of an image-based map, the acute changes in frequency allocation and electrode channel deactivations used with the image-guided maps did not worsen consonant-nucleus-consonant (-1% correct phonemes, 95% CI, -2.5% to 6%) and Bamford-Kowal-Bench Speech-in-Noise (0.5-dB difference; 95% CI, -0.75 to 2.25 dB) median performance results relative to the clinical maps used by the patients. An image-based approach toward ochlear implant mapping may improve pitch perception outcomes by reducing place-pitch mismatch. Studies using a longer acclimation period with chronic stimulation over months may help assess the full range of the benefits associated with personalized image-guided cochlear implant mapping.

An integrated model of pitch perception incorporating place and temporal pitch codes with application to cochlear implant research

Although the neural mechanisms underlying pitch perception are not yet fully understood, there is general agreement that place and temporal representations of pitch are both used by the auditory system. This paper describes a neural network model of pitch perception that integrates both codes of pitch and explores the contributions of, and the interactions between, the two representations in simulated pitch ranking trials in normal and cochlear implant hearing. The model can replicate various psychophysical observations including the perception of the missing fundamental pitch and sensitivity to pitch interval sizes. As a case study, the model was used to investigate the efficiency of pitch perception cues in a novel sound processing scheme, Stimulation based on Auditory Modelling (SAM), that aims to improve pitch perception in cochlear implant hearing. Results showed that enhancement of the pitch perception cues would lead to better pitch ranking scores in the integrated model only if the place and temporal pitch cues were consistent.

Place dependent stimulation rates improve pitch perception in cochlear implantees with single-sided deafness

In normal hearing, the pitch of an acoustic tone can theoretically be encoded by either the place of stimulation in the cochlea or the corresponding rate of vibration. Thus spectral attributes and temporal fine structure of an acoustic signal are naturally correlated. Cochlear implants (CIs), neural prosthetic devices that restore hearing in the profoundly hearing impaired, currently disregard this mechanism; electrical stimulation is provided at fixed electrode positions with default place independent stimulation rate assignments. This does not account for individual cochlear encoding depending on electrode array placement, variations in insertion depth, and the proximity to nerve fibers. Encoding pitch in such manner delivers limited tonal information. Consequently, music appraisal in CI users is often rated cacophonic while speech perception in quiet is close to normal in top performers. We hypothesize that this limitation in electric stimulation is at least partially due to the mismatch between frequency and place encoding in CIs. In the present study, we determined individual electrode locations by analysis of cochlear radiographic images obtained after surgery and calculated place dependent stimulation rates according to models of the normal tonotopic function. Pitch matching in CI users with single-sided deafness shows that place dependent stimulation rates allow thus far unparalleled restoration of tonotopic pitch perception. Collapsed data of matched pitch frequencies as a function of calculated electrical stimulation rate were well fitted by linear regression (R2 = 0.878). Sound processing strategies incorporating place dependent stimulation rates are expected to improve pitch perception in CI users.

Excitation Patterns of Standard and Steered Partial Tripolar Stimuli in Cochlear Implants.

Current steering in partial tripolar (pTP) mode has been shown to improve pitch perception and spectral resolution with cochlear implants (CIs). In this mode, a fraction (σ) of the main electrode current is returned within the cochlea and steered between the basal and apical flanking electrodes (with a proportion of α and 1 - α, respectively). Pitch generally decreases when α increases from 0 to 1, although the salience of pitch change varies across CI users. This study aimed to identify the mechanism of pitch changes with pTP-mode current steering and the factors contributing to the intersubject variability in pitch-ranking sensitivity. The electrical fields were measured for steered pTP stimuli on the same main electrode with α = 0, 0.5, and 1 in five implanted ears using electrical field imaging (EFI). The related excitation patterns were also measured physiologically using evoked compound action potential (ECAP) and psychophysically using psychophysical forward masking (PFM). Consistent with the pitch-ranking results in this study, the EFI, ECAP, and PFM centroids shifted apically with increasing α. An apical shift was also observed for the PFM peak but not for the EFI or ECAP peak. The pattern width was similar with different α values within a given measure (e.g., EFI, ECAP, or PFM), but the ECAP patterns were broader than the EFI and PFM patterns, possibly because ECAP was measured with smaller σ values than EFI and PFM. The amount of pattern shift with α depended on σ (i.e., the total amount of current used for steering) but was not correlated with the pitch-ranking sensitivity across subjects. The results revealed that the pitch changes elicited by pTP-mode current steering were not only driven by the shifts of excitation centroid.

Speech perception with F0mod, a cochlear implant pitch coding strategy

Objective: The fundamental frequency modulation (F0mod) sound processing strategy was developed to improve pitch perception with cochlear implants. In previous work it has been shown to improve performance in a number of pitch-related tasks such as pitch ranking, familiar melody identification, and Mandarin Chinese tone identification. The objective of the current study was to compare speech perception with F0mod and the standard clinical advanced combination encoder (ACE) strategy. Study sample: Seven cochlear-implant listeners were recruited from the clinical population of the University Hospital Leuven. Design: F0mod was implemented on a real-time system. Speech recognition in quiet and noise was measured for seven cochlear-implant listeners, comparing F0mod with ACE, using three different Dutch-language speech materials. Additionally the F0 estimator used was evaluated physically, and pitch ranking performance was compared between F0mod and ACE. Results: Immediately after switch-on of the F0mod strategy, speech recognition in quiet and noise were similar for ACE and F0mod, for four out of seven listeners. The remaining three listeners were subjected to a short training protocol with F0mod, after which their performance was reassessed, and a significant improvement was found. Conclusions: As F0mod improves pitch perception, for the seven subjects tested it did not interfere with speech recognition in quiet and noise, and has a low computational complexity, it seems promising for implementation in a clinical sound processor.

Contribution of nonimplanted ear to pitch perception for prelingually deafened cochlear implant recipients.

Bimodal stimulation (BMS) has been shown to be beneficial for the performance of pitch ranking in postlingually deafened adults. However, the contribution of nonimplanted ears to pitch perception with respect to duration of hearing aid (HAs) use for prelingually cochlear implantees remained unclear. This study aimed to investigate whether experiences/duration of HAs use in the nonimplanted ear improved pitch perception ability in this population of subjects. Twenty-nine children with congenital/prelingual deafness of profound degree were studied. Test stimuli consisted of 2 sequential piano tones, ranging from C (256 Hz) to B (495 Hz). Children were asked to identify the pitch relationship between the 2 tones (i.e., same, higher, or lower). Duration of HAs use was the major factor related to the correct rate for pitch perception. Overall correct rate for pitch perception (O) could be best predicted by duration of HAs use (DuA) (O = 0.561XDuA, r = 0. 315, p = 0.002). Experiences of HAs use appear to improve pitch perception ability in prelingually cochlear implantees. This suggests that incorporation of HAs use early in life and through the postoperative rehabilitation program for prelingually deafened children with cochlear implants would be beneficial, although an association does not guarantee causality. A longitudinal study is needed to show whether improvement of music performance with duration of HAs use in these children is measurable using auditory evoked potentials.

PITCH PERCEPTION IN AN AUDITORY PROSTHESIS

A sound processing process, device and software are disclosed which seek to improve pitch perception, with particular application to auditory prostheses. After input sound signals are processed into channels, an algorithm is applied to selectively increase the modulation depth of the envelope signals. In certain embodiments, the channelized signals are adjusted in timing so as to align the phase of modulated envelope signals in different channels. This results in provision of synchronous (phase aligned) modulation periodicity across channels and hence less pitch ambiguity for listeners to the processed signal, or for application of the signal to hearing prostheses such as cochlear implants. In some embodiments, a broadband envelope signal is used to modulate the level of the narrow band channel signals, so that voicing frequency modulation information in the broadband envelope signal is provided in all narrow band channel signals and the phase of modulated signals in the channels are aligned. A preferred form uses an envelope signal which is modified to increase its modulation depth, and is normalized so as to allow for modulation of the channel signals.

Music Training Improves Pitch Perception in Prelingually Deafened Children With Cochlear Implants

The comparatively poor music appreciation in patients with cochlear implants might be ascribed to an inadequate exposure to music; however, the effect of training on music perception in prelingually deafened children with cochlear implants remains unknown. This study aimed to investigate whether previous musical education improves pitch perception ability in these children. Twenty-seven children with congenital/prelingual deafness of profound degree were studied. Test stimuli consisted of 2 sequential piano tones, ranging from C (256 Hz) to B (495 Hz). Children were asked to identify the pitch relationship between the 2 tones (same, higher, or lower). Effects of musical training duration, pitch-interval size, current age, age of implantation, gender, and type of cochlear implant on accuracy of pitch perception were evaluated. The duration of musical training positively correlated with the correct rate of pitch perception. Pitch perception performance was better in children who had a cochlear implant and were older than 6 years than in those who were aged < or =6 years (ie, preschool). Effect of pitch-interval size was insignificant on pitch perception, and there was no correlation between pitch perception and the age of implantation, gender, or type of cochlear implant. Musical training seems to improve pitch perception ability in prelingually deafened children with a cochlear implant. Auditory plasticity might play an important role in such enhancement. This suggests that incorporation of a structured training program on music perception early in life and as part of the postoperative rehabilitation program for prelingually deafened children with cochlear implants would be beneficial. A longitudinal study is needed to show whether improvement of music performance in these children is measurable by use of auditory evoked potentials.

Improved fundamental frequency coding in cochlear implant signal processing

A new signal processing algorithm for improved pitch perception in cochlear implants is proposed. The algorithm realizes fundamental frequency (F0) coding by explicitly modulating the amplitude of the electrical stimulus. The proposed processing scheme is compared with the standard advanced combination encoder strategy in psychophysical music perception related tasks. Possible filter-bank and loudness cues between the strategies under study were minimized to predominantly focus on differences in temporal processing. The results demonstrate significant benefits provided by the new coding strategy for pitch ranking, melodic contour identification, and familiar melody identification.

Use of a single channel dedicated to conveying enhanced temporal periodicity cues in cochlear implants: Effects on prosodic perception and vowel identification

The continuous interleaved sampling (CIS) strategy for cochlear implants has well-established limitations for the perception of pitch changes in speech. This study investigated a modification of CIS in which one channel was dedicated to the transmission of a temporal encoding of fundamental frequency (F0). Normal hearing subjects listening to noise-excited vocoders, and implantees were tested on labelling the pitch movement of diphthongal glides, on using intonation information to identify sentences as question or statement, and on vowel recognition. There were no significant differences between modified processing and CIS in vowel recognition. However, while there was limited evidence of improved pitch perception relative to CIS with simplified F0 modulation applied to the most basal channel, in general it appears that for most implant users, restricting F0-related modulation to one channel does not provide significantly enhanced pitch information.

Pitch discrimination of patterned electric stimulation

One reason for the poor pitch performance in current cochlear-implant users may be the highly synchronized neural firing in electric hearing that lacks stochastic properties of neural firing in normal acoustic hearing. This study used three different electric stimulation patterns, jittered, probabilistic, and auditory-model-generated pulses, to mimic some aspects of the normal neural firing pattern in acoustic hearing. Pitch discrimination was measured at standard frequencies of 100, 250, 500, and 1000 Hz on three Nucleus-24 cochlear-implant users. To test the utility of the autocorrelation pitch perception model in electric hearing, one, two, and four electrodes were stimulated independently with the same patterned electric stimulation. Results showed no improvement in performance with any experimental pattern compared to the fixed-rate control. Pitch discrimination was actually worsened with the jittered pattern at low frequencies (125 and 250 Hz) than that of the control, suggesting that externally introduced stochastic properties do not improve pitch perception in electric stimulation. The multiple-electrode stimulation did not improve performance but did not degrade performance either. The present results suggest that both "the right time and the right place" may be needed to restore normal pitch perception in cochlear-implant users.

Improved Pitch Perception with Training on a Single Tone

The present investigation was concerned with whether pitch judgment could be improved through practice. A preliminary study revealed that S's with training in music could judge pitches more accurately (with smaller average error) than subjects with little or no training. If S was a pianist, he named piano tones more accurately than pure tones. It appeared that pitch judgment was related to familiarity with musical tones. Music students who did not possess “absolute pitch” were given systematic training with a pure tone. The essential feature of the method was concentration on identifying a single reference standard—A4 (440 cps). Although other tones were presented, S was required to recognize only A4. 5 sec after each A4 was presented, a light signal came on and remained on while A4 was repeated. Experiment I showed that with practice S's improved their ability to recognize A4 in a random series of tones. Experiment II showed that, following this training, performance on a test in which 10 tones were named had improved significantly over ability prior to training. By comparison, training in which S is required to name each tone and is immediately told the correct response to each was not found to be effective.