Amplitude-modulated Pulse Trains Research Articles

Psychoacoustic and electroencephalographic responses to changes in amplitude modulation depth and frequency in relation to speech recognition in cochlear implantees

Temporal envelope modulations (TEMs) are one of the most important features that cochlear implant (CI) users rely on to understand speech. Electroencephalographic assessment of TEM encoding could help clinicians to predict speech recognition more objectively, even in patients unable to provide active feedback. The acoustic change complex (ACC) and the auditory steady-state response (ASSR) evoked by low-frequency amplitude-modulated pulse trains can be used to assess TEM encoding with electrical stimulation of individual CI electrodes. In this study, we focused on amplitude modulation detection (AMD) and amplitude modulation frequency discrimination (AMFD) with stimulation of a basal versus an apical electrode. In twelve adult CI users, we (a) assessed behavioral AMFD thresholds and (b) recorded cortical auditory evoked potentials (CAEPs), AMD-ACC, AMFD-ACC, and ASSR in a combined 3-stimulus paradigm. We found that the electrophysiological responses were significantly higher for apical than for basal stimulation. Peak amplitudes of AMFD-ACC were small and (therefore) did not correlate with speech-in-noise recognition. We found significant correlations between speech-in-noise recognition and (a) behavioral AMFD thresholds and (b) AMD-ACC peak amplitudes. AMD and AMFD hold potential to develop a clinically applicable tool for assessing TEM encoding to predict speech recognition in CI users.

Pitch discrimination in electric hearing with inconsistent and consistent amplitude-modulation and inter-pulse rate cues.

Users of cochlear implants (CIs) struggle in situations that require selective hearing to focus on a target source while ignoring other sources. One major reason for that is the limited access to timing cues such as temporal pitch or interaural time differences (ITDs). Various approaches to improve timing-cue sensitivity while maintaining speech understanding have been proposed, among them inserting extra pulses with short inter-pulse intervals (SIPIs) into amplitude-modulated (AM) high-rate pulse trains. Indeed, SIPI rates matching the naturally occurring AM rates improve pitch discrimination. For ITD, however, low SIPI rates are required, potentially mismatching the naturally occurring AM rates and thus creating unknown pitch effects. In this study, we investigated the perceptual contribution of AM and SIPI rate to pitch discrimination in five CI listeners and with two AM depths (0.1 and 0.5). Our results show that the SIPI-rate cue generally dominated the percept for both consistent and inconsistent cues. When tested with inconsistent cues, also the AM rate contributed, however, at the large AM depth only. These findings have implications when aiming at jointly improving temporal-pitch and ITD sensitivity in a future mixed-rate stimulation approach.

Using Interleaved Stimulation and EEG to Measure Temporal Smoothing and Growth of the Sustained Neural Response to Cochlear-Implant Stimulation.

Two EEG experiments measured the sustained neural response to amplitude-modulated (AM) high-rate pulse trains presented to a single cochlear-implant (CI) electrode. Stimuli consisted of two interleaved pulse trains with AM rates F1 and F2 close to 80 and 120Hz respectively, and where F2 = 1.5F1. Following Carlyon et al. (J Assoc Res Otolaryngol, 2021), we assume that such stimuli can produce a neural distortion response (NDR) at F0 = F2-F1 Hz if temporal dependencies ("smoothing") in the auditory system are followed by one or more neural nonlinearities. In experiment 1, the rate of each pulse train was 480 pps and the gap between pulses in the F1 and F2 pulse trains ranged from 0 to 984µs. The NDR had a roughly constant amplitude for gaps between 0 and about 200-400µs, and decreased for longer gaps. We argue that this result is consistent with a temporal dependency, such as facilitation, operating at the level of the auditory nerve and/or with co-incidence detection by cochlear-nucleus neurons. Experiment 2 first measured the NDR for stimuli at each listener's most comfortable level ("MCL") and for F0 = 37, 40, and 43Hz. This revealed a group delay of about 42ms, consistent with a thalamic/cortical source. We then showed that the NDR grew steeply with stimulus amplitude and, for most listeners, decreased by more than 12dB between MCL and 75% of the listener's dynamic range. We argue that the NDR is a potentially useful objective estimate of MCL.

Investigation of locked operation in a system of two passively mode-locked semiconductor lasers under weak lateral coupling

We study theoretically the operation of two semiconductor passively mode-locked lasers laterally coupled through evanescent fields. The investigation is carried out using a time domain traveling wave numerical model for two-section lasers (gain and absorption) enhanced to include weak mutual coupling. The study of the coupled system shows that although the operation is dominated mostly by instabilities and amplitude modulated pulse trains, under specific conditions, stable mode locking with low intensity noise and time-synchronized pulses emerges. The influence of operational and geometrical parameters on the coupled dynamics is identified and discussed.

Vestibular Co-stimulation in Adults with a Cochlear Implant.

Background : Vestibular co-stimulation is a side effect of cochlear implant stimulation. The electrical currents delivered by the cochlear implant can spread toward the vestibular system and thus stimulate it. The aim of the study is to evaluate whether it is feasible to functionally restore the balance by modifying the vestibular co-stimulation.Methods: Four adult patients, who had received a commercially available cochlear implant previously, were enrolled. Counterbalanced biphasic pulses were presented as bursts or as an amplitude-modulated biphasic pulse train (modulation frequencies ranging from 1 to 500 Hz) at the participant’s upper comfortable level for electrical stimulation. Subjective sensations and vestibular-mediated eye movements were used for evaluating the possible effects of vestibular co-stimulation.Results: One participant experienced a cyclic tilting of his head in response to an amplitude-modulated biphasic pulse train with a modulation frequency of 2 and 400 Hz. However, during a follow-up visit, the sensation could not be replicated.Conclusion: Subjective vestibular sensations or vestibular-mediated eye movements could not be electrically evoked with a commercially available cochlear implant in 4 adult patients with almost normal vestibular function. Therefore, customized design of the hard-, firm-, and/or software of the commercially available cochlear implant might be necessary in order to electrically restore vestibular performance.

Using Interleaved Stimulation to Measure the Size and Selectivity of the Sustained Phase-Locked Neural Response to Cochlear Implant Stimulation

We measured the sustained neural response to electrical stimulation by a cochlear implant (CI). To do so, we interleaved two stimuli with frequencies F1 and F2 Hz and recorded a neural distortion response (NDR) at F2-F1 Hz. We show that, because any one time point contains only the F1 or F2 stimulus, the instantaneous nonlinearities typical of electrical artefact should not produce distortion at this frequency. However, if the stimulus is smoothed, such as by charge integration at the nerve membrane, subsequent (neural) nonlinearities can produce a component at F2-F1 Hz. We stimulated a single CI electrode with interleaved sinusoids or interleaved amplitude-modulated pulse trains such that F2 = 1.5F1, and found no evidence for an NDR when F2-F1 was between 90 and 120 Hz. However, interleaved amplitude-modulated pulse trains with F2-F1~40 Hz revealed a substantial NDR with a group delay of about 45 ms, consistent with a thalamic and/or cortical response. The NDR could be measured even from recording electrodes adjacent to the implant and at the highest pulse rates (> 4000 pps) used clinically. We then measured the selectivity of this sustained response by presenting F1 and F2 to different electrodes and at different between-electrode distances. This revealed a broad tuning that, we argue, reflects the overlap between the excitation elicited by the two electrodes. Our results also provide a glimpse of the neural nonlinearity in the auditory system, unaffected by the biomechanical cochlear nonlinearities that accompany acoustic stimulation. Several potential clinical applications of our findings are discussed.

Characterizing Cochlear implant artefact removal from EEG recordings using a real human model

Electroencephography (EEG) recordings from CI listeners are contaminated by electrical artefacts that make it difficult to extract neural responses. Previously, we have removed these artefacts by means of interpolation and spatial filtering. However, the extent to which this method can effectively reduce electrical artefacts has not been fully investigated. Here, we assessed the effectiveness of interpolation and spatial filtering to remove electrical artefacts using recordings from a human head specimen implanted with a CI.•Electrical artefacts were obtained using amplitude-modulated (AM'ed) pulse trains presented at several pulse rates (100-to-902 pps) or using high rate pulse trains (902 pps) in which either a pair of electrodes or AM frequencies alternated periodically at a rate of 1Hz.•By adding auditory change complex (ACC), auditory steady-state response (ASSR), or auditory change following response (AC-FR) template waveforms to the contaminated recordings, we show that interpolation allows for effective artefact removal for pulse rates below 400 pps whilst interpolation and spatial filtering are effective at higher pulse rates, with minimal distortions for ACC and AC-FR, and with a degree of amplitude- and phase-distortions for ASSR.•Recordings from CI listeners agreed with simulations, demonstrating that reliable responses can be recovered.

Improving Interaural Time Difference Sensitivity Using Short Inter-pulse Intervals with Amplitude-Modulated Pulse Trains in Bilateral Cochlear Implants.

Interaural time differences (ITDs) at low frequencies are important for sound localization and spatial speech unmasking. These ITD cues are not encoded in commonly used envelope-based stimulation strategies for cochlear implants (CIs) using high pulse rates. However, ITD sensitivity can be improved by adding extra pulses with short inter-pulse intervals (SIPIs) in unmodulated high-rate trains. Here, we investigated whether this improvement also applies to amplitude-modulated (AM) high-rate pulse trains. To this end, we systematically varied the temporal position of SIPI pulses within the envelope cycle (SIPI phase), the fundamental frequency (F0) of AM (125Hz and 250Hz), and AM depth (from 0.1 to 0.9). Stimuli were presented at an interaurally place-matched electrode pair at a reference pulse rate of 1000 pulses/s. Participants performed an ITD-based left/right discrimination task. SIPI insertion resulted in improved ITD sensitivity throughout the range of modulation depths and for both male and female F0s. The improvements were largest for insertion at and around the envelope peak. These results are promising for conveying salient ITD cues at high pulse rates commonly used to encode speech information.

Shot noise control in an AC-driven quantum point contact

We propose a scheme to manipulate the shot noise spectrum via the gate voltage Vg(t) of the quantum point contact. It has been known that shot noise can be used as a hallmark of electron temperature in the reservoirs. We show that, by choosing the pulse shape of Vg(t) properly, the zero-frequency shot noise can be tuned so that it is the same with the DC shot noise of two electron reservoirs at different temperatures. The voltage pulse width is rather fixed and cannot be changed efficiently. We provide a way to construct an amplitude-modulated pulse train to increase the signal strength of shot noise, which is useful in the study of shot noise experimentally.

Improving temporal modulation sensitivity in cochlear implant users

The present study investigated the limitations of temporal modulation sensitivity in cochlear implant (CI) users. Adult users of Cochlear Nucleus devices were tested by presenting sounds through their clinical processors using an auxiliary cable and using direct electrical stimulation provided through a custom research processor. Threshold and comfort current levels were determined by adjusting the phase duration of 10 Hz amplitude modulated pulse trains of 400 ms duration at a given stimulation rate. After mapping the participants, modulation detection thresholds were measured by means of a 3 alternative forced choice procedure which adaptively adjusted the modulation depth to determine the threshold in dB relative to full modulation. Participants completed the task using a graphical user interface to indicate which interval was different. Modulation frequencies from 10 to 800 Hz were tested at various stimulation rates on basal and apical electrodes in both psuedomonopolar and bipolar modes of stimulation. Preliminary findings indicate that modulation sensitivity drops off with increases in modulation frequency. Performance was significantly better with direct stimulation as compared to through the clinical processor and better at higher modulation frequencies than previous findings from CI users. Outcomes will have implications for the development of next generation CI devices.

Reconfigurable Envelope Generation of Optical Pulse Train Based on Discrete Fourier Transform

We experimentally demonstrate a fiber-based reconfigurable system for programming the envelope of high-speed optical pulse train by using fractional-rate multilevel amplitude modulation. Amplitude-modulated optical pulse trains undergo the discrete Fourier transform (DFT) realized by the temporal Talbot effect in a dispersive fiber. Consequently, rate-multiplied optical pulse trains with programmable envelopes can be achieved. In this letter, we report experimental synthesis of ~80-GHz optical pulse trains with expectant binary patterns, parabolic, square, and triangular envelopes. We also consider practical implementation issues and numerically analyze the influence from the deviation of modulation coefficients and finite extinction ratio of the Mach-Zehnder modulator on the generated pulses.

Electrically-evoked auditory steady-state responses as neural correlates of loudness growth in cochlear implant users

Loudness growth functions characterize how the loudness percept changes with current level between the threshold and most comfortable loudness level in cochlear implant users. Even though loudness growth functions are highly listener-dependent, currently default settings are used in clinical devices. This study investigated whether electrically-evoked auditory steady-state response amplitude growth functions correspond to behaviorally measured loudness growth functions. Seven cochlear implant listeners participated in two behavioral loudness growth tasks and an EEG recording session. The 40-Hz sinusoidally amplitude-modulated pulse trains were presented to CI channels stimulating at a more apical and basal region of the cochlea, and were presented at different current levels encompassing the listeners' dynamic ranges. Behaviorally, loudness growth was measured using an Absolute Magnitude Estimation and a Graphic Rating Scale with loudness categories. A good correspondence was found between the response amplitude functions and the behavioral loudness growth functions. The results are encouraging for future advances in individual, more automatic, and objective fitting of cochlear implants.

Modeled auditory nerve responses to amplitude modulated cochlear implant stimulation

Cochlear implants encode speech information by stimulating the auditory nerve with amplitude-modulated pulse trains. A computer model of the auditory nerve's response to electrical stimulation can be used to evaluate different approaches to improving CI patients' perception. In this paper a computationally efficient stochastic and adaptive auditory nerve model was used to investigate full nerve responses to amplitude-modulated electrical pulse trains. The model was validated for nerve responses to AM pulse trains via comparison with animal data. The influence of different parameters, such as adaptation and stochasticity, on long-term adaptation and modulation-following behavior was investigated. Responses to pulse trains with different pulse amplitudes, amplitude modulation frequencies, and modulation depths were modeled. Rate responses as well as period histograms, Vector Strength and the fundamental frequency were characterized in different time bins. The response alterations, including frequency following behavior, observed over the stimulus duration were similar to those seen in animal experiments. The tested model can be used to predict complete nerve responses to arbitrary input, and thus to different sound coding strategies.

Amplitude Modulation-based Electrical Stimulation for Encoding Multipixel Spatiotemporal Visual Information in Retinal Neural Activities.

Retinal implants have been developed as a promising way to restore partial vision for the blind. The observation and analysis of neural activities can offer valuable insights for successful prosthetic electrical stimulation. Retinal ganglion cell (RGC) activities have been investigated to provide knowledge on the requirements for electrical stimulation, such as threshold current and the effect of stimulation waveforms. To develop a detailed ‘stimulation strategy’ for faithful delivery of spatiotemporal visual information to the brain, it is essential to examine both the temporal and spatial characteristics of RGC responses, whereas previous studies were mainly focused on one or the other. In this study, we investigate whether the spatiotemporal visual information can be decoded from the RGC network activity evoked by patterned electrical stimulation. Along with a thorough characterization of spatial spreading of stimulation current and temporal information encoding, we demonstrated that multipixel spatiotemporal visual information can be accurately decoded from the population activities of RGCs stimulated by amplitude-modulated pulse trains. We also found that the details of stimulation, such as pulse amplitude range and pulse rate, were crucial for accurate decoding. Overall, the results suggest that useful visual function may be restored by amplitude modulation-based retinal stimulation.

Effect of current focusing on the sensitivity of inferior colliculus neurons to amplitude-modulated stimulation.

In multichannel cochlear implants (CIs), current is delivered to specific electrodes along the cochlea in the form of amplitude-modulated pulse trains, to convey temporal and spectral cues. Our previous studies have shown that focused multipolar (FMP) and tripolar (TP) stimulation produce more restricted neural activation and reduced channel interactions in the inferior colliculus (IC) compared with traditional monopolar (MP) stimulation, suggesting that focusing of stimulation could produce better transmission of spectral information. The present study explored the capability of IC neurons to detect modulated CI stimulation with FMP and TP stimulation compared with MP stimulation. The study examined multiunit responses of IC neurons in acutely deafened guinea pigs by systematically varying the stimulation configuration, modulation depth, and stimulation level. Stimuli were sinusoidal amplitude-modulated pulse trains (carrier rate of 120 pulses/s). Modulation sensitivity was quantified by measuring modulation detection thresholds (MDTs), defined as the lowest modulation depth required to differentiate the response of a modulated stimulus from an unmodulated one. Whereas MP stimulation showed significantly lower MDTs than FMP and TP stimulation (P values <0.05) at stimulation ≤2 dB above threshold, all stimulation configurations were found to have similar modulation sensitivities at 4 dB above threshold. There was no difference found in modulation sensitivity between FMP and TP stimulation. The present study demonstrates that current focusing techniques such as FMP and TP can adequately convey amplitude modulation and are comparable to MP stimulation, especially at higher stimulation levels, although there may be some trade-off between spectral and temporal fidelity with current focusing stimulation.

Assessing temporal modulation sensitivity using electrically evoked auditory steady state responses

Temporal cues are important for cochlear implant (CI) users when listening to speech. Users with greater sensitivity to temporal modulations show better speech recognition and modifications to stimulation parameters based on modulation sensitivity have resulted in improved speech understanding. Behavioural measures of temporal sensitivity require cooperative participants and a large amount of time. These limitations have motivated the desire for an objective measure with which to appraise temporal sensitivity for CI users.Electrically evoked auditory steady state responses (EASSRs) are neural responses to periodic electrical stimulation that have been used to predict threshold (T) levels. In this study we evaluate the use of EASSRs as a tool for assessing temporal modulation sensitivity.Modulation sensitivity was assessed behaviourally using modulation detection thresholds (MDTs) for a 20 Hz rate. On the same stimulation sites, EASSRS were measured using sinusoidally amplitude modulated pulse trains at 4 and 40 Hz. Measurements were taken using a bipolar configuration on 12 electrode pairs over 5 participants. Results showed that EASSR amplitudes and signal-to-noise ratios (SNRs) were significantly related to the MDTs. Larger EASSRs corresponded with sites of improved modulation sensitivity. This relation was driven by across-subject variation. This result indicates that EASSRs may be used as an objective measure of site-specific temporal sensitivity for CI users.

Reconstruction of dynamical pulse trains via time-resolved multiheterodyne detection

A multiheterodyne technique is presented which can accurately measure the complex spectrum and temporally reconstruct certain dynamic pulse trains. This technique is applied to periodic pulses formed in a LiNb0₃ Mach Zehnder modulator. The spectral amplitude and phase of 20 GHz 66% return-to-zero (RZ) pulses and 10 GHz 50% RZ pulses are measured, and compared to independent measurements from a high resolution optical spectrum analyser. The temporal pulse shape and phase is reconstructed and compared to high speed sampling oscilloscope measurements. This technique is applied to sections of a large single acquisition, allowing the reconstruction of frequency and amplitude modulated pulse trains.

Pitch and loudness matching of unmodulated and modulated stimuli in cochlear implantees

The pitch elicited by unmodulated and amplitude modulated electrical pulse trains was examined with six adult cochlear implantees. In addition, for three of those subjects who had some hearing in their contralateral ear, the pitch of unmodulated electrical pulse trains was compared to that of complex harmonic acoustic tones. In the first experiment, pulse rate discrimination and the effects of place and level differences on pitch were examined for unmodulated pulse trains. General results were consistent with previous studies showing that variations in pulse rate, while holding loudness fixed, elicit changes in pitch at low rates, but become progressively harder to discriminate as rates approach approximately 300 pulses-per-second. Variations in place or level of stimulation generally produced changes in pitch consistent with tonotopic place and spread of excitation. In the second experiment, pitch and loudness of unmodulated pulse trains were compared with those of amplitude modulated stimuli as a function of modulation depth, rate, and shape, and presentation level. The pitch elicited by an amplitude modulated pulse train was generally higher than that of an unmodulated pulse train with a pulse rate equal to the modulation rate, and generally decreased toward that of the unmodulated pulse train as modulation depth or rate increased, or as presentation level decreased. Sharper/narrower modulation produced lower pitch. In the final experiment, the pitch heights of acoustic complex harmonic tones and unmodulated pulse trains were compared. When electrical pulse rate was equal to the fundamental frequency of the acoustic tone, similar pitch heights were elicited. The results from these experiments indicate that F0 rate pitch derived from the temporal envelope in existing clinical cochlear implant strategies may often be higher than that of acoustic harmonic tones at the same F0 in normal hearing, and that pitch growth with increasing F0 may be shallower. The relationship between F0 and rate pitch is expected to be more similar to acoustic stimulation for low F0 rates when using new pitch coding strategies that code F0 information via deep (narrow) amplitude modulation of the stimulus envelope. Although that similarity reduces as F0 approaches the upper limit of rate-pitch discrimination, that limit is reached sooner for the shallow (or broad) modulators used in existing clinical strategies.

Neural representation in the auditory midbrain of the envelope of vocalizations based on a peripheral ear model

The auditory midbrain implant (AMI) consists of a single shank array (20 sites) for stimulation along the tonotopic axis of the central nucleus of the inferior colliculus (ICC) and has been safely implanted in deaf patients who cannot benefit from a cochlear implant (CI). The AMI improves lip-reading abilities and environmental awareness in the implanted patients. However, the AMI cannot achieve the high levels of speech perception possible with the CI. It appears the AMI can transmit sufficient spectral cues but with limited temporal cues required for speech understanding. Currently, the AMI uses a CI-based strategy, which was originally designed to stimulate each frequency region along the cochlea with amplitude-modulated pulse trains matching the envelope of the bandpass-filtered sound components. However, it is unclear if this type of stimulation with only a single site within each frequency lamina of the ICC can elicit sufficient temporal cues for speech perception. At least speech understanding in quiet is still possible with envelope cues as low as 50 Hz. Therefore, we investigated how ICC neurons follow the bandpass-filtered envelope structure of natural stimuli in ketamine-anesthetized guinea pigs. We identified a subset of ICC neurons that could closely follow the envelope structure (up to ß100 Hz) of a diverse set of species-specific calls, which was revealed by using a peripheral ear model to estimate the true bandpass-filtered envelopes observed by the brain. Although previous studies have suggested a complex neural transformation from the auditory nerve to the ICC, our data suggest that the brain maintains a robust temporal code in a subset of ICC neurons matching the envelope structure of natural stimuli. Clinically, these findings suggest that a CI-based strategy may still be effective for the AMI if the appropriate neurons are entrained to the envelope of the acoustic stimulus and can transmit sufficient temporal cues to higher centers.

Unanesthetized Auditory Cortex Exhibits Multiple Codes for Gaps in Cochlear Implant Pulse Trains

Cochlear implant listeners receive auditory stimulation through amplitude-modulated electric pulse trains. Auditory nerve studies in animals demonstrate qualitatively different patterns of firing elicited by low versus high pulse rates, suggesting that stimulus pulse rate might influence the transmission of temporal information through the auditory pathway. We tested in awake guinea pigs the temporal acuity of auditory cortical neurons for gaps in cochlear implant pulse trains. Consistent with results using anesthetized conditions, temporal acuity improved with increasing pulse rates. Unlike the anesthetized condition, however, cortical neurons responded in the awake state to multiple distinct features of the gap-containing pulse trains, with the dominant features varying with stimulus pulse rate. Responses to the onset of the trailing pulse train (Trail-ON) provided the most sensitive gap detection at 1,017 and 4,069 pulse-per-second (pps) rates, particularly for short (25 ms) leading pulse trains. In contrast, under conditions of 254 pps rate and long (200 ms) leading pulse trains, a sizeable fraction of units demonstrated greater temporal acuity in the form of robust responses to the offsets of the leading pulse train (Lead-OFF). Finally, TONIC responses exhibited decrements in firing rate during gaps, but were rarely the most sensitive feature. Unlike results from anesthetized conditions, temporal acuity of the most sensitive units was nearly as sharp for brief as for long leading bursts. The differences in stimulus coding across pulse rates likely originate from pulse rate-dependent variations in adaptation in the auditory nerve. Two marked differences from responses to acoustic stimulation were: first, Trail-ON responses to 4,069 pps trains encoded substantially shorter gaps than have been observed with acoustic stimuli; and second, the Lead-OFF gap coding seen for <15 ms gaps in 254 pps stimuli is not seen in responses to sounds. The current results may help to explain why moderate pulse rates around 1,000 pps are favored by many cochlear implant listeners.