Weighting Of Cues Research Articles

On the relative weight of pitch and durational cues in the perception of accentuation by French listeners.

Accentuation is encoded by both durational and pitch cues in French. While previous research agrees that the sole presence of pitch cues is sufficient to encode accentuation in French, the role of durational cues is less clear. In four cue-weighting accent perception experiments, we examined the role of pitch and durational cues in French listeners' perception of accentuation. French listeners were tested on acoustic continua ranging from an unaccented first syllable [depla'se] "moved" to an accented first syllable ['de] [pla'se] "a dice placed." The continua were obtained by manipulating pitch and durational cues either separately or conjointly. In Experiments 1 and 2, participants identified each step of the continuum by choosing between two possible segmentations while in Experiments 3 and 4, participants performed an AX discrimination task on two adjacent steps. Results indicate that participants' performance was better when pitch cues were varied compared to when durational cues were varied in both the identification and discrimination tasks. In addition, while participants always benefited from the additional presence of pitch cues, participants did not consistently benefit from the additional presence of durational cues. Together, these results suggest that pitch cues are a better marker of French accentuation than durational cues.

Weighting of sensory cues reflect changing patterns of visual investment during ecological divergence in Heliconius butterflies.

Integrating information across sensory modalities enables animals to orchestrate a wide range of complex behaviours. The relative importance placed on one sensory modality over another reflects the reliability of cues in a particular environment and corresponding differences in neural investment. As populations diverge across environmental gradients, the reliability of sensory cues may shift, favouring divergence in neural investment and the weight given to different sensory modalities. During their divergence across closed-forest and forest-edge habitats, closely related butterflies Heliconius cydno and Heliconius melpomene evolved distinct brain morphologies, with the former investing more in vision. Quantitative genetic analyses suggest that selection drove these changes, but their behavioural consequences remain uncertain. We hypothesized that divergent neural investment may alter sensory weighting. We trained individuals in an associative learning experiment using multimodal colour and odour cues. When positively rewarded stimuli were presented in conflict, i.e. pairing positively trained colour with negatively trained odour and vice versa, H. cydno favoured visual cues more strongly than H. melpomene. Hence, differences in sensory weighting may evolve early during divergence and are predicted by patterns of neural investment. These findings, alongside other examples, imply that differences in sensory weighting stem from divergent investment as adaptations to local sensory environments.

Perception of voice cues and speech-in-speech by children with prelingual single-sided deafness and a cochlear implant

Voice cues, such as fundamental frequency (F0) and vocal tract length (VTL), help listeners identify the speaker's gender, perceive the linguistic and emotional prosody, and segregate competing talkers. Postlingually implanted adult cochlear implant (CI) users seem to have difficulty in perceiving and making use of voice cues, especially of VTL. Early implanted child CI users, in contrast, perceive and make use of both voice cues better than CI adults, and in patterns similar to their peers with normal hearing (NH).In our study, we investigated the perception and use of voice cues in children with single-sided deafness (SSD) who received their CI at an early age (SSD+CI), in an attempt to bridge the gap between these two groups. The SSD+CI children have access to bilateral auditory information and often receive their CI at an early age, similar to CI children. They may also have dominant acoustic representations, similar to CI adults who acquired hearing loss at a later age. As such, the current study aimed to investigate the perception and use of voice cues by a group of nine early-implanted children with prelingual SSD. The study consisted of three experiments: F0 and VTL discrimination, voice gender categorization, and speech-in-speech perception. In each experiment, the results of the SSD group are compared to children and adults with CIs (for their CI ear) and with typical hearing (for their NH ear).Overall, the SSD+CI children had poorer VTL detection thresholds with their CI compared to their NH ear, while their F0 perception was similar across ears. Detection thresholds for both F0 and VTL with their CI ear was comparable to those of bilaterally implanted CI children, suggesting that SSD+CI children do not only rely on their NH ear, but actually make use of their CI. SSD+CI children relied more heavily on F0 cues than on VTL cues for voice gender categorization, with cue weighting patterns comparable to those of CI adults. In contrast to CI children, the SSD+CI children showed limited speech perception benefit based on F0 and VTL differences between the target and masker speaker, which again corresponded to the results of CI adults. Altogether, the SSD+CI children make good use of their CI, despite a good-hearing ear, however, the perceptual patterns seem to fall in-between those of CI children and CI adults. Perhaps a combination of childhood neuroplasticity, limited experience with relying only on the CI, and a dominant acoustic representation of voice gender explain these results.

The perception and production of Korean stops in second dialect acquisition.

This study investigated the acoustic cue weighting of the Korean stop contrast in the perception and production of speakers who moved from a nonstandard dialect region to the standard dialect region, Seoul. Through comparing these mobile speakers with data from nonmobile speakers in Seoul and their home region, it was found that the speakers shifted their cue weighting in perception and production to some degree, but also retained some subphonemic features of their home dialect in production. The implications of these results for the role of dialect prestige and awareness in second dialect acquisition are discussed.

Age and masking effects on acoustic cues for vowel categorizationa).

Age-related changes in auditory processing may reduce physiological coding of acoustic cues, contributing to older adults' difficulty perceiving speech in background noise. This study investigated whether older adults differed from young adults in patterns of acoustic cue weighting for categorizing vowels in quiet and in noise. All participants relied primarily on spectral quality to categorize /ɛ/ and /æ/ sounds under both listening conditions. However, relative to young adults, older adults exhibited greater reliance on duration and less reliance on spectral quality. These results suggest that aging alters patterns of perceptual cue weights that may influence speech recognition abilities.

Apparent-time variation in the use of multiple cues for perception of anticipatory nasal coarticulation in California English

This study examines apparent-time variation in the use of multiple acoustic cues present on coarticulatorily nasalized vowels in California English. Eighty-nine listeners ranging in age from 18-58 (grouped into 3 apparent-time categories based on year of birth) performed lexical identifications on syllables excised from words with oral and nasal codas from six speakers who produced either minimal (n=3) or extensive (n=3) anticipatory nasal coarticulation (realized by greater vowel nasalization, F1 bandwidth, and diphthongization on vowels in CVN contexts). Results showed no differences across listeners’ identification for Extensively coarticulated vowels, as well as oral vowels by both types of speakers (all at-ceiling). Yet, performance for the Minimal Coarticulators’ nasalized vowels was lowest for the older listener group and increased over apparent-time. Perceptual cue-weighting analyses revealed that older listeners rely more on F1 bandwidth, while younger listeners rely more on acoustic nasality, as coarticulatory cues providing information about lexical identity. Thus, there is evidence for variation in apparent- time in the use of the different coarticulatory cues present on vowels. Younger listeners’ cue weighting allows them flexibility to identify lexical items given a range of coarticulatory variation across (here, younger) speakers, while older listeners’ cue weighting leads to reduced performance for talkers producing innovative phonetic forms. This study contributes to our understanding of the relationship between multidimensional acoustic features resulting from coarticulation and the perceptual re-weighting of cues that can lead to sound change over time.

Auditory discrimination learning and acoustic cue weighing in female zebra finches with localized FoxP1 knockdowns.

Rare disruptions of the transcription factor FOXP1 are implicated in a human neurodevelopmental disorder characterized by autism and/or intellectual disability with prominent problems in speech and language abilities. Avian orthologues of this transcription factor are evolutionarily conserved and highly expressed in specific regions of songbird brains, including areas associated with vocal production learning and auditory perception. Here, we investigated possible contributions of FoxP1 to song discrimination and auditory perception in juvenile and adult female zebra finches. They received lentiviral knockdowns of FoxP1 in one of two brain areas involved in auditory stimulus processing, HVC (proper name) or CMM (caudomedial mesopallium). Ninety-six females, distributed over different experimental and control groups were trained to discriminate between two stimulus songs in an operant Go/Nogo paradigm and subsequently tested with an array of stimuli. This made it possible to assess how well they recognized and categorized altered versions of training stimuli and whether localized FoxP1 knockdowns affected the role of different features during discrimination and categorization of song. Although FoxP1 expression was significantly reduced by the knockdowns, neither discrimination of the stimulus songs nor categorization of songs modified in pitch, sequential order of syllables or by reversed playback were affected. Subsequently, we analyzed the full dataset to assess the impact of the different stimulus manipulations for cue weighing in song discrimination. Our findings show that zebra finches rely on multiple parameters for song discrimination, but with relatively more prominent roles for spectral parameters and syllable sequencing as cues for song discrimination.NEW & NOTEWORTHY In humans, mutations of the transcription factor FoxP1 are implicated in speech and language problems. In songbirds, FoxP1 has been linked to male song learning and female preference strength. We found that FoxP1 knockdowns in female HVC and caudomedial mesopallium (CMM) did not alter song discrimination or categorization based on spectral and temporal information. However, this large dataset allowed to validate different cue weights for spectral over temporal information for song recognition.

Prelingually Deaf Children With Cochlear Implants Show Better Perception of Voice Cues and Speech in Competing Speech Than Postlingually Deaf Adults With Cochlear Implants.

Postlingually deaf adults with cochlear implants (CIs) have difficulties with perceiving differences in speakers' voice characteristics and benefit little from voice differences for the perception of speech in competing speech. However, not much is known yet about the perception and use of voice characteristics in prelingually deaf implanted children with CIs. Unlike CI adults, most CI children became deaf during the acquisition of language. Extensive neuroplastic changes during childhood could make CI children better at using the available acoustic cues than CI adults, or the lack of exposure to a normal acoustic speech signal could make it more difficult for them to learn which acoustic cues they should attend to. This study aimed to examine to what degree CI children can perceive voice cues and benefit from voice differences for perceiving speech in competing speech, comparing their abilities to those of normal-hearing (NH) children and CI adults. CI children's voice cue discrimination (experiment 1), voice gender categorization (experiment 2), and benefit from target-masker voice differences for perceiving speech in competing speech (experiment 3) were examined in three experiments. The main focus was on the perception of mean fundamental frequency (F0) and vocal-tract length (VTL), the primary acoustic cues related to speakers' anatomy and perceived voice characteristics, such as voice gender. CI children's F0 and VTL discrimination thresholds indicated lower sensitivity to differences compared with their NH-age-equivalent peers, but their mean discrimination thresholds of 5.92 semitones (st) for F0 and 4.10 st for VTL indicated higher sensitivity than postlingually deaf CI adults with mean thresholds of 9.19 st for F0 and 7.19 st for VTL. Furthermore, CI children's perceptual weighting of F0 and VTL cues for voice gender categorization closely resembled that of their NH-age-equivalent peers, in contrast with CI adults. Finally, CI children had more difficulties in perceiving speech in competing speech than their NH-age-equivalent peers, but they performed better than CI adults. Unlike CI adults, CI children showed a benefit from target-masker voice differences in F0 and VTL, similar to NH children. Although CI children's F0 and VTL voice discrimination scores were overall lower than those of NH children, their weighting of F0 and VTL cues for voice gender categorization and their benefit from target-masker differences in F0 and VTL resembled that of NH children. Together, these results suggest that prelingually deaf implanted CI children can effectively utilize spectrotemporally degraded F0 and VTL cues for voice and speech perception, generally outperforming postlingually deaf CI adults in comparable tasks. These findings underscore the presence of F0 and VTL cues in the CI signal to a certain degree and suggest other factors contributing to the perception challenges faced by CI adults.

Spectral resolution and voice cue weighting in adults with normal hearing

Cochlear implant (CI) users use acoustic voice cues differently than normal hearing (NH) adults to identify a talker’s gender. Specifically, whereas NH listeners weight a talker’s fundamental frequency (f0) and resonance (operationalized as vocal tract length or VTL) equally, CI users rely almost exclusively on f0. CI users’ abnormal cue weighting may partially arise due to degraded auditory information delivered by the CI. We hypothesized that altering the amount of spectral information in the signal impacts voice cue weighting in NH listeners. Thirty NH adults performed a gender identification task. Auditory stimuli were monosyllabic words synthesized to have one of five f0 values and one of five VTL values. Synthesized voices were processed using a 16-, 8-, and 4-channel noise-band vocoder. Perceptual weights for each voice cue were estimated as the coefficients for f0 and VTL in regression models, with higher coefficients corresponding to stronger perceptual weightings. Listeners relied more on f0 in conditions with less spectral resolution than in conditions with greater spectral resolution. Cue weights for VTL did not change across conditions. Results suggest that removing frequency information from the auditory signal can modify the extent to which listeners use f0 to identify the gender of a talker.

Patterns of phonetic cue switching in older adults

Primary phonetic cues for identifying speech in quiet may be unreliable in background noise, requiring listeners to utilize cues more resistant to masking to accurately recognize speech. Previous experiments demonstrated that individuals rely mainly on voice onset time (VOT) to categorize /bir/-/pir/ sounds in quiet but rely on fundamental frequency (F0) when VOT is masked by noise. As older adults report challenges perceiving speech in noise, the current study investigated whether older adults exhibited poor ability to switch reliance from VOT to F0 in broadband noise. Young (aged 18–30) and older (aged 55+) adults with normal or near-normal hearing categorized /bir/ and /pir/ sounds that were manipulated on a continuum of VOT and F0. No group differences were found in cue weights in quiet or when noise was presented at a signal-to-noise ratio (SNR) of 0 dB. However, when SNR ranged from + 6 to -4 dB, young adults relied on F0 even at the best SNR, whereas older adults continued relying on VOT until significantly poorer SNRs, suggesting that older adults may exhibit maladaptive strategies for phonetic cue switching. Continued use of cues even as they become less reliable may help explain why older adults experience difficulty identifying speech in noise.

Perceptual weighting of acoustic cues to contrastive prosody for sentences in quiet and in noise

Prosody is used to mark important information in speech, yet despite this important role in everyday communication it is not a customary part of speech recognition testing in routine audiometry. Listeners might fail to perceive meaningful emphasis on a specific word signaled by prosodic cues despite repeating the words correctly. This study introduces a new paradigm for assessing perception of prosodic cues that are used to signify new/corrective information in a sentence. Stimuli consisted of spoken sentences where one word (in various sentence positions) was emphasized through acoustic modifications across the entire utterance, in a manner that corrected wrong information. Participants used a visual analog scale to mark the timing and degree of emphasis aligned with the target words. Perceptual data in this study are linked with acoustic measures of voice pitch contour, intensity, and duration to characterize how contrastive stress cues are recovered by listeners with and without cochlear implants, who are especially at risk for poorer pitch perception. Follow-up conditions used stimuli where acoustic cues (F0, duration, intensity) were manipulated independently to explore perceptual cue weighting, and the perseverance of these cues through background noise.

Limits of short-term perceptual training for enhancing Seoul-Korean listeners’ use of English lexical stress in spoken word recognition

This study investigates whether short-term perceptual training can enhance Seoul-Korean listeners’ use of English lexical stress in spoken word recognition. Unlike English, Seoul Korean does not have lexical stress (or lexical pitch accents/tones). Seoul-Korean speakers at a high-intermediate English proficiency completed a visual-world eye-tracking experiment adapted from Connell et al. (2018) (pre-/post-test). The experiment tested whether pitch in the target stimulus (accented versus unaccented first syllable) and vowel quality in the lexical competitor (reduced versus full first vowel) modulated fixations to the target word (e.g., PARrot; ARson) over the competitor word (e.g., paRADE or PARish; arCHIVE or ARcade). In the training (eight 30-min sessions over eight days), participants heard English lexical-stress minimal pairs uttered by four talkers (high variability) or one talker (low variability), categorized them as noun (first-syllable stress) or verb (second-syllable stress), and received accuracy feedback. The results showed that neither training increased target-over-competitor fixation proportions. Crucially, the same training had been found to improve Seoul- Korean listeners’ recall of English words differing in lexical stress (Tremblay et al., 2022) and their weighting of acoustic cues to English lexical stress (Tremblay et al., 2023). These results suggest that short-term perceptual training has a limited effect on target-over-competitor word activation.

The Effect of Pitch Accent on the Perception of English Lexical Stress: Evidence from English and Mandarin Chinese Listeners

The relative weighting of f0 and vowel reduction in English spoken word recognition at the sentence level were investigated in one two-alternative forced-choice word identification experiment. In the experiment, an H* pitch-accented or a deaccented word fragment (e.g., AR- in the word archive) was presented at the end of a carrier sentence for identification. The results of the experiment revealed differences in the cue weighting of English lexical stress perception between native and non-native listeners. For native English listeners, vowel quality was a more prominent cue than f0, while native Mandarin Chinese listeners employed both vowel quality and f0 in a comparable fashion. These results suggested that (a) vowel reduction is superior to f0 in signaling initial stress in the words and (b) f0 facilitates the recognition of word initial stress, which is modulated by first language.

Musical experience is linked to enhanced dimension-selective attention to pitch and increased primary weighting during suprasegmental categorization.

Speech perception requires the integration of evidence from acoustic cues across multiple dimensions. Individuals differ in their cue weighting strategies, that is, the weight they assign to different dimensions during speech categorization. In two experiments, we investigate musical training as one potential predictor of individual differences in prosodic cue weighting strategies. Attentional theories of speech categorization suggest that prior experience with the task-relevance of a particular dimension leads that dimension to attract attention. Experiment 1 tested whether musicians and nonmusicians differed in their ability to selectively attend to pitch and loudness in speech. Compared to nonmusicians, musicians showed enhanced dimension-selective attention to pitch but not loudness. Experiment 2 tested the hypothesis that musicians would show greater pitch weighting during prosodic categorization due to prior experience with the task-relevance of pitch cues in music. Listeners categorized phrases that varied in the extent to which pitch and duration signaled the location of linguistic focus and phrase boundaries. During linguistic focus categorization, musicians upweighted pitch compared to nonmusicians. During phrase boundary categorization, musicians upweighted duration relative to nonmusicians. These results suggest that musical experience is linked with domain-general enhancements in the ability to selectively attend to certain acoustic dimensions in speech. As a result, musicians may place greater perceptual weight on a single primary dimension during prosodic categorization, while nonmusicians may be more likely to choose a perceptual strategy that integrates across multiple dimensions. These findings support attentional theories of cue weighting, which suggest attention influences listeners' perceptual weighting of acoustic dimensions during categorization. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Lexical Stress Identification in Cochlear Implant-Simulated Speech by Non-Native Listeners.

This study investigates whether a presumed difference in the perceptibility of cues to lexical stress in spectro-temporally degraded simulated cochlear implant (CI) speech affects how listeners weight these cues during a lexical stress identification task, specifically in their non-native language. Previous research suggests that in English, listeners predominantly rely on a reduction in vowel quality as a cue to lexical stress. In Dutch, changes in the fundamental frequency (F0) contour seem to have a greater functional weight than the vowel quality contrast. Generally, non-native listeners use the cue-weighting strategies from their native language in the non-native language. Moreover, few studies have suggested that these cues to lexical stress are differently perceptible in spectro-temporally degraded electric hearing, as CI users appear to make more effective use of changes in vowel quality than of changes in the F0 contour as cues to linguistic phenomena. In this study, native Dutch learners of English identified stressed syllables in CI-simulated and non-CI-simulated Dutch and English words that contained changes in the F0 contour and vowel quality as cues to lexical stress. The results indicate that neither the cue-weighting strategies in the native language nor in the non-native language are influenced by the perceptibility of cues in the spectro-temporally degraded speech signal. These results are in contrast to our expectations based on previous research and support the idea that cue weighting is a flexible and transferable process.

An auditory perspective on phonological development in infancy.

The auditory system encodes the phonetic features of languages by processing spectro-temporal modulations in speech, which can be described at two time scales: relatively slow amplitude variations over time (AM, further distinguished into the slowest <8-16 Hz and faster components 16-500 Hz), and frequency modulations (FM, oscillating at higher rates about 600-10 kHz). While adults require only the slowest AM cues to identify and discriminate speech sounds, infants have been shown to also require faster AM cues (>8-16 Hz) for similar tasks. Using an observer-based psychophysical method, this study measured the ability of typical-hearing 6-month-olds, 10-month-olds, and adults to detect a change in the vowel or consonant features of consonant-vowel syllables when temporal modulations are selectively degraded. Two acoustically degraded conditions were designed, replacing FM cues with pure tones in 32 frequency bands, and then extracting AM cues in each frequency band with two different low-pass cut- off frequencies: (1) half the bandwidth (Fast AM condition), (2) <8 Hz (Slow AM condition). In the Fast AM condition, results show that with reduced FM cues, 85% of 6-month-olds, 72.5% of 10-month-olds, and 100% of adults successfully categorize phonemes. Among participants who passed the Fast AM condition, 67% of 6-month-olds, 75% of 10-month-olds, and 95% of adults passed the Slow AM condition. Furthermore, across the three age groups, the proportion of participants able to detect phonetic category change did not differ between the vowel and consonant conditions. However, age-related differences were observed for vowel categorization: while the 6- and 10-month-old groups did not differ from one another, they both independently differed from adults. Moreover, for consonant categorization, 10-month-olds were more impacted by acoustic temporal degradation compared to 6-month-olds, and showed a greater decline in detection success rates between the Fast AM and Slow AM conditions. The degradation of FM and faster AM cues (>8 Hz) appears to strongly affect consonant processing at 10 months of age. These findings suggest that between 6 and 10 months, infants show different developmental trajectories in the perceptual weight of speech temporal acoustic cues for vowel and consonant processing, possibly linked to phonological attunement.

Unraveling the Complexities of Second Language Lexical Stress Processing: The Impact of First Language Transfer, Second Language Proficiency, and Exposure

AbstractWe investigated the role of cue weighting, second language (L2) proficiency, and L2 daily exposure in L2 learning of suprasegmentals different from the first language (L1), using eye‐tracking. Spanish monolinguals, English–Spanish learners, and Mandarin–Spanish learners saw a paroxytone and an oxytone verb (e.g., FIRma–firMÓ “s/he signs–signed”), listened to a sentence containing one of the verbs, and chose the one that they heard. The three languages have contrastive lexical stress, but suprasegmentals have a greater functional load in Mandarin than in English. Monolinguals predicted suffixes accurately with both stress conditions and favored oxytones, but learners predicted suffixes accurately only with oxytones, the condition activating fewer lexical competitors. Monolinguals predicted suffixes accurately sooner but at a slower rate than did learners. L2 proficiency, but not L1 or L2 exposure, facilitated L2 predictions. In conclusion, learners of a contrastive‐stress L1 rely on L2 suprasegmentals to the same extent as monolinguals, regardless of their L1. Lower L2 proficiency and higher cognitive load (more lexical competitors) reduce learners’ reliance on suprasegmentals.

Extensive residence in a second language environment modifies perceptual strategies for suprasegmental categorization.

Languages differ in the importance of acoustic dimensions for speech categorization. This poses a potential challenge for second language (L2) learners, and the extent to which adult L2 learners can acquire new perceptual strategies for speech categorization remains unclear. This study investigated the effects of extensive English L2 immersion on speech perception strategies and dimension-selective-attention ability in native Mandarin speakers. Experienced first language (L1) Mandarin speakers (length of U.K. residence > 3 years) demonstrated more native-like weighting of cues to L2 suprasegmental categorization relative to inexperienced Mandarin speakers (length of residence < 1 year), weighting duration more highly. However, both the experienced and the inexperienced Mandarin speakers continued to weight duration less highly and pitch more highly during musical beat categorization and struggled to ignore pitch and selectively attend to amplitude in speech, relative to native English speakers. These results suggest that adult L2 experience can lead to retuning of perceptual strategies in specific contexts, but global acoustic salience is more resistant to change. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

How cross–linguistic influence affects the use of duration in the production and perception of corrective and non–corrective focus types

AbstractSpeakers use corrective focus as an explicit way to correct misunderstandings in communication. We investigate whether immersive contact with a rhythmically different language affects the production and perception of duration as a cue to corrective and non–corrective focus. We tested twenty-eight native speakers and sixty-four native listeners of Urdu, half of whom lived in Germany and used German as a second language, and half lived in Pakistan. German is a stress–timed language with head–prominence marking and makes intensive use of duration to mark corrective focus, while Urdu is a syllable–timed language with edge–prominence marking, which uses duration differently from German to mark focus types. Results showed that the majority language, German, affected focus processing in Urdu differently across modalities: In production, focus marking was not affected by country of residence, while in perception, Urdu speakers living in Germany were more sensitive to duration in the corrective focus context than Urdu speakers in Pakistan. We analyze this as cross–linguistic influence and argue that contact with a stress–timed, head–prominence majority language (here: German) affects the cue weighting in the native language Urdu in perception but not (yet) in production.

Challenges in providing augmented hearing for individuals with hearing loss

Recently there has been an emphasis on developing augmented reality systems that can enhance the sensory signals listeners normally perceive in the real world. An early example of a practical augmented hearing system is the hearing aid, which amplifies the signals that would normally enter the ear in order to improve their audibility for hearing impaired listeners. Many applications are now envisioning the use of virtual audio technology to add synthetic, spatialized sounds to the “passthrough” audio signal that would normally be produced by a hearing aid. One challenge for the designers of both augmented and virtual audio systems is to ensure they preserve the ability of both normal and hearing-impaired listeners to determine the spatial locations of sounds in the environment. The auditory cues required for localizing sounds are well understood for normal hearing listeners, but less so for hearing impaired listeners. Here we discuss the results from two experiments where hearing-impaired listeners performed substantially worse than expected with virtual or augmented audio cues, and present preliminary results suggesting that the unexpectedly poor results from hearing-impaired listeners may be the result of a different weighting of localization cues across frequency regions than is typically observed for listeners with normal hearing.