Voice Identity Research Articles

The effects of high variability training on voice identity learning

High-variability training has been shown to benefit the learning of phonetic contrasts and new face identities. Here, we investigated whether high-variability training also aids voice identity learning. In Experiment 1, we contrasted high variability training (including stimuli extracted from several different recording sessions and speaking styles) with low variability training (including stimuli extracted from one recording session of read sentences; i.e., one speaking style). Listeners learned to recognise 4 voice identities (2 through high-variability training, 2 through low-variability training) and were subsequently tested on an old/new recognition task using novel read sentences. We found no high-variability training advantage in Experiment 1 – instead we found a high-variability disadvantage. However, in this experiment there was full overlap of speaking style in the low variability voices across the two task phases. We therefore ran a second experiment (Experiment 2), in which test stimuli were sourced from a previously unheard speaking style: The manipulation of high versus low-variability training was otherwise achieved in the same way as before (many speaking styles versus one speaking style). In this experiment, we observed a high-variability advantage. Findings are discussed in the context of the mechanisms thought to underpin advantages for high-variability training.

Inclusive Leadership, Proactive Personality and Employee Voice: A Voice Role Identity Perspective

Drawing on role identity theory, we theorized and examined voice identity salience (i.e., speaking up toward supervisors or peers becomes part of an employee’s self-concept or identity) and its imp...

‘Please sort these voice recordings into 2 identities’: Effects of task instructions on performance in voice sorting studies

We investigated the effects of two types of task instructions on performance on a voice sorting task by listeners who were either familiar or unfamiliar with the voices. Listeners were asked to sort 15 naturally varying stimuli from two voice identities into perceived identities. Half of the listeners sorted the recordings freely into as many identities as they perceived; the other half were forced to sort stimuli into two identities only. As reported in previous studies, unfamiliar listeners formed more clusters than familiar listeners. Listenerstherefore perceived different naturally varying stimuli from the same identity as coming from different identities, while being highly accurate at telling apart the stimuli from different voices. We furthershow that a change in task instructions - forcing listeners to sort stimuli into two identities only - helped unfamiliar listeners to overcome this selective failure at 'telling people together'. This improvement, however, came at the cost of an increase in errors in telling people apart. For familiar listeners, similar non-significant trends were apparent. Therefore, even when informed about correct number of identities, listeners may fail to accurately perceive identity further highlighting that voice identity perception in the context of natural within-person variability is a challenging task. We discuss our results in terms of similarities and differences to findings in the face perception literature and their importance in applied settings, such as forensic voice identification.

The effects of high variability training on voice identity learning

High variability training has been shown to benefit the learning of new face identities. In three experiments, we investigated whether this is also the case for voice identity learning. In Experiment 1a, we contrasted high variability training sets – which included stimuli extracted from a number of different recording sessions, speaking environments and speaking styles – with low variability stimulus sets that only included a single speaking style (read speech) extracted from one recording session (see Ritchie & Burton, 2017 for faces). Listeners were tested on an old/new recognition task using read sentences (i.e. test materials fully overlapped with the low variability training stimuli) and we found a high variability disadvantage. In Experiment 1b, listeners were trained in a similar way, however, now there was no overlap in speaking style or recording session between training sets and test stimuli. Here, we found a high variability advantage. In Experiment 2, variability was manipulated in terms of the number of unique items as opposed to number of unique speaking styles. Here, we contrasted the high variability training sets used in Experiment 1a with low variability training sets that included the same breadth of styles, but fewer unique items; instead, individual items were repeated (see Murphy, Ipser, Gaigg, & Cook, 2015 for faces). We found only weak evidence for a high variability advantage, which could be explained by stimulus-specific effects. We propose that high variability advantages may be particularly pronounced when listeners are required to generalise from trained stimuli to different-sounding, previously unheard stimuli. We discuss these findings in the context of mechanisms thought to underpin advantages for high variability training.

Faces and voices in the brain: A modality-general person-identity representation in superior temporal sulcus

Face-selective and voice-selective brain regions have been shown to represent face-identity and voice-identity, respectively. Here we investigated whether there are modality-general person-identity representations in the brain that can be driven by either a face or a voice, and that invariantly represent naturalistically varying face videos and voice recordings of the same identity. Models of face and voice integration suggest that such representations could exist in multimodal brain regions, and in unimodal regions via direct coupling between face- and voice-selective regions. Therefore, in this study we used fMRI to measure brain activity patterns elicited by the faces and voices of familiar people in face-selective, voice-selective, and person-selective multimodal brain regions. We used representational similarity analysis to (1) compare representational geometries (i.e. representational dissimilarity matrices) of face- and voice-elicited identities, and to (2) investigate the degree to which pattern discriminants for pairs of identities generalise from one modality to the other. We did not find any evidence of similar representational geometries across modalities in any of our regions of interest. However, our results showed that pattern discriminants that were trained to discriminate pairs of identities from their faces could also discriminate the respective voices (and vice-versa) in the right posterior superior temporal sulcus (rpSTS). Our findings suggest that the rpSTS is a person-selective multimodal region that shows a modality-general person-identity representation and integrates face and voice identity information.

Self-voice perception and its relationship with hallucination predisposition

ABSTRACTIntroduction: Auditory verbal hallucinations (AVH) are a core symptom of psychotic disorders such as schizophrenia but are also reported in 10–15% of the general population. Impairments in self-voice recognition are frequently reported in schizophrenia and associated with the severity of AVH, particularly when the self-voice has a negative quality. However, whether self-voice processing is also affected in nonclinical voice hearers remains to be specified.Methods: Thirty-five nonclinical participants varying in hallucination predisposition based on the Launay-Slade Hallucination Scale, listened to prerecorded words and vocalisations differing in identity (self/other) and emotional quality. In Experiment 1, participants indicated whether words were spoken in their own voice, another voice, or whether they were unsure (recognition task). They were also asked whether pairs of words/vocalisations were uttered by the same or by a different speaker (discrimination task). In Experiment 2, participants judged the emotional quality of the words/vocalisations.Results: In Experiment 1, hallucination predisposition affected voice discrimination and recognition, irrespective of stimulus valence. Hallucination predisposition did not affect the evaluation of the emotional valence of words/vocalisations (Experiment 2).Conclusions: These findings suggest that nonclinical participants with high HP experience altered voice identity processing, whereas HP does not affect the perception of vocal emotion. Specific alterations in self-voice perception in clinical and nonclinical voice hearers may establish a core feature of the psychosis continuum.

Listeners form average-based representations of individual voice identities

Models of voice perception propose that identities are encoded relative to an abstracted average or prototype. While there is some evidence for norm-based coding when learning to discriminate different voices, little is known about how the representation of an individual's voice identity is formed through variable exposure to that voice. In two experiments, we show evidence that participants form abstracted representations of individual voice identities based on averages, despite having never been exposed to these averages during learning. We created 3 perceptually distinct voice identities, fully controlling their within-person variability. Listeners first learned to recognise these identities based on ring-shaped distributions located around the perimeter of within-person voice spaces – crucially, these distributions were missing their centres. At test, listeners’ accuracy for old/new judgements was higher for stimuli located on an untrained distribution nested around the centre of each ring-shaped distribution compared to stimuli on the trained ring-shaped distribution.

Interactions between Conscious and Subconscious Signals: Selective Attention under Feature-Based Competition Increases Neural Selectivity during Brain Adaptation.

Efficient perception in natural environments depends on neural interactions between voluntary processes within cognitive control, such as attention, and those that are automatic and subconscious, such as brain adaptation to predictable input (also called repetition suppression). Although both attention and adaptation have been studied separately and there is considerable knowledge of the neurobiology involved in each of these processes, how attention interacts with adaptation remains equivocal. We examined how attention interacts with visual and auditory adaptation by measuring neuroimaging effects consistent with changes in either neural gain or selectivity. Male and female human participants were scanned with functional magnetic resonance imaging (fMRI) first while they discriminated repetition of morphed faces or voices and either directed their attention to stimulus identity or spatial location. Attention to face or voice identity, while ignoring stimulus location, solely increased the gain of respectively face- or voice-sensitive cortex. The results were strikingly different in an experiment when participants attended to voice identity versus stimulus loudness. In this case, attention to voice while ignoring sound loudness increased neural selectivity. The combined results show that how attention affects adaptation depends on the level of feature-based competition, reconciling prior conflicting observations. The findings are theoretically important and are discussed in relation to neurobiological interactions between attention and different types of predictive signals.SIGNIFICANCE STATEMENT Adaptation to repeated environmental events is ubiquitous in the animal brain, an automatic typically subconscious, predictive signal. Cognitive influences, such as by attention, powerfully affect sensory processing and can overcome brain adaptation. However, how neural interactions occur between adaptation and attention remains controversial. We conducted fMRI experiments regulating the focus of attention during adaptation to repeated stimuli with perceptually balanced stimulus expectancy. We observed an interaction between attention and adaptation consistent with increased neural selectivity, but only under conditions of feature-based competition, challenging the notion that attention interacts with brain adaptation by only affecting response gain. This demonstrates that attention retains its full complement of mechanistic influences on sensory cortex even as it interacts with more automatic or subconscious predictive processes.

Temporal Features of Psychological and Physical Self-Representation: An ERP Study.

Psychological and physical-self are two important aspects of self-concept. Although a growing number of behavioral and neuroimaging studies have investigated the cognitive mechanism and neural substrate underlying psychological and physical-self-representation, most of the existing research on psychological and physical-self-representation had been done in isolation. The present study aims to examine the electrophysiological responses to both psychological (one’s own name) and physical (one’s own voice) self-related stimuli in a uniform paradigm. Event-related potentials (ERPs) were recorded for subjects’ own and others’ names uttered by subjects’ own or others’ voice (own voice-own name, own voice-other’s name, other’s voice-own name, other’s voice-other’s name) while subjects performed an auditory passive oddball task. The results showed that one’s own name elicited smaller P2 and larger P3 amplitudes than those of other’s names, irrespective of the voice identity. However, no differences were observed between self and other’s voice during the P2 and P3 stages. Moreover, an obvious interaction effect was observed between voice content and voice identity at the N400 stage that the subject’s own voice elicited a larger parietal N400 amplitude than other’s voice in other name condition but not in own name condition. Taken together, these findings suggested that psychological (one’s own name) and physical (one’s own voice) self-representation induced distinct electrophysiological response patterns in auditory-cognitive processing.

Breaking voice identity perception: Expressive voices are more confusable for listeners.

The human voice is a highly flexible instrument for self-expression, yet voice identity perception is largely studied using controlled speech recordings. Using two voice-sorting tasks with naturally varying stimuli, we compared the performance of listeners who were familiar and unfamiliar with the TV show Breaking Bad. Listeners organised audio clips of speech with (1) low-expressiveness and (2) high-expressiveness into perceived identities. We predicted that increased expressiveness (e.g., shouting, strained voice) would significantly impair performance. Overall, while unfamiliar listeners were less able to generalise identity across exemplars, the two groups performed equivalently well when telling voices apart when dealing with low-expressiveness stimuli. However, high vocal expressiveness significantly impaired telling apart in both the groups: this led to increased misidentifications, where sounds from one character were assigned to the other. These misidentifications were highly consistent for familiar listeners but less consistent for unfamiliar listeners. Our data suggest that vocal flexibility has powerful effects on identity perception, where changes in the acoustic properties of vocal signals introduced by expressiveness lead to effects apparent in familiar and unfamiliar listeners alike. At the same time, expressiveness appears to have affected other aspects of voice identity processing selectively in one listener group but not the other, thus revealing complex interactions of stimulus properties and listener characteristics (i.e., familiarity) in identity processing.

How many voices did you hear? Natural variability disrupts identity perception from unfamiliar voices.

Our voices sound different depending on the context (laughing vs. talking to a child vs. giving a speech), making within‐person variability an inherent feature of human voices. When perceiving speaker identities, listeners therefore need to not only ‘tell people apart’ (perceiving exemplars from two different speakers as separate identities) but also ‘tell people together’ (perceiving different exemplars from the same speaker as a single identity). In the current study, we investigated how such natural within‐person variability affects voice identity perception. Using voices from a popular TV show, listeners, who were either familiar or unfamiliar with this show, sorted naturally varying voice clips from two speakers into clusters to represent perceived identities. Across three independent participant samples, unfamiliar listeners perceived more identities than familiar listeners and frequently mistook exemplars from the same speaker to be different identities. These findings point towards a selective failure in ‘telling people together’. Our study highlights within‐person variability as a key feature of voices that has striking effects on (unfamiliar) voice identity perception. Our findings not only open up a new line of enquiry in the field of voice perception but also call for a re‐evaluation of theoretical models to account for natural variability during identity perception.

Student Voice and Linguistic Identity: Digital Badging as a Tool for Retention of First Year and First Generation Undergraduates

This article describes the role that linguists can play in the retention of first year and first generation college students through both collaborative and cross-disciplinary work. By drawing on our academic training, linguists can design materials and implement programs both within and outside of our home academic departments that not only affirm students’ linguistic identities and home languages (National Council of Teachers of English 1974; Smitherman 1995), but also simultaneously engage them in overt discussion about the academic discourse community and ways to negotiate multiple linguistic terrains. An example of this type of engagement and material development is discussed in this article, which examines three learning modules that use an electronic badge system. The modules and badges allow students to explore linguistic diversity and discuss the different ways of “being” (including language) that they encounter in their new academic community. Coupled with these three badges for first year students, additional materials have been developed and implemented for student tutors at the university writing center. These materials better contextualize the linguistic diversity that student tutors encounter as they come into contact daily with linguistic diversity, primarily in the form of Southern U.S. English and African American English varieties.

Caribbean Literary Discourse: Voice and Cultural Identity in the Anglophone Caribbean, by Barbara Lalla, Jean D’Costa & Velma Pollard

Caribbean Literary Discourse: Voice and Cultural Identity in the Anglophone Caribbean, by Barbara Lalla, Jean D’Costa & Velma Pollard

The lost ability to distinguish between self and other voice following a brain lesion.

Mechanisms underlying the self/other distinction have been mainly investigated focusing on visual, tactile or proprioceptive cues, whereas very little is known about the contribution of acoustical information. Here the ability to distinguish between self and others' voice is investigated by using a neuropsychological approach. Right (RBD) and left brain damaged (LBD) patients and healthy controls were submitted to a voice discrimination and a voice recognition task. Stimuli were paired words/pseudowords pronounced by the participant, by a familiar or unfamiliar person. In the voice discrimination task, participants had to judge whether two voices were same or different, whereas in the voice recognition task participants had to judge whether their own voice was or was not present. Crucially, differences between patient groups were found. In the discrimination task, only RBD patients were selectively impaired when their own voice was present. By contrast, in the recognition task, both RBD and LBD patients were impaired and showed two different biases: RBD patients misattributed the other's voice to themselves, while LBD patients denied the ownership of their own voice. Thus, two kinds of bias can affect self-voice recognition: we can refuse self-stimuli (voice disownership), or we can misidentify others' stimuli as our own (embodiment of others' voice). Overall, these findings reflect different impairments in self/other distinction both at behavioral and anatomical level, the right hemisphere being involved in voice discrimination and both hemispheres in the voice identity explicit recognition. The finding of selective brain networks dedicated to processing one's own voice demonstrates the relevance of self-related acoustic information in bodily self-representation.

P 15 Voice-identity processing deficits are induced by lesions in the temporal and inferior parietal lobe

Human voice recognition is an essential skill for social interactions. The mechanisms that the human brain uses for voice recognition are to-date unknown. According to studies in patients with brain lesions, voice recognition critically involves the bilateral temporal lobe and the right inferior parietal lobe. In contrast, functional magnetic resonance imaging (fMRI) studies suggest that primarily the right temporal lobe contributes to voice recognition. In order to systematically investigate brain regions required for voice recognition, we conducted a voxel-based lesion symptom mapping (VLSM) study. The study included a comprehensive behavioral test battery, neuropsychological assessment and high-resolution structural brain images. We tested 58 patients having unilateral focal brain lesions on unfamiliar and familiar voice recognition as well as face recognition skills. VLSM analysis revealed three key findings. (i) A strong association between right temporal and right inferior parietal lobe lesions and voice-recognition deficits. (ii) Only the association of the right temporal lobe with voice-recognition deficits remained significant when we controlled for face-recognition performance. (iii) Unfamiliar voice-recognition deficits were associated with lesions in the right temporal lobe as well as in the right inferior parietal lobe. The ability to recognize familiar voices was associated with left posterior temporal lobe lesions. Our results help to explain the discrepancies between previous lesion and fMRI findings. They show that both the right temporal lobe and the parietal lobe play critical roles for voice-recognition abilities. The right temporal lobe might be key for the representation of the voice and speaker identity, while the parietal lobe might be involved in a more multimodal representation of person identities.

Familiarity and Voice Representation: From Acoustic-Based Representation to Voice Averages.

The ability to recognize an individual from their voice is a widespread ability with a long evolutionary history. Yet, the perceptual representation of familiar voices is ill-defined. In two experiments, we explored the neuropsychological processes involved in the perception of voice identity. We specifically explored the hypothesis that familiar voices (trained-to-familiar (Experiment 1), and famous voices (Experiment 2)) are represented as a whole complex pattern, well approximated by the average of multiple utterances produced by a single speaker. In experiment 1, participants learned three voices over several sessions, and performed a three-alternative forced-choice identification task on original voice samples and several “speaker averages,” created by morphing across varying numbers of different vowels (e.g., [a] and [i]) produced by the same speaker. In experiment 2, the same participants performed the same task on voice samples produced by familiar speakers. The two experiments showed that for famous voices, but not for trained-to-familiar voices, identification performance increased and response times decreased as a function of the number of utterances in the averages. This study sheds light on the perceptual representation of familiar voices, and demonstrates the power of average in recognizing familiar voices. The speaker average captures the unique characteristics of a speaker, and thus retains the information essential for recognition; it acts as a prototype of the speaker.

Similarities in face and voice cerebral processing

ABSTRACTIn this short paper I illustrate by a few selected examples several compelling similarities in the functional organization of face and voice cerebral processing: (1) Presence of cortical areas selective to face or voice stimuli, also observed in non-human primates, and causally related to perception; (2) Coding of face or voice identity using a “norm-based” scheme; (3) Personality inferences from faces and voices in a same Trustworthiness–Dominance “social space”.

It doesn't matter what you say: FMRI correlates of voice learning and recognition independent of speech content

Listeners can recognize newly learned voices from previously unheard utterances, suggesting the acquisition of high-level speech-invariant voice representations during learning. Using functional magnetic resonance imaging (fMRI) we investigated the anatomical basis underlying the acquisition of voice representations for unfamiliar speakers independent of speech, and their subsequent recognition among novel voices. Specifically, listeners studied voices of unfamiliar speakers uttering short sentences and subsequently classified studied and novel voices as “old” or “new” in a recognition test. To investigate “pure” voice learning, i.e., independent of sentence meaning, we presented German sentence stimuli to non-German speaking listeners. To disentangle stimulus-invariant and stimulus-dependent learning, during the test phase we contrasted a “same sentence” condition in which listeners heard speakers repeating the sentences from the preceding study phase, with a “different sentence” condition. Voice recognition performance was above chance in both conditions although, as expected, performance was higher for same than for different sentences. During study phases activity in the left inferior frontal gyrus (IFG) was related to subsequent voice recognition performance and same versus different sentence condition, suggesting an involvement of the left IFG in the interactive processing of speaker and speech information during learning. Importantly, at test reduced activation for voices correctly classified as “old” compared to “new” emerged in a network of brain areas including temporal voice areas (TVAs) of the right posterior superior temporal gyrus (pSTG), as well as the right inferior/middle frontal gyrus (IFG/MFG), the right medial frontal gyrus, and the left caudate. This effect of voice novelty did not interact with sentence condition, suggesting a role of temporal voice-selective areas and extra-temporal areas in the explicit recognition of learned voice identity, independent of speech content.

Emotional self-other voice processing in schizophrenia and its relationship with hallucinations: ERP evidence.

Abnormalities in self-other voice processing have been observed in schizophrenia, and may underlie the experience of hallucinations. More recent studies demonstrated that these impairments are enhanced for speech stimuli with negative content. Nonetheless, few studies probed the temporal dynamics of self versus nonself speech processing in schizophrenia and, particularly, the impact of semantic valence on self-other voice discrimination. In the current study, we examined these questions, and additionally probed whether impairments in these processes are associated with the experience of hallucinations. Fifteen schizophrenia patients and 16 healthy controls listened to 420 prerecorded adjectives differing in voice identity (self-generated [SGS] versus nonself speech [NSS]) and semantic valence (neutral, positive, and negative), while EEG data were recorded. The N1, P2, and late positive potential (LPP) ERP components were analyzed. ERP results revealed group differences in the interaction between voice identity and valence in the P2 and LPP components. Specifically, LPP amplitude was reduced in patients compared with healthy subjects for SGS and NSS with negative content. Further, auditory hallucinations severity was significantly predicted by LPP amplitude: the higher the SAPS "voices conversing" score, the larger the difference in LPP amplitude between negative and positive NSS. The absence of group differences in the N1 suggests that self-other voice processing abnormalities in schizophrenia are not primarily driven by disrupted sensory processing of voice acoustic information. The association between LPP amplitude and hallucination severity suggests that auditory hallucinations are associated with enhanced sustained attention to negative cues conveyed by a nonself voice.

Normal voice processing after posterior superior temporal sulcus lesion

The right posterior superior temporal sulcus (pSTS) shows a strong response to voices, but the cognitive processes generating this response are unclear. One possibility is that this activity reflects basic voice processing. However, several fMRI and magnetoencephalography findings suggest instead that pSTS serves as an integrative hub that combines voice and face information. Here we investigate whether right pSTS contributes to basic voice processing by testing Faith, a patient whose right pSTS was resected, with eight behavioral tasks assessing voice identity perception and recognition, voice sex perception, and voice expression perception. Faith performed normally on all the tasks. Her normal performance indicates right pSTS is not necessary for intact voice recognition and suggests that pSTS activations to voices reflect higher-level processes.