Montreal Affective Voices Research Articles

Validation of behavioral measures of social cognition in individuals diagnosed with schizophrenia.

Schizophrenia, a complex neuropsychiatric disorder, manifests severe impairments in social cognition, notably in Theory of Mind (ToM), empathy, and emotion recognition, which significantly influence social competence and overall functioning. These aspects are crucial for prognosis in individuals diagnosed with schizophrenia (SZ). This study validates a comics strip paradigm for ToM and empathy assessment, the Montreal Affective Voices (MAV) for measuring emotion recognition, and a Go-NoGo task for inhibition control estimation in individuals diagnosed with SZ, comparing their performance with healthy controls. SZ participants exhibited diminished abilities in the comics strip task, especially in ToM and empathy conditions, alongside challenges in identifying emotions from vocal cues in MAV. They responded slower and tended to be less accurate in the Go-NoGo task. The validated behavioral battery addresses the limitations of previous measures and emerges as a promising tool for future investigations into the neural systems underlying social cognition in schizophrenia. Such insights can lead to the development of long-needed treatment for negative symptoms and social dysfunctions in schizophrenia.

Validation of scrambling methods for vocal affect bursts

Studies on perception and cognition require sound methods allowing us to disentangle the basic sensory processing of physical stimulus properties from the cognitive processing of stimulus meaning. Similar to the scrambling of images, the scrambling of auditory signals is aimed at creating stimulus instances that are unrecognizable but have comparable low-level features. In the present study, we generated scrambled stimuli of short vocalizations taken from the Montreal Affective Voices database (Belin et al., Behav Res Methods, 40(2):531–539, 2008) by applying four different scrambling methods (frequency-, phase-, and two time-scrambling transformations). The original stimuli and their scrambled versions were judged by 60 participants for the apparency of a human voice, gender, and valence of the expressions, or, if no human voice was detected, for the valence of the subjective response to the stimulus. The human-likeness ratings were reduced for all scrambled versions relative to the original stimuli, albeit to a lesser extent for phase-scrambled versions of neutral bursts. For phase-scrambled neutral bursts, valence ratings were equivalent to those of the original neutral burst. All other scrambled versions were rated as slightly unpleasant, indicating that they should be used with caution due to their potential aversiveness.

Facial Emotion Recognition in Patients with Post-Paralytic Facial Synkinesis-A Present Competence.

Facial palsy is a movement disorder with impacts on verbal and nonverbal communication. The aim of this study is to investigate the effects of post-paralytic facial synkinesis on facial emotion recognition. In a prospective cross-sectional study, we compared facial emotion recognition between n = 30 patients with post-paralytic facial synkinesis (mean disease time: 1581 ± 1237 days) and n = 30 healthy controls matched in sex, age, and education level. Facial emotion recognition was measured by the Myfacetraining Program. As an intra-individual control condition, auditory emotion recognition was assessed via Montreal Affective Voices. Moreover, self-assessed emotion recognition was studied with questionnaires. In facial as well as auditory emotion recognition, on average, there was no significant difference between patients and healthy controls. The outcomes of the measurements as well as the self-reports were comparable between patients and healthy controls. In contrast to previous studies in patients with peripheral and central facial palsy, these results indicate unimpaired ability for facial emotion recognition. Only in single patients with pronounced facial asymmetry and severe facial synkinesis was an impaired facial and auditory emotion recognition detected. Further studies should compare emotion recognition in patients with pronounced facial asymmetry in acute and chronic peripheral paralysis and central and peripheral facial palsy.

Cross-classification of musical and vocal emotions in the auditory cortex.

Whether emotions carried by voice and music are processed by the brain using similar mechanisms has long been investigated. Yet neuroimaging studies do not provide a clear picture, mainly due to lack of control over stimuli. Here, we report a functional magnetic resonance imaging (fMRI) study using comparable stimulus material in the voice and music domains-the Montreal Affective Voices and the Musical Emotional Bursts-which include nonverbal short bursts of happiness, fear, sadness, and neutral expressions. We use a multivariate emotion-classification fMRI analysis involving cross-timbre classification as a means of comparing the neural mechanisms involved in processing emotional information in the two domains. We find, for affective stimuli in the violin, clarinet, or voice timbres, that local fMRI patterns in the bilateral auditory cortex and upper premotor regions support above-chance emotion classification when training and testing sets are performed within the same timbre category. More importantly, classifier performance generalized well across timbre in cross-classifying schemes, albeit with a slight accuracy drop when crossing the voice-music boundary, providing evidence for a shared neural code for processing musical and vocal emotions, with possibly a cost for the voice due to its evolutionary significance.

Effect of Parkinson Disease on Emotion Perception Using the Persian Affective Voices Test

Emotion perception plays a major role in proper communication with people in different social interactions. Nonverbal affect bursts can be used to evaluate vocal emotion perception. The present study was a preliminary step to establishing the psychometric properties of the Persian version of the Montreal Affective Voices (MAV) test, as well as to investigate the effect of Parkinson disease (PD) on vocal emotion perception. The short, emotional sound made by pronouncing the vowel "a" in Persian was recorded by 22 actors and actresses to develop the Persian version of the MAV, the Persian Affective Voices (PAV), for emotions of happiness, sadness, pleasure, pain, anger, disgust, fear, surprise, and neutrality. The results of the recordings of five of the actresses and five of the actors who obtained the highest score were used to generate the test. For convergent validity assessment, the correlation between the PAV and a speech prosody comprehension test was examined using a gender- and age-matched control group. To investigate the effect of the PD on emotion perception, the PAV test was performed on 28 patients with mild PD between ages 50 and 70 years. The PAV showed a high internal consistency (Cronbach's α = 0.80). A significant positive correlation was observed between the PAV and the speech prosody comprehension test. The test-retest reliability also showed the high repeatability of the PAV (intraclass correlation coefficient = 0.815, P ≤ 0.001). A significant difference was observed between the patients with PD and the controls in all subtests. The PAV test is a useful psychometric tool for examining vocal emotion perception that can be used in both behavioral and neuroimaging studies.

Affective auditory stimulus database: An expanded version of the International Affective Digitized Sounds (IADS-E).

Using appropriate stimuli to evoke emotions is especially important for researching emotion. Psychologists have provided several standardized affective stimulus databases-such as the International Affective Picture System (IAPS) and the Nencki Affective Picture System (NAPS) as visual stimulus databases, as well as the International Affective Digitized Sounds (IADS) and the Montreal Affective Voices as auditory stimulus databases for emotional experiments. However, considering the limitations of the existing auditory stimulus database studies, research using auditory stimuli is relatively limited compared with the studies using visual stimuli. First, the number of sample sounds is limited, making it difficult to equate across emotional conditions and semantic categories. Second, some artificially created materials (music or human voice) may fail to accurately drive the intended emotional processes. Our principal aim was to expand existing auditory affective sample database to sufficiently cover natural sounds. We asked 207 participants to rate 935 sounds (including the sounds from the IADS-2) using the Self-Assessment Manikin (SAM) and three basic-emotion rating scales. The results showed that emotions in sounds can be distinguished on the affective rating scales, and the stability of the evaluations of sounds revealed that we have successfully provided a larger corpus of natural, emotionally evocative auditory stimuli, covering a wide range of semantic categories. Our expanded, standardized sound sample database may promote a wide range of research in auditory systems and the possible interactions with other sensory modalities, encouraging direct reliable comparisons of outcomes from different researchers in the field of psychology.

Altered emotional prosody processing in patients with Parkinson's disease after subthalamic nucleus stimulation.

BackgroundPatients with Parkinson’s disease (PD) exhibit deficits in recognizing and expressing vocal emotional prosody. The aim of this study was to explore emotional prosody processing in patients with PD shortly after subthalamic nucleus (STN) deep brain stimulation (DBS).MethodsTwo groups of patients with PD (pre-DBS and post-DBS) and one healthy control (HC) group were recruited as participants. All participants (PD and HC) were assessed using the Montreal Affective Voices database 50 Voices Recognition test. All participants were asked to nonverbally express five basic emotions (happiness, anger, fear, sadness, and neutral) to test emotional prosody expression. Fifteen native Chinese speakers were recruited as raters. We recorded the accuracy rate, reaction time, confidence level, and two acoustic parameters (mean pitch and mean intensity).ResultsThe PD groups scored lower than the HC group in recognizing and expressing emotional prosody. STN DBS had no significant effect on the recognition of emotional prosody but had a significant effect on fear prosody expression. Pearson’s correlation analysis revealed significant correlations between performance on emotional prosody recognition tests and performance on emotional prosody expression tests in both the pre-DBS PD and post-DBS PD groups.ConclusionShortly after STN DBS, the ability to recognize emotional prosody was not altered, but fear expression was impaired. We identified associations between abnormalities in emotional prosody recognition and expression deficits both before and after STN DBS, indicating that the processes involved in recognizing and expressing emotional prosody may share a common system.

Altered emotional recognition and expression in patients with Parkinson's disease.

BackgroundParkinson’s disease (PD) patients exhibit deficits in emotional recognition and expression abilities, including emotional faces and voices. The aim of this study was to explore emotional processing in pre-deep brain stimulation (pre-DBS) PD patients using two sensory modalities (visual and auditory).MethodsFifteen PD patients who needed DBS surgery and 15 healthy, age- and gender-matched controls were recruited as participants. All participants were assessed by the Karolinska Directed Emotional Faces database 50 Faces Recognition test. Vocal recognition was evaluated by the Montreal Affective Voices database 50 Voices Recognition test. For emotional facial expression, the participants were asked to imitate five basic emotions (neutral, happiness, anger, fear, and sadness). The subjects were required to express nonverbal vocalizations of the five basic emotions. Fifteen Chinese native speakers were recruited as decoders. We recorded the accuracy of the responses, reaction time, and confidence level.ResultsFor emotional recognition and expression, the PD group scored lower on both facial and vocal emotional processing than did the healthy control group. There were significant differences between the two groups in both reaction time and confidence level. A significant relationship was also found between emotional recognition and emotional expression when considering all participants between the two groups together.ConclusionThe PD group exhibited poorer performance on both the recognition and expression tasks. Facial emotion deficits and vocal emotion abnormalities were associated with each other. In addition, our data allow us to speculate that emotional recognition and expression may share a common system.

What is the Melody of That Voice? Probing Unbiased Recognition Accuracy with the Montreal Affective Voices

The present study aimed to clarify how listeners decode emotions from human nonverbal vocalizations, exploring unbiased recognition accuracy of vocal emotions selected from the Montreal Affective Voices (MAV) (Belin et al. in Trends Cognit Sci 8:129–135, 2008. doi: 10.1016/j.tics.2004.01.008 ). The MAV battery includes 90 nonverbal vocalizations expressing anger, disgust, fear, pain, sadness, surprise, happiness, sensual pleasure, as well as neutral expressions, uttered by female and male actors. Using a forced-choice recognition task, 156 native speakers of Portuguese were asked to identify the emotion category underlying each MAV sound, and additionally to rate the valence, arousal and dominance of these sounds. The analysis focused on unbiased hit rates (Hu Score; Wagner in J Nonverbal Behav 17(1):3–28, 1993. doi: 10.1007/BF00987006 ), as well as on the dimensional ratings for each discrete emotion. Further, we examined the relationship between categorical and dimensional ratings, as well as the effects of speaker’s and listener’s sex on these two types of assessment. Surprise vocalizations were associated with the poorest accuracy, whereas happy vocalizations were the most accurately recognized, contrary to previous studies. Happiness was associated with the highest valence and dominance ratings, whereas fear elicited the highest arousal ratings. Recognition accuracy and dimensional ratings of vocal expressions were dependent both on speaker’s sex and listener’s sex. Further, discrete vocal emotions were not consistently predicted by dimensional ratings. Using a large sample size, the present study provides, for the first time, unbiased recognition accuracy rates for a widely used battery of nonverbal vocalizations. The results demonstrated a dynamic interplay between listener’s and speaker’s variables (e.g., sex) in the recognition of emotion from nonverbal vocalizations. Further, they support the use of both categorical and dimensional accounts of emotion when probing how emotional meaning is decoded from nonverbal vocal cues.

Constant Current versus Constant Voltage Subthalamic Nucleus Deep Brain Stimulation in Parkinson's Disease

Background: Subthalamic nucleus (STN) deep brain stimulation (DBS) is an established therapy for advanced Parkinson's disease (PD). Motor efficacy and safety have been established for constant voltage (CV) devices and more recently for constant current (CC) devices. CC devices adjust output voltage to provide CC stimulation irrespective of impedance fluctuation, while the current applied by CV stimulation depends on the impedance that may change over time. No study has directly compared the clinical effects of these two stimulation modalities. Objective: To compare the safety and clinical impact of CC STN DBS to CV STN DBS in patients with advanced PD 2 years after surgery. Methods: Patients were eligible for inclusion if they had undergone STN DBS surgery for idiopathic PD, had been implanted with a Medtronic Activa PC and if their stimulation program and medication had been stable for at least 1 year. This single-center trial was designed as a double-blind, randomized, prospective study with crossover after 2 weeks. Motor equivalence of the 2 modalities was confirmed utilizing part III of the Unified Parkinson's Disease Rating Scale (UPDRS). PD diaries and multiple subjective and objective evaluations of quality of life, depression, cognition and emotional processing were evaluated on both CV and on CC stimulation. Analysis using the paired t test with Bonferroni correction for multiple comparisons was performed to identify any significant difference between the stimulation modalities. Results: 8 patients were recruited (6 men, 2 women); 1 patient did not complete the study. The average age at surgery was 56.7 years (range 47-63). Disease duration at the time of surgery was 7.5 years (range 3-12). Patients were recruited 23.8 months (range 22.5-24) after surgery. At the postoperative study baseline, this patient group showed an average motor improvement of 69% (range 51-97) as measured by the change in UPDRS part III with stimulation alone. Levodopa equivalent medication was reduced on average by 67% (range 15-88). Patients were poorly compliant with PD diaries, and these did not yield useful information. The minor deterioration in quality-of-life scores (Parkinson's Disease Questionnaire-39, Quality of Life Enjoyment and Satisfaction Questionnaire) with CC stimulation were not statistically significant. Two measures of depression (Hamilton Rating Scale D17, Quick Inventory of Depressive Symptomatology - Self-Report) showed a nonsignificant lower score (less depression) with CC stimulation, but a third (Beck Depression Inventory) showed equivalence. Cognitive testing (Mini Mental State Examination) and emotional processing (Montreal Affective Voices) were equivalent for CC and CV. Conclusion: CC STN DBS is safe. For equivalent motor efficacy, no significant difference could be identified between CC and CV stimulation for nonmotor evaluations in PD patients 2 years after surgery.

Single-subject analyses of magnetoencephalographic evoked responses to the acoustic properties of affective non-verbal vocalizations.

Magneto-encephalography (MEG) was used to examine the cerebral response to affective non-verbal vocalizations (ANVs) at the single-subject level. Stimuli consisted of non-verbal affect bursts from the Montreal Affective Voices morphed to parametrically vary acoustical structure and perceived emotional properties. Scalp magnetic fields were recorded in three participants while they performed a 3-alternative forced choice emotion categorization task (Anger, Fear, Pleasure). Each participant performed more than 6000 trials to allow single-subject level statistical analyses using a new toolbox which implements the general linear model (GLM) on stimulus-specific responses (LIMO-EEG). For each participant we estimated “simple” models [including just one affective regressor (Arousal or Valence)] as well as “combined” models (including acoustical regressors). Results from the “simple” models revealed in every participant the significant early effects (as early as ~100 ms after onset) of Valence and Arousal already reported at the group-level in previous work. However, the “combined” models showed that few effects of Arousal remained after removing the acoustically-explained variance, whereas significant effects of Valence remained especially at late stages. This study demonstrates (i) that single-subject analyses replicate the results observed at early stages by group-level studies and (ii) the feasibility of GLM-based analysis of MEG data. It also suggests that early modulation of MEG amplitude by affective stimuli partly reflects their acoustical properties.

A CASE OF ORGANIC AMNESIC DISORDER SYNDROME DIAGNOSED WITH FMRI

ObjectivePost-concussion syndrome after traffic accident is often clinically associated with prolonged cognitive impairment due to brain lesions, but sometimes a symptom like amnesia may occur without structural abnormality in neuroimaging....

The “Musical Emotional Bursts”: a validated set of musical affect bursts to investigate auditory affective processing

The Musical Emotional Bursts (MEB) consist of 80 brief musical executions expressing basic emotional states (happiness, sadness and fear) and neutrality. These musical bursts were designed to be the musical analog of the Montreal Affective Voices (MAV)—a set of brief non-verbal affective vocalizations portraying different basic emotions. The MEB consist of short (mean duration: 1.6 s) improvisations on a given emotion or of imitations of a given MAV stimulus, played on a violin (10 stimuli × 4 [3 emotions + neutral]), or a clarinet (10 stimuli × 4 [3 emotions + neutral]). The MEB arguably represent a primitive form of music emotional expression, just like the MAV represent a primitive form of vocal, non-linguistic emotional expression. To create the MEB, stimuli were recorded from 10 violinists and 10 clarinetists, and then evaluated by 60 participants. Participants evaluated 240 stimuli [30 stimuli × 4 (3 emotions + neutral) × 2 instruments] by performing either a forced-choice emotion categorization task, a valence rating task or an arousal rating task (20 subjects per task); 40 MAVs were also used in the same session with similar task instructions. Recognition accuracy of emotional categories expressed by the MEB (n:80) was lower than for the MAVs but still very high with an average percent correct recognition score of 80.4%. Highest recognition accuracies were obtained for happy clarinet (92.0%) and fearful or sad violin (88.0% each) MEB stimuli. The MEB can be used to compare the cerebral processing of emotional expressions in music and vocal communication, or used for testing affective perception in patients with communication problems.

Cross-Cultural Differences in the Processing of Non-Verbal Affective Vocalizations by Japanese and Canadian Listeners

The Montreal Affective Voices (MAVs) consist of a database of non-verbal affect bursts portrayed by Canadian actors, and high recognitions accuracies were observed in Canadian listeners. Whether listeners from other cultures would be as accurate is unclear. We tested for cross-cultural differences in perception of the MAVs: Japanese listeners were asked to rate the MAVs on several affective dimensions and ratings were compared to those obtained by Canadian listeners. Significant Group × Emotion interactions were observed for ratings of Intensity, Valence, and Arousal. Whereas Intensity and Valence ratings did not differ across cultural groups for sad and happy vocalizations, they were significantly less intense and less negative in Japanese listeners for angry, disgusted, and fearful vocalizations. Similarly, pleased vocalizations were rated as less intense and less positive by Japanese listeners. These results demonstrate important cross-cultural differences in affective perception not just of non-verbal vocalizations expressing positive affect (Sauter et al., 2010), but also of vocalizations expressing basic negative emotions.

P10 Cultural effects on the perception of non-linguistic affective vocalisation by Japanese and Canadian subjects

<h3>Objective</h3> Although language and culture are different in each area in the world, how does culture affect the recognition of nonverbal emotional vocalisations? A previous study on non-verbal emotional vocalisations has shown a cross-cultural effect in Western and African participants. However, nobody has ever investigated the cross-cultural differences between Japanese and Caucasian participants in their emotional response to non-verbal vocal sounds. In the present study, we aimed to investigate cross-cultural effect between Caucasian subjects and Japanese subjects when the subjects listen to nonverbal affect bursts. <h3>Method</h3> 30 Japanese subjects (15 males) participated in this study. The data of Japanese subjects were compared with data from 30 Canadian subjects (15 males). Subjects listened to the Montreal Affective Voices (MAVs), which consist of a database of nonverbal affect bursts portrayed by Canadian actors. Each voice was evaluated using three criteria: perceived emotional intensity in each of the eight emotions (Anger, Disgust, Fear, Pain, Sadness, Surprise, Happiness, and Pleasure), perceived valence, and perceived arousal. To investigate cross-cultural differences between Japanese and Canadian participants, mixed 2×8 ANOVAs with Group (Japanese, Canadian) and Emotion (eight emotions) as factors were calculated on ratings of Intensity, Valence, and Arousal. <h3>Results</h3> Significant Group × Emotion interactions were observed for ratings of intensity, valence and arousal (intensity: F(5.5, 313.5) = 9.137, p&lt;0.001, valence: F(4.3, 244.3) = 25.101, p&lt;0.001, arousal: F(4.4, 250.5) = 8.955, p&lt;0.001). Post-hoc tests showed that intensity ratings from Japanese listeners were significantly higher than ratings from Caucasian listeners for angry, disgusted, fearful, surprise, and pleased (p&lt;0.05/8). Further, valence ratings from Japanese listeners were significantly higher than ratings from Caucasian listeners for angry, disgusted, fearful, painful, surprised (p&lt;0.05/9), whereas valence rating of pleased in Japanese listener was significantly lower than in Caucasian listener (p&lt;0.05/9). Arousal ratings of sad vocalisations by Japanese listeners were significantly higher than by Caucasian listeners (p&lt;0.05/9). <h3>Conclusion</h3> This study demonstrates important cross-cultural differences in the perception of non-verbal affect bursts and extends recent observations by showing that these cross-cultural differences are also found for negative emotions.

Age-related Differences in Emotion Recognition Ability: Visual and Auditory Modalities

Emotion recognition is an important aspect of social interaction. Deficits in emotion recognition have been tied to poor social competence, interpersonal functioning, and communication along with a reduced quality of life and inappropriate social behavior. Recent experimental evidence suggests that emotion recognition ability across modalities seems to change in an age-dependent way, with deficits specifically noted for negative emotion recognition. Therefore, the primary purpose of this study is to assess emotion recognition ability in both the visual and auditory modalities in healthy elderly patients versus healthy young patients to test the hypothesis that deficits in emotion recognition ability are age-related and increase with age across visual and auditory modalities. The secondary purpose of this study is to assess valence-specific emotion recognition ability to test the hypothesis that increased deficits for elderly individuals as compared to young healthy subjects occur for negative emotion recognition specifically. We examined the ability to recognize emotion in the auditory and visual modality in two groups of patients: healthy elderly subjects and healthy young subjects. The Montreal Affective Voices task (MAV), the Distorted Tunes task (DTT), the Awareness of Social Inference test (TASIT), and the Baron-Cohen Mind in the Eyes Test (EYES) were used to gauge emotion recognition ability. For the visual tasks (TASIT and EYES), the elderly subjects and young subjects did not have significant differences in performance. In addition, a significant difference was also not found for the DTT, indicating that both populations had intact lower-level auditory processing abilities. Significant differences were found between the two populations on the MAV task in both baseline accuracy and valence-specific performance. These findings suggest that age-related deficits in emotion recognition may be specific to the recognition of auditory emotion.

The Montreal Affective Voices: A validated set of nonverbal affect bursts for research on auditory affective processing

The Montreal Affective Voices consist of 90 nonverbal affect bursts corresponding to the emotions of anger, disgust, fear, pain, sadness, surprise, happiness, and pleasure (plus a neutral expression), recorded by 10 different actors (5 of them male and 5 female). Ratings of valence, arousal, and intensity for eight emotions were collected for each vocalization from 30 participants. Analyses revealed high recognition accuracies for most of the emotional categories (mean of 68%). They also revealed significant effects of both the actors' and the participants' gender: The highest hit rates (75%) were obtained for female participants rating female vocalizations, and the lowest hit rates (60%) for male participants rating male vocalizations. Interestingly, the mixed situations--that is, male participants rating female vocalizations or female participants rating male vocalizations--yielded similar, intermediate ratings. The Montreal Affective Voices are available for download at vnl.psy.gla.ac.uk/ (Resources section).