The relationship between bi/multilingualism, nativeness, proficiency and multimodal emotion recognition ability

Abstract

Aims and Objectives: The primary aim of this study is to investigate the relationship between visual–vocal–verbal emotion recognition ability (ERA) and multilingualism – that is, both bilingual first language (L1) acquisition and the level of multilingualism operationalised as the number of languages one can speak. Besides these two factors, we also consider nativeness and proficiency as possible predictors of ERA. Methodology: One-thousand-two-hundred-and-twenty participants completed a survey online consisting of a sociobiographical background questionnaire, an English lexical test and an emotion recognition test including six stimuli. For each of the six audiovisual recordings, participants had to indicate which emotion they thought the L1 English speaker was conveying – happiness, sadness, anger, (positive) surprise, fear, disgust or no/neutral emotion. Data and Analysis: An individual ERA score was calculated for each participant. Correlations between ERA and the different variables were computed – including interactions – and significant correlations were fed into a linear regression model. Findings: The number of spoken languages was unrelated to ERA in our sample. The data revealed an interaction between BFLA and nativeness: bi/multilingually raised English second or foreign language (LX) users outperformed monolingually raised LX users, but bi/multilingually raised L1 users of English scored lower than monolingually raised L1 users. Proficiency was significantly related to ERA. Originality: This study points to a bilingual advantage in emotion recognition in English for participants with specific linguistic profiles. Participants who grew up with two languages from birth had an advantage if it did not include English. The advantage seemed to be cancelled out among bi/multilingually raised English L1 users, possibly due to interferences from their other L1(s) or L1 culture(s). Significance: This study contributes to the scarce literature on bilingual advantage in the affective domain and offers a nuanced view on bilingualism and ERA.