Vocal Communication Research Articles

Female pond frog vocalisation deters sexual coercion by males

Avoiding sexual-conflict-induced sexual coercion is crucial for females, especially in anurans, where the necessity of sexual coercion counterstrategies is increased because of their strong male-male competition and external fertilisation. In this study, we tested the hypothesis that the recently discovered female Pelophylax nigromaculatus calls prevent male courtship and prevented sexual coercion. By observing the reproductive behaviour of anurans, this study examined when females emitted calls and how males responded to them, while comparing the reproductive conditions of call-emitting and non-call-emitting females. The results of this study revealed that females without eggs which were assumed to finish spawning emitted calls in response to male approaches, and the males subsequently moved away from the females obediently. This suggests that female P. nigromaculatus calls work as a counterstrategy against male sexual coercion. This countermeasure communication was first identified in anurans, suggesting that they engage in more complex bidirectional vocal communication during the breeding season than previously assumed.

Human emotion recognition with convolutional neural network

The interaction between intelligent robots and humans has always been a hot issue, and researchers hope to make human-robot interaction as harmonious as human-human interaction. To achieve this, it is particularly important to enable robots to recognize human facial emotions automatically. However, many intelligent robots can already understand people's emotions through vocal communication. However, some people do not like to express their feelings through words, so it would be more convenient to let machines can automatically analyze people's facial emotions. This paper aims to make the machine recognize people's facial expressions and automatically analyze their emotions to make human-computer interaction more harmonious. The convolutional neural network has shown great influence on image feature extraction in the development of the machine learning field today. Therefore, this paper will adopt the advanced method of CNN to train the model on the FER2013 dataset. The abundant experiments demonstrate that the final trained model has good accuracy in recognizing three emotions: happy, surprise, and neutral.

Seabird’s cry: repertoire and vocal expression of contextual valence in the little auk (Alle alle)

Many seabird species breed in colonies counting up to hundreds of thousands of individuals. Life in such crowded colonies might require special coding–decoding systems to reliably convey information through acoustic cues. This can include, for example, developing complex vocal repertoires and adjusting the properties of their vocal signals to communicate behavioural contexts, and thus regulate social interactions with their conspecifics. We studied vocalisations produced by the little auk (Alle alle)—a highly vocal, colonial seabird—over mating and incubation periods on the SW coast of Svalbard. Using passive acoustic recordings registered in a breeding colony, we extracted eight vocalisation types: single call, clucking, classic call, low trill, short call, short-trill, terror, and handling vocalisation. Calls were grouped by production context (based on the typically associated behaviour), to which a valence (positive vs negative) was later attributed, when possible, according to fitness threats, i.e. predator or human presence (negative) and promoters, i.e. interaction with a partner (positive). The effect of the putative valence on eight selected frequency and duration variables was then investigated. The putative contextual valence significantly affected the acoustic properties of the calls. Calls assigned positive valence had higher fundamental frequency and spectral centre of gravity as well as shorter sound duration than these assigned negative valence. These results indicate that the little auk’s vocal communication system may facilitate expression of complex behavioural contexts, and seems to include vocal plasticity within vocalisation types—however, more data are necessary to better understand this effect and possible interplays of other factors.

Early-life stress affects Mongolian gerbil interactions with conspecific vocalizations in a sex-specific manner.

During development, early-life stress (ELS) impairs cognition, learning, and emotional regulation, in part by disrupting neural circuitry in regions underlying these higher-order functions. In addition, our recent work indicates that ELS also alters simple sensory perception: ELS impaired auditory perception and neural encoding of short gaps in sounds, which are essential for vocal communication. The combination of higher-order and basic sensory disruption suggests that ELS is likely to affect both the perception and interpretation of communication signals. We tested this hypothesis by measuring behavioral responses to conspecific vocalizations (those emitted by other gerbils) in ELS and untreated Mongolian gerbils. Because stress effects often differ by sex, we separately examined females and males. To induce ELS, pups were intermittently maternally separated and restrained from post-natal days (P) 9-24, a time window when the auditory cortex is most sensitive to external disruption. We measured the approach responses of juvenile (P31-32) gerbils to two types of conspecific vocalizations: an alarm call, which is emitted to alert other gerbils of a potential threat, and the prosocial contact call, which is emitted near familiar gerbils, especially after separation. Control males, Control females, and ELS females approached a speaker emitting pre-recorded alarm calls, while ELS males avoided this source, suggesting that ELS affects the response to alarm calls in male gerbils. During playback of the pre-recorded contact call, Control females and ELS males avoided the sound source, while Control males neither approached nor avoided, and ELS females approached the sound. These differences cannot be accounted for by changes in locomotion or baseline arousal. However, ELS gerbils slept more during playback, suggesting that ELS may reduce arousal during vocalization playback. Further, male gerbils made more errors than females on a measure of working memory, but the sex difference of cognition in this context may stem from novelty aversion rather than impaired memory. These data indicate that ELS influences behavioral responses to ethologically relevant communication sounds in a sex-specific manner, and are among the first to demonstrate an altered response to auditory stimuli following ELS. Such changes may arise from differences in auditory perception, cognition, or a combination of factors, and suggest that ELS may affect auditory communication in human adolescents.

Speech- and language-linked FOXP2 mutation targets protein motors in striatal neurons.

Human speech and language are among the most complex motor and cognitive abilities. The discovery of a mutation in the transcription factor FOXP2 in KE family members with speech disturbances has been a landmark example of the genetic control of vocal communication in humans. Cellular mechanisms underlying this control have remained unclear. By leveraging FOXP2 mutation/deletion mouse models, we found that the KE family FOXP2R553H mutation directly disables intracellular dynein-dynactin 'protein motors' in the striatum by induction of a disruptive high level of dynactin1 that impairs TrkB endosome trafficking, microtubule dynamics, dendritic outgrowth and electrophysiological activity in striatal neurons alongside vocalization deficits. Dynactin1 knockdown in mice carrying FOXP2R553H mutations rescued these cellular abnormalities and improved vocalization. We suggest that FOXP2 controls vocal circuit formation by regulating protein motor homeostasis in striatal neurons, and that its disruption could contribute to the pathophysiology of FOXP2 mutation/deletion-associated speech disorders.

Multimodal Communication in the Human-Cat Relationship: A Pilot Study.

Across all species, communication implies that an emitter sends signals to a receiver, through one or more channels. Cats can integrate visual and auditory signals sent by humans and modulate their behaviour according to the valence of the emotion perceived. However, the specific patterns and channels governing cat-to-human communication are poorly understood. This study addresses whether, in an extraspecific interaction, cats are sensitive to the communication channel used by their human interlocutor. We examined three types of interactions-vocal, visual, and bimodal-by coding video clips of 12 cats living in cat cafés. In a fourth (control) condition, the human interlocutor refrained from emitting any communication signal. We found that the modality of communication had a significant effect on the latency in the time taken for cats to approach the human experimenter. Cats interacted significantly faster to visual and bimodal communication compared to the "no communication" pattern, as well as to vocal communication. In addition, communication modality had a significant effect on tail-wagging behaviour. Cats displayed significantly more tail wagging when the experimenter engaged in no communication (control condition) compared to visual and bimodal communication modes, indicating that they were less comfortable in this control condition. Cats also displayed more tail wagging in response to vocal communication compared to the bimodal communication. Overall, our data suggest that cats display a marked preference for both visual and bimodal cues addressed by non-familiar humans compared to vocal cues only. Results arising from the present study may serve as a basis for practical recommendations to navigate the codes of human-cat interactions.

Directional speakers as a tool for animal vocal communication studies.

Audio playbacks are a common experimental tool in vocal communication research. However, low directionality of sound makes it hard to control the audience exposed to the stimuli. Parametric speakers offer a solution for transmitting directional audible signals by using ultrasonic carrier waves. The targeted transmission of vocal signals offers exciting opportunities for testing the diffusion of information in animal groups and mechanisms for resolving informational ambiguities. We have field tested the quality and directionality of a commercial parametric speaker, Soundlazer SL-01. Additionally, we assessed its usability for performing playback experiments by comparing behavioural responses of free-ranging meerkats (Suricata suricatta) with calls transmitted from conventional and parametric speakers. Our results show that the tested parametric speaker is highly directional. However, the acoustic structure of meerkat calls was strongly affected and low frequencies were not reliably reproduced by the parametric speaker. The playback trials elicited weakened behavioural responses probably due to the partial distortion of the signal but also indicating the potential importance of social facilitation for initiating mobbing events in meerkats. We conclude that parametric speakers can be useful tools for directed transmission of animals calls but after a careful assessment of signal fidelity.

Whole-brain mapping of neuronal activity evoked by maternal separation in neonatal mice: An association with ultrasound vocalization.

Neonatal mice emit ultrasonic vocalizations (USVs) when separated from their mothers. Since the USVs attract their mothers' attention and trigger maternal retrieval, they are considered to serve as social signals for communication. We have modeled paternal aging effects on the vocal communication of offspring in mice. However, little is known about the neural basis underlying neonatal USV production. To identify responsible brain regions driving the vocal behavior, we comprehensively mapped the neuronal activity associated with USV production in the entire brain of mice at postnatal day 6 (P6). Using an expression of immediate-early gene c-Fos as a neuronal activity marker, correlations between the numbers of USVs and c-Fos positive neurons were analyzed. We identified 23 candidate brain regions associated with USV production in the mice at P6. Our study would be a first step toward comprehensively understanding the neuronal mechanisms that regulate and develop vocal behaviors in neonatal mice.

Improving the workflow to crack Small, Unbalanced, Noisy, but Genuine (SUNG) datasets in bioacoustics: The case of bonobo calls.

Despite the accumulation of data and studies, deciphering animal vocal communication remains challenging. In most cases, researchers must deal with the sparse recordings composing Small, Unbalanced, Noisy, but Genuine (SUNG) datasets. SUNG datasets are characterized by a limited number of recordings, most often noisy, and unbalanced in number between the individuals or categories of vocalizations. SUNG datasets therefore offer a valuable but inevitably distorted vision of communication systems. Adopting the best practices in their analysis is essential to effectively extract the available information and draw reliable conclusions. Here we show that the most recent advances in machine learning applied to a SUNG dataset succeed in unraveling the complex vocal repertoire of the bonobo, and we propose a workflow that can be effective with other animal species. We implement acoustic parameterization in three feature spaces and run a Supervised Uniform Manifold Approximation and Projection (S-UMAP) to evaluate how call types and individual signatures cluster in the bonobo acoustic space. We then implement three classification algorithms (Support Vector Machine, xgboost, neural networks) and their combination to explore the structure and variability of bonobo calls, as well as the robustness of the individual signature they encode. We underscore how classification performance is affected by the feature set and identify the most informative features. In addition, we highlight the need to address data leakage in the evaluation of classification performance to avoid misleading interpretations. Our results lead to identifying several practical approaches that are generalizable to any other animal communication system. To improve the reliability and replicability of vocal communication studies with SUNG datasets, we thus recommend: i) comparing several acoustic parameterizations; ii) visualizing the dataset with supervised UMAP to examine the species acoustic space; iii) adopting Support Vector Machines as the baseline classification approach; iv) explicitly evaluating data leakage and possibly implementing a mitigation strategy.

Variability in humpback whale songs reveals how individuals can be distinctive when sharing a complex vocal display.

Individually distinctive acoustic signals in animal vocal communication are taxonomically widespread, however, the investigation of these signal types in marine mammals has focused only on a few species. Humpback whale songs are a stereotyped, hierarchically structured vocal display performed by males, and hence thought to be sexually selected. Within a population, whales conform to a common version of the song despite the song constantly evolving. While humpback songs have been studied extensively at the population level, individual level variation has been rarely described, with inconclusive results. Here, we quantified inter- and intra-individual variability at different levels in the song hierarchy using songs from 25 singers across two song types from the eastern Australian population song of 2002 (12 singers), and the revolutionary song introduced in 2003 (13 singers). Inter-individual variability was found heterogeneously across all hierarchical levels of the song structure. In addition, distinct and individually specific patterns of song production were consistently recorded across song levels, with clear structural differences between the two song types. These results suggest that within the constraints of song conformity, males can produce individually distinctive patterns that could function as an advertisement to females to convey individual qualities.

Effect of Vocal Anesthesia on Adult Dental Patients during Covid-19 pandemic period

BACKGROUND: Pain is as a major concern with dental patients. The dentist-patient interaction can reveal the presence of anxiety and fear, which may result in rise of pain. This study aimed to assess vocabulary communication as support to dental anesthesia on the adult dental patient.MATERIALS AND METHODS: This is a prospective, randomized clinical study, conducted from February 2020 through March 2021. Two hundred individuals (112 males, 88 females) of the age range (16 to 84 years) were separated into two groups for testing the level of pain during dental local anesthesia, with vocal communication and without vocal communication.RESULTS: While the control group showed no difference between males and females, there was a difference between the sexes in the experimental group with past dental visits, VAS and injection type having less anxiety (p=0.0001) while with education/VAS having (p£0.01) as appear in sex to age (p£0.05). There was no difference when data were compared by age, or type of anesthesia (inferior alveolar nerve block or infiltration technique).CONCLUSION: Dental anxiety can be alleviated by talking to the patients before the procedure, which could reduce the amount of pain.

Bat vocal sequences enhance contextual information independently of syllable order

Many animals, humans included, rely on acoustic vocalizations for communication. The complexity of non-human vocal communication has been under debate one of the main open questions being: What could be the function of multi-syllabic vocal sequences? We address these questions by analyzing fruit-bat vocal communication. We use neural networks to encode the vocalizations, and statistical models to examine the information conveyed by sequences of vocalizations. We show that fruit-bat vocal sequences potentially convey more contextual information than individual syllables, but that the order of the syllables within the sequence is unimportant for context. Specifically, sequences are composed of slightly modified syllables, thus increasing the probability of context-specificity. We note that future behavioral, e.g., playback experiments are needed in order to validate the biological relevance of our statistical results. We hypothesize that such sequences might have served as pre-syntax precursors in the evolution of animal communication.

The experience of interacting: Learning communication for deaf students

<p>In the school environment in addition to studying teaching materials, deaf students also explore a variety of vocabulary. Teachers have a more role, in addition to helping students' understanding of communication teaching materials, it is also needed as a means of enriching vocabulary, including honing students in understanding oral communication, namely reading lip movements. The hope is that when deaf people can understand vocabulary and sign language, communication with sign language becomes equivalent to vocal communication in general which can make them confident in communicating with anyone. During the process, everything cannot be separated from the teacher's intervention in educating, exposing the material, and honing the potential of his students. Based on this phenomenon, researchers will examine the meaning of learning communication in teachers towards deaf people as research objects. This study aimed to determine the learning communication experience of deaf students at SLBN Cicendo, Bandung. It uses Symbolic Interaction Theory developed by George Herbert Mead as a guide. The approach used in this study is qualitative with a phenomenology method. The data in this study were obtained through observation, in-depth interviews, and a literature study. The results of this study indicate that learning communication in deaf students begins with the things closest to the children. These things can be experiences or what the child is thinking. The teacher as a teacher will lead the opinion on the material to be taught at that time. Then the teaching given is also adjusted to the abilities possessed by each child. The conclusion of this research is the provision of teaching materials to deaf students guided by individual learning. How to find out the best learning techniques for deaf students are obtained through the experience of interacting between classroom teachers and students.</p><p> </p>

Voice acoustics and effort of three different communication scenarios presented in an anechoic baseline

While vocal pathology can elevate vocal effort, communication situations also have an effect. Previous work on vocal effort and communication situations have relied on listener ratings of effort rather than talker-centric vocal effort. Towards that end, in this study, talker-centric vocal effort was related to different communication demands. Additionally, vocal performance was measured to investigate potential relationships between effort, production, and communication demand. In an anechoic chamber, participants described to an interlocutor various maps. The communication demands were communication distance (1, 2, 4 m), loudness goal (54, 60, 66 dB), and background noise (53, 62, 71 dBA). Talkers rated their vocal effort after each task with a Borg CR100 scale and were recorded with a calibrated head-worn microphone. There were significant increases in ratings of vocal effort, fundamental frequency, intensity, and cepstral-peak prominence (CPP) from the control condition to the extremes of the distance and loudness goal vocal demands which are consistent with previously observed Lombard responses. This study shows that communication demands that exceed typical conditions (such as talking at 4 m) result in increases in vocal effort and a Lombard-like response. Therefore, considerations to potential communication barriers are important for the reduction of vocal effort.

Effects of Cortical FoxP1 Knockdowns on Learned Song Preference in Female Zebra Finches.

The search for molecular underpinnings of human vocal communication has focused on genes encoding forkhead-box transcription factors, as rare disruptions of FOXP1, FOXP2, and FOXP4 have been linked to disorders involving speech and language deficits. In male songbirds, an animal model for vocal learning, experimentally altered expression levels of these transcription factors impair song production learning. The relative contributions of auditory processing, motor function or auditory-motor integration to the deficits observed after different FoxP manipulations in songbirds are unknown. To examine the potential effects on auditory learning and development, we focused on female zebra finches (Taeniopygia guttata) that do not sing but develop song memories, which can be assayed in operant preference tests. We tested whether the relatively high levels of FoxP1 expression in forebrain areas implicated in female song preference learning are crucial for the development and/or maintenance of this behavior. Juvenile and adult female zebra finches received FoxP1 knockdowns targeted to HVC (proper name) or to the caudomedial mesopallium (CMM). Irrespective of target site and whether the knockdown took place before (juveniles) or after (adults) the sensitive phase for song memorization, all groups preferred their tutor's song. However, adult females with FoxP1 knockdowns targeted at HVC showed weaker motivation to hear song and weaker song preferences than sham-treated controls, while no such differences were observed after knockdowns in CMM or in juveniles. In summary, FoxP1 knockdowns in the cortical song nucleus HVC were not associated with impaired tutor song memory but reduced motivation to actively request tutor songs.

Lesions to Caudomedial Nidopallium Impair Individual Vocal Recognition in the Zebra Finch.

Many social animals can recognize other individuals by their vocalizations. This requires a memory system capable of mapping incoming acoustic signals to one of many known individuals. Using the zebra finch, a social songbird that uses songs and distance calls to communicate individual identity (Elie and Theunissen, 2018), we tested the role of two cortical-like brain regions in a vocal recognition task. We found that the rostral region of the Cadomedial Nidopallium (NCM), a secondary auditory region of the avian pallium, was necessary for maintaining auditory memories for conspecific vocalizations in both male and female birds, whereas HVC (used as a proper name), a premotor areas that gates auditory input into the vocal motor and song learning pathways in male birds (Roberts and Mooney, 2013), was not. Both NCM and HVC have previously been implicated for processing the tutor song in the context of song learning (Sakata and Yazaki-Sugiyama, 2020). Our results suggest that NCM might not only store songs as templates for future vocal imitation but also songs and calls for perceptual discrimination of vocalizers in both male and female birds. NCM could therefore operate as a site for auditory memories for vocalizations used in various facets of communication. We also observed that new auditory memories could be acquired without intact HVC or NCM but that for these new memories NCM lesions caused deficits in either memory capacity or auditory discrimination. These results suggest that the high-capacity memory functions of the avian pallial auditory system depend on NCM.SIGNIFICANCE STATEMENT Many aspects of vocal communication require the formation of auditory memories. Voice recognition, for example, requires a memory for vocalizers to identify acoustical features. In both birds and primates, the locus and neural correlates of these high-level memories remain poorly described. Previous work suggests that this memory formation is mediated by high-level sensory areas, not traditional memory areas such as the hippocampus. Using lesion experiments, we show that one secondary auditory brain region in songbirds that had previously been implicated in storing song memories for vocal imitation is also implicated in storing vocal memories for individual recognition. The role of the neural circuits in this region in interpreting the meaning of communication calls should be investigated in the future.

More Melody and Harmony with Less Vocal Attack

This article is dedicated to the World Voice Day theme “Your Voice Matters”. It is a statement of opinion about vocalization that is nurturing and uplifting, especially to children. It is based on the author’s personal experiences in World War II, and thereafter as a child refugee and immigrant. A contrast is made between melody and harmony in vocal communication versus harsh and controlling attacks on others with speech.

RoboFinch: A versatile audio‐visual synchronised robotic bird model for laboratory and field research on songbirds

Abstract Singing in birds is accompanied by beak, head and throat movements. The role of these visual cues has long been hypothesised to be an important facilitator in vocal communication, including social interactions and song acquisition, but has seen little experimental study. To address whether audio‐visual cues are relevant for birdsong we used high‐speed video recording, 3D scanning, 3D printing technology and colour‐realistic painting to create RoboFinch, an open source adult‐mimicking robot which matches temporal and chromatic properties of songbird vision. We exposed several groups of juvenile zebra finches during their song developmental phase to one of six singing robots that moved their beaks synchronised to their song and compared them with birds in a non‐synchronised and two control treatments. Juveniles in the synchronised treatment approached the robot setup from the start of the experiment and progressively increased the time they spent singing, contra to the other treatment groups. Interestingly, birds in the synchronised group seemed to actively listen during tutor song playback, as they sung less during the actual song playback compared to the birds in the asynchronous and audio‐only control treatments. Our open source RoboFinch setup thus provides an unprecedented tool for systematic study of the functionality and integration of audio‐visual cues associated with song behaviour. Realistic head and beak movements aligned to specific song elements may allow future studies to assess the importance of multisensory cues during song development, sexual signalling and social behaviour. All software and assembly instructions are open source, and the robot can be easily adapted to other species. Experimental manipulations of stimulus combinations and synchronisation can further elucidate how audio‐visual cues are integrated by receivers and how they may enhance signal detection, recognition, learning and memory.

Dopamine injections to the midbrain periaqueductal gray inhibit vocal-motor production in a teleost fish

Across vertebrates, the midbrain periaqueductal gray (PAG) plays a critical role in social and vocal behavior. Dopaminergic neurotransmission also modulates these behaviors, and dopaminergic innervation of the PAG has been well documented. Nonetheless, the potential role of dopamine in shaping vocal production at the level of the PAG is not well understood. Here, we tested the hypothesis that dopamine modulates vocal production in the PAG, using a well-characterized vertebrate model system for the study of vocal communication, the plainfin midshipman fish, Porichthys notatus. We found that focal dopamine injections to the midshipman PAG rapidly and reversibly inhibited vocal production triggered by stimulation of known vocal-motor structures in the preoptic area / anterior hypothalamus. While dopamine inhibited vocal-motor output, it did not alter behaviorally-relevant parameters of this output, such as vocalization duration and frequency. Dopamine-induced inhibition of vocal production was prevented by the combined blockade of D1- and D2-like receptors but was unaffected by isolated blockade of either D1-receptors or D2-receptors. Our results suggest dopamine neuromodulation in the midshipman PAG may inhibit natural vocal behavior, in courtship and/or agonistic social contexts.

Characterizing maternal isolation-induced ultrasonic vocalizations in a gene-environment interaction rat model for autism.

Deficits in social communication and language development belong to the earliest diagnostic criteria of autism spectrum disorders. Of the many risk factors for autism spectrum disorder, the contactin-associated protein-like 2 gene, CNTNAP2, is thought to be important for language development. The present study used a rat model to investigate the potential compounding effects of autism spectrum disorder risk gene mutation and environmental challenges, including breeding conditions or maternal immune activation during pregnancy, on early vocal communication in the offspring. Maternal isolation-induced ultrasonic vocalizations from Cntnap2 wildtype and knockout rats at selected postnatal days were analyzed for their acoustic, temporal and syntax characteristics. Cntnap2 knockout pups from heterozygous breeding showed normal numbers and largely similar temporal structures of ultrasonic vocalizations to wildtype controls, whereas both parameters were affected in homozygously bred knockouts. Homozygous breeding further exacerbated altered pitch and transitioning between call types found in Cntnap2 knockout pups from heterozygous breeding. In contrast, the effect of maternal immune activation on the offspring's vocal communication was confined to call type syntax, but left ultrasonic vocalization acoustic and temporal organization intact. Our results support the "double-hit hypothesis" of autism spectrum disorder risk gene-environment interactions and emphasize that complex features of vocal communication are a useful tool for identifying early autistic-like features in rodent models.