Nonverbal Research Articles

Human Perception of Emotions from Canis familiaris Barks: An Auditory-Perceptual Study

This study investigates how experience and gender influence the perception of emotions in dog barks. Drawing from Morton's structural-motivational rule and previous research on mammalian vocalizations, we aimed to discern whether humans, especially those experienced with dogs, can accurately identify emotions such as stranger, anger, lonely, and play in dog barks. Using recordings of Indian Lesser Spitz barks in various contexts, we conducted auditory-perceptual experiments with two groups: experienced listeners (with more than 2- 3 years of pet dog experience) and non-experienced listeners. Participants listened to bark sequences and identified the corresponding emotions. Results revealed that experienced listeners consistently outperformed non- experienced ones in identifying emotions, except for 'play,' where no significant difference was observed. Gender did not significantly affect emotion perception. Interestingly, 'anger' was most accurately identified across both groups, followed by 'stranger,' 'play,' and 'lonely' emotions. Analyzing open-ended responses, we found that acoustic cues such as pitch and inter-bark intervals strongly influenced emotional perception. 'Stranger' barks were described as low-pitched, while 'anger' barks had shorter inter-bark intervals. 'Lonely' barks were characterized by high pitch and longer inter- bark intervals than 'play' barks. These findings suggest that experience plays a crucial role in accurately perceiving emotions in dog barks, aligning with the concept of a common mammalian heritage in emotional communication. Gender differences were negligible in this context. Understanding the acoustic cues underlying emotional expression in dogs enhances our comprehension of canine behavior and has implications for fields like animal welfare and neuroscience. Further research could delve deeper into the mechanisms underlying emotional perception in non-verbal communication across mammalian species.

Decoding Group Emotional Dynamics in a Web-Based Collaborative Environment: A Novel Framework Utilizing Multi-Person Facial Expression Recognition

As a crucial form of non-verbal communication, facial expressions can convey an individual’s emotional state through a combination of facial muscle movements and provide an effective approach to understanding emotional shifts among group members to a certain extent. However, in real-time collaborative environments, the increasing influx of audiovisual information can overwhelm an individual’s limited visual attention, making it challenging to observe and analyze other group members’ facial expressions continually. The failure to promptly recognize and interpret facial expressions can disrupt individual and group-level comprehension and evaluation of emotional dynamics during collaborative interactions, consequently hindering subsequent emotion management and communication. This article delves into the classification of facial expression information and its formation mechanism to thoroughly analyze the relationship between group members’ emotional perceptions and expressions in the collaboration process. Leveraging the YOLO-FaceV2 face detection model, FaceNet face recognition model, and CERN expression recognition model, we present a novel Collaborative Emotion Analysis Framework (CEAF) for multi-person facial expression recognition. By employing Web real-time communication technology, this framework is integrated into an online group meetings system, which can identify the faces and expressions of the participants and provide real-time visual analysis of their expression information. After the conclusion of the meeting, the system can perform an emotional evaluation with pre-defined operators, providing invaluable insights into the emotional dynamics of the group and individual members throughout the collaborative process. Ultimately, validation through an online meeting instance indicates that this system can facilitate groups in interpreting emotional changes among collaborative group members to a considerable extent.

Every "Body" Gets a Say: An Augmented Optimization Metric to Preserve Body Pose during Avatar Adaptation in Mixed/Augmented Reality.

User-Avatar interaction within augmented reality applications is rapidly increasing in frequency. Applications routinely place users in rooms with other, remote users embodied by photorealistic avatars, or require users to work with an avatar of a remote user to complete a task. During these types of interactions, it is often required to modify or redirect the posture of an avatar to achieve goals such as contact with or pointing at an object or maintaining eye gaze with the local user. A key limitation of modern redirection techniques is successfully preserving body posture, a critical component of nonverbal communication. This paper presents a new pose-preserving objective function to be used in the multi-objective optimization of an avatar's kinematic configuration. This objective function not only mimics the correct placement of body joints, but also preserves their orientation in space. We have tested this approach against several commonly used and current state-of-the-art redirection techniques and have found that our new approach achieves a significant reduction in targeted redirection error while simultaneously reducing body posture error. Additionally, human subject testing has shown that our new technique provides both a significantly more natural looking redirection and a significantly more realistic and believable overall body posture.

Party Face Congratulations! Exploring Design Ideas to Help Sighted Users with Emoji Accessibility when Messaging with Screen Reader Users

Emoji are a popular, expressive form of non-verbal communication. However, people often use emoji in ways that result in confusing or cumbersome screen reader output. We created two accessibility support designs: (1) Preview, which displays a basic text transcript of a message with emoji that a screen reader would narrate, and (2) Alert, which summarises potential accessibility issues caused by emoji within a message. We explored our designs using an online survey and provided participants with the option to edit messages that contained emoji, should they choose to do so. We collected 1508 modified messages from 116 sighted participants and conducted a qualitative analysis of the data to identify the strategies participants used when asked to edit a message for accessibility issues and their appreciation of each design. We found that participants preferred the Preview design over Alert since it allows for subjective interpretations of what constitutes an accessible message. We report sighted users' rewriting strategies (e.g., editing the message to move the emoji to the end) and incorrect assumptions about screen readers that would lead to using textual markers that are incompatible with screen readers. We discuss the design implications for future systems for accessible messaging.

Online therapy with families - what can families tell us about how to do this well? A qualitative study assessing families' experience of remote Dyadic Developmental Psychotherapy compared to face-to-face therapy.

Dyadic Developmental Psychotherapy (DDP) is a family-based therapy for adopted children aiming to achieve secure attachment between the child and parent. Due to restrictions under the COVID-19 pandemic, delivery of DDP transitioned from face-to-face to online methods. This study aimed to explore families experience of online DDP compared to face-to-face DDP, looking at the advantages and disadvantages of remote delivery methods and the implications this has on future service delivery for clinicians. Semi-structured interviews with 6 families were conducted online. Analysis of transcripts using Interpretative Phenomenological Analysis (IPA) revealed four superordinate themes: environment and child engagement, non-verbal communication, travel and familiarity with remote interactions. Parents recognised the influence the physical and online environment had on their child's engagement levels, however, varied in their experience and hence preference of delivery method. All families emphasised the importance of non-verbal communication within DDP sessions and majority highlighted this may be lost online. For families who travelled to face-to-face DDP, car journeys provided a unique opportunity to decompress and reflect after sessions. For families where travel is unfeasible, online DDP was a lifeline, demonstrating the ability of remote therapy to widen access to specialist healthcare. Familiarity with online work emerged as a strong indicator of positive attitudes towards remote DDP, especially if the previous experience is positive and the child is confident using technology. Overall, families differed greatly in their experience of remote and face-to-face DDP indicating a new approach must be undertaken with each family beginning therapy, ensuring it is unique and individual to their needs.

Nursing Students' Experiences of Empathy in a Virtual Reality Simulation Game: A Descriptive Qualitative Study.

Empathy is significant in nursing, and showing empathy toward a patient positively impacts a patient's health. Learning empathy through immersive simulations is effective. Immersion is an essential factor in virtual reality. This study aimed to describe nursing students' experiences of empathy in a virtual reality simulation game. Data were collected from nursing students (n = 20) from May 2021 to January 2022. Data collection included individual semistructured interviews; before the interviews, the virtual reality gaming procedure was conducted. Inductive content analysis was used. Nursing students experienced compassion and a feeling of concern in the virtual reality simulation game. Students were willing to help the virtual patient, and they recognized the virtual patient's emotions using methods such as listening and imagining. Students felt the need to improve the patient's condition, and they responded to the virtual patient's emotions with the help of nonverbal and verbal communication and helping methods. Empathy is possible to experience by playing virtual reality simulation games, but it demands technique practicing before entering the virtual reality simulation game.

It's Just a Distance Thing: Affordances and Decisions in Online Disclosure of Sexual Violence Victimization.

The Internet offers an alternative context in which personal experiences with sexual violence can be shared. It has been suggested that victims experience lower barriers to disclosing their stories in a digital environment due to an online disinhibition effect and mainly anonymity. However, little is known about the lived experiences of victims who have shared their experiences online regarding these disinhibiting affordances of the Internet. Twenty-three interviews with victims were conducted to understand the digital affordances involved in the online disclosure of sexual victimization. The results suggest that the Internet offers several opportunities (visibility management, asynchronicity, and connectivity) and constraints (lack of non-verbal communication, disclosing online is irreversible, and Internet as a source of triggers) when disclosing sexual violence victimization online. We learn that disclosures are informed by previous experiences and weighed against digital affordances. Victims use multiple platforms or multiple accounts on the same platform and manipulate anonymity and visibility through the settings of online platforms. The Internet offers a potential for informal online peer support. The results have practical implications for victims, clinicians, and support providers for guiding the disclosure process. Furthermore, a re-evaluation and nuance of the online disinhibition theory is suggested. Suggestions for future research are made.

VERBAL İNTERAKTİVLİYİN PLÜRALİST YANAŞMADA TƏDRİSİNİN BƏZİ MƏSƏLƏLƏRİ

Some Issues of Teaching Verbal Interactivity in a Pluralistic Approaches Summary The article deals with the some issues of teaching verbal interactivity in a pluralistic approaches. When communicating in a foreign language, the rules for using speech activities and practical activities related to verbal interactivity in different situations are shown. The article also refers to the Common European Framework of Reference for Languages (CEFR) in the application of verbal and non-verbal communication and the Framework of Reference for Pluralistic Approaches to Languages and Cultures(CARAP) developed under the leadership of Michel Candelier. In this regard, the use of gestures, facial expressions and body language to achieve effective communication during dialogues in cultural and natural situations is important in teaching French. The scientific studies of local and foreign linguists and methodologists on the subject have been analyzed and summarized. Key words: communication, interactivity, verbal communication, nonverbal communication, pluralistic approaches

The impact of scaffolded and non-scaffolded suicidal virtual human interaction training on clinician emotional self-awareness, empathic communication, and clinical efficacy

BackgroundClinicians working with patients at risk of suicide often experience high stress, which can result in negative emotional responses (NERs). Such negative emotional responses may lead to less empathic communication (EC) and unintentional rejection of the patient, potentially damaging the therapeutic alliance and adversely impacting suicidal outcomes. Therefore, clinicians need training to effectively manage negative emotions toward suicidal patients to improve suicidal outcomes.MethodsThis study investigated the impact of virtual human interaction (VHI) training on clinicians’ self-awareness of their negative emotional responses, assessed by the Therapist Response Questionnaire Suicide Form, clinicians’ verbal empathic communication assessed by the Empathic Communication and Coding System, and clinical efficacy (CE). Clinical efficacy was assessed by the likelihood of subsequent appointments, perceived helpfulness, and overall interaction satisfaction as rated by individuals with lived experience of suicide attempts. Two conditions of virtual human interactions were used: one with instructions on verbal empathic communication and reminders to report negative emotional responses during the interaction (scaffolded); and the other with no such instructions or reminders (non-scaffolded). Both conditions provided pre-interaction instructions and post-interaction feedback aimed at improving clinicians’ empathic communication and management of negative emotions. Sixty-two clinicians participated in three virtual human interaction sessions under one of the two conditions. Linear mixed models were utilized to evaluate the impact on clinicians’ negative emotional responses, verbal empathic communication, and clinical efficacy; and to determine changes in these outcomes over time, as moderated by the training conditions.ResultsClinician participants’ negative emotional responses decreased after two training sessions with virtual human interactions in both conditions. Participants in the scaffolded condition exhibited enhanced empathic communication after one training session, while two sessions were required for participants in the non-scaffolded condition. Surprisingly, after two training sessions, clinical efficacy was improved in the non-scaffolded group, while no similar improvements were observed in the scaffolded group.ConclusionLower clinical efficacy after virtual human interaction training in clinicians with higher verbal empathic communication suggests that nonverbal expressions of empathy are critical when interacting with suicidal patients. Future work should explore virtual human interaction training in both nonverbal and verbal empathic communication.

Detecting Leadership Opportunities in Group Discussions Using Off-the-Shelf VR Headsets.

The absence of some forms of non-verbal communication in virtual reality (VR) can make VR-based group discussions difficult even when a leader is assigned to each group to facilitate discussions. In this paper, we discuss if the sensor data from off-the-shelf VR devices can be used to detect opportunities for facilitating engaging discussions and support leaders in VR-based group discussions. To this end, we focus on the detection of suppressed speaking intention in VR-based group discussions by using personalized and general models. Our extensive analysis of experimental data reveals some factors that should be considered to enable effective feedback to leaders. In particular, our results show the benefits of combining the sensor data from leaders and low-engagement participants, and the usefulness of specific HMD sensor features.

Brief Report: Quantifying Speech Production Coordination from Non- and Minimally-Speaking Individuals.

Non-verbal utterances are an important tool of communication for individuals who are non- or minimally-speaking. While these utterances are typically understood by caregivers, they can be challenging to interpret by their larger community. To date, there has been little work done to detect and characterize the vocalizations produced by non- or minimally-speaking individuals. This paper aims to characterize five categories of utterances across a set of 7 non- or minimally-speaking individuals. The characterization is accomplished using a correlation structure methodology, acting as a proxy measurement for motor coordination, to localize similarities and differences to specific speech production systems. We specifically find that frustrated and dysregulated utterances show similar correlation structure outputs, especially when compared to self-talk, request, and delighted utterances. We additionally witness higher complexity of coordination between articulatory and respiratory subsystems and lower complexity of coordination between laryngeal and respiratory subsystems in frustration and dysregulation as compared to self-talk, request, and delight. Finally, we observe lower complexity of coordination across all three speech subsystems in the request utterances as compared to self-talk and delight. The insights from this work aid in understanding of the modifications made by non- or minimally-speaking individuals to accomplish specific goals in non-verbal communication.

Empowering Nonverbal Communication: A Comprehensive Examination of Sign Language Recognition Systems and Implementation of Interpretation

This paper provides a analysis of previous research on sign language recognition systems and their impact on Providing meaningful interaction among non-verbal individuals. It introduces a real-time sign language interpreter that translates text into gestures and vice-versa, accommodating regional sign languages and promoting personal expression. In a manner distinct from previous systems, it emphasizes individualization and includes text chat features for seamless communication. By enabling users to create and share their own gestures, it Promotes cultural diversity and authentic self-expression, promoting inclusivity and empowerment within the non-verbal community. This innovative solution also alleviates the pressure on non-verbal communication users to perform gestures in front of a camera for accurate recognition, addressing issues with outdated sign languages and the lack of personal sign gestures. Key Word: Sign Language Recognition, Text-to-sign Translation, Sign Language Interpreter, Sign Language Evolution, Recognition Models, Recognition Techniques.

Perceived Effects of Tango Argentino on Couple Relationship Functioning in Individuals with Parkinson’s Disease and Their Partners: Findings from a Qualitative Study

This research focuses on the impact of Tango Argentino (TA) on the dynamics of relationships in couples who are dealing with Parkinson’s disease (PD). In particular, it investigates Neuro Tango Argentino Training as an intervention to explore its effects on participants and the potential benefits for the well-being and relationship dynamics of couples dealing with PD. By conducting semi-structured interviews with 13 individuals with PD and their partners, six main themes emerged. These themes include relationship quality and body awareness. The participants reported increased sensitivity and non-verbal communication within couples following the TA intervention. Additionally, the study demonstrated the adaptability of this intervention through the development of a 10-week TA program tailored for individuals with impairments. These findings suggest that TA can promote shared body awareness, facilitate meaningful experiences and encourage interaction among couples managing PD. In conclusion, this research indicates that TA holds promise as an intervention to enhance shared body awareness in couples affected by PD; however, further investigation is warranted to validate these findings.

Content validity of the electronic faces thermometer scale for pain in children: is a picture worth more than a thousand words?

Early recognition of pain in children is crucial, and their self-report is the primary source of information. However, communication about pain in healthcare settings can be challenging. For non-verbal communication regarding different symptoms, children prefer digital tools. The electronic Faces Thermometer Scale (eFTS) utilizes a universal design with colors, face emojis, and numbers on an 11-point scale (0-10) for pain assessment. The aim of this study was to establish content validity of the eFTS for pain assessments in children. A mixed methods design was used. The study took place at a university hospital in eastern Sweden, involving 102 children aged 8-17 years who visited outpatient clinics. Participants were presented with 17 pictures representing varying pain levels and asked to assess hypothetical pain using the eFTS. A think-aloud approach was employed, prompting children to verbalize their thoughts about assessments and the eFTS. Quantitative data were analyzed using descriptive and comparative statistics, together with a qualitative approach for analysis of think-aloud conversations. A total of 1,734 assessments of hypothetical pain using the eFTS were conducted. The eFTS differentiated between no pain (level 0-1) and pain (level 2-10). However, no clear agreement was found in the differentiation between hypothetical pain intensity levels (level 2-10). The analysis revealed that children utilized the entire scale, ranging from no pain to high pain, incorporating numbers, colors, and face emojis in their assessments. The variability in assessments was influenced by prior experiences, which had an impact on the statistical outcome in our study. However, employing the think-aloud method enhances our understanding of how children utilize the scale and perceive its design, including the incorporation of emotion-laden anchors. Children express a preference for using the eFTS to assess their pain during hospital visits.

Animal Fridays in Robinson Crusoe and Its Afterlives

Robinson narrates his rescue of Friday in a way that is reminiscent of the saving of the dog ten pages before: he calls them both ‘poor creatures’ and uses non-verbal communication with Friday at first as he does with his ‘pets’: all are discussed and addressed as his ‘subjects’ and possessions, irrespective of their human or non-human bodies. In a number of Robinsonades, the blurred human-animal boundary is translated in the fact that the role of Friday is taken up by an animal, most often a pet, as is the case with Yann Martel’s Life of Pi, in which the tiger, Richard Parker, is subjugated by Pi in a manner reminiscent of imperial control. Following recent critical work on ‘Animal Crusoes’ in children’s Robinsonades as well as the increased interest in ecocritical, posthuman theories and animal studies, this article focuses on animal comparisons and characters as regards Friday in Defoe’s novel and Life of Pi. It shows that while both texts may depict the subjugation of Friday in the context of colonialism and imperialism, they also participate in the breaking down of the absolute boundaries between humans and non-humans and provide a reflection upon and reevaluation of the nature/culture dichotomy.

Adaptations to sociality in the mimetic and auricular musculature of the African wild dog (Lycaon pictus).

The African wild dog (Lycaon pictus) is a highly social canid that engages in sophisticated, coordinated group hunting tactics to procure large game. It is one of the most effective hunters of the African savannah, due to its highly developed communication methods. It also has large, mobile ears which enhance its auditory capabilities while hunting and assist with thermoregulation. Recent research suggested that certain muscles of facial expression, particularly those involved with expressive eyebrow movement, evolved solely in domestic dogs (Canis familiaris) to facilitate communication with their human owners. However, it is unclear whether highly social wild canid species may also employ similar expressive eye communication. We performed detailed dissections of an adult male L. pictus to evaluate and describe its mimetic and auricular musculature. Overall, L. pictus has well-developed facial and ear muscles. Musculi levator anguli oculi medialis (LAOM) and retractor anguli oculi lateralis (RAOL), mimetic muscles of hypothesized importance in domestic dog-human non-verbal communication, are enlarged in L. pictus, comparable in size to those of domestic dogs, as is m. orbicularis oculi. This morphology suggests that ocular facial expressions contribute to within-pack communication in wild dogs and are not unique to domestic dogs. The auricular muscles of L. pictus are well-developed, supporting greater leverage and fine manipulation of its large, mobile ears. These muscular adaptations facilitate the highly social ecology of African wild dogs and challenge current interpretations about the unique nature of domestic dog facial expressions.

Laughing out loud in Edward Albee’s Who’s Afraid of Virginia Woolf?: a postmodernist reading

In Edward Albee’s Who’s Afraid of Virginia Woolf? (1962), laughing out loud is the most common act shared by all the characters. This laughter often surfaces during moments of tension, failure, or encounters with death. The tragicomic nature of this laughter, arising from such circumstances, mirrors a postmodernist playful stance towards assertions of singularity and unquestionable truths, operating on both structural and thematic levels. The laughter characters produce may seem as inappropriate in certain situations. However, seen from a postmodernist perspective, it can be defined as an expression of scepticism towards diseased metanarratives and absolute foundations. The postmodern tendency to question and revise claims to ultimate truth finds resonance in the loud laughter of pain and relief. Within the postmodernist context, laughter transforms into an anti-foundational nonverbal expression against constraints and oppression. This paper asserts the postmodernist nature of laughter, frequently heard in Who’s Afraid of Virginia Woolf?, emphasising its playful yet serious tone.

Impaired recognition of interactive intentions in adults with autism spectrum disorder not attributable to differences in visual attention or coordination via eye contact and joint attention

Altered nonverbal communication patterns especially with regard to gaze interactions are commonly reported for persons with autism spectrum disorder (ASD). In this study we investigate and differentiate for the first time the interplay of attention allocation, the establishment of shared focus (eye contact and joint attention) and the recognition of intentions in gaze interactions in adults with ASD compared to control persons. Participants interacted via gaze with a virtual character (VC), who they believed was controlled by another person. Participants were instructed to ascertain whether their partner was trying to interact with them. In fact, the VC was fully algorithm-controlled and showed either interactive or non-interactive gaze behavior. Participants with ASD were specifically impaired in ascertaining whether their partner was trying to interact with them or not as compared to participants without ASD whereas neither the allocation of attention nor the ability to establish a shared focus were affected. Thus, perception and production of gaze cues seem preserved while the evaluation of gaze cues appeared to be impaired. An additional exploratory analysis suggests that especially the interpretation of contingencies between the interactants’ actions are altered in ASD and should be investigated more closely.

Digital Boundaries: A Review of Clinical and Ethical Issues in Telepsychology among Mental Health Professionals

With the COVID-19 epidemic starting in early 2020, the unintentional mass migration to online therapy has drastically changed the landscape. Because of this, mental health professionals need to be conscious of the fact that their traditional ethical obligations still hold even while using technology to offer a service. This scoping study examined the applicability of telepsychology among mental health practitioners as well as its ethical and clinical concerns. There is general agreement in this study that providing mental health treatments to clients via telepsychology is a realistic and practical option both before and after the epidemic. There was a clear pattern that the most prevalent clinical concerns were restricted nonverbal communication between the therapist and the client, communication difficulties in the therapeutic relationship, unsuitable to some mental health disorders, and clinician exhaustion. On the other side, privacy, and secrecy, insufficient telepsychology training and instruction, boundary-related concerns, insufficient telepsychology rules, and handling emergencies were significant ethical issues. These findings open the door to telepsychology, a workable method of providing mental health and psychosocial treatments that aim to reach clients across geographic boundaries and continue the transformative job of fostering change, healing, and growth among clients. Understanding these problems makes it easier for mental health practitioners to respond to future public health emergencies and other natural catastrophes

Persuasive Communication Between Wedding Photographers and Consumers During Covid-19 in Completing Work Contracts

The impact of the Covid-19 virus that has struck Indonesia is also felt by photographers, especially in the context of weddings. Wedding events during the Covid-19 pandemic significantly affect photographers in providing good services to customers due to the involvement of two large families. Photographers must have strategies to attract customers. One possible strategy that photographers may use in this regard is employing persuasive communication. Therefore, this research aims to analyze the processes and obstacles of verbal and non-verbal persuasive communication between photographers and customers in completing work contracts. This study is qualitative with a constructivist paradigm. The results indicate that the persuasive communication employed by photographers provides a sense of safety and comfort to customers. Obstacles such as time delays pose challenges for photographers