Nonverbal Aspects Research Articles

Computational elucidation of nonverbal behavior and body language in music therapy

Abstract Music therapy has shown efficacy in serious and chronic conditions, mental disorders, and disabilities. However, there is still much to explore regarding the mechanisms through which music interventions exert their effects. A typical session involves interactions between the therapist, the client, and the musical work itself, and to help address the challenges of capturing and comprehending its dynamics, we extend our general computational paradigm (CP) for analyzing the expressive and social behavioral processes in arts therapies. The extension includes bodily and nonverbal aspects of the behavior, offering additional insights into the client's emotional states and engagement. We have used this version of the CP, which employs AI pose estimation technology, image processing, and audio analysis, to capture therapy-related psychometrics and their intra- and inter-session analysis. The CP is applied in a real-world proof-of-concept study, and the results enable us to pinpoint meaningful events and emergent properties not captured by the human eye, complementing the therapist's interpretations. The resulting data may also be useful in other scientific and clinical areas.

The Russian Language Textbook as a Multimodal Object

The school textbook has always been the most important tool for organizing the educational process. Many studies by Kazakhstani scholars have been devoted to the issue of the quality of Kazakhstani textbooks. However, most of the research primarily focuses on the verbal component of textbooks, while their visual design is often underestimated. This suggests that the school textbook is not considered a holistic multimodal object, each element of which (both verbal and non-verbal) is intended to contribute to developing students' multimodal literacy. Since the development of educational literature today is carried out not only by scholars but also by practicing educators, there is a need to study teachers' professional attitudes toward the multimodality of textbooks. The article employs a survey method to investigate teachers' evaluative perception of the visual design of Russian language textbooks for the 5th grade from the publishers “Mektep” and “AEO NIS”. The authors found out that teachers transfer their negative attitude towards the verbal component of the textbook to its non-verbal aspect, poorly understanding the didactic potential of the multimodality of the textbook, which hinders their successful work in shaping and developing students' multimodal literacy. In light of the insufficiently high ranking of Kazakhstani students in international studies such as PIRLS and PISA, the results obtained in the article acquire special relevance. Based on the conducted analysis, the authors propose recommendations for solving the identified problem.

Machine Learning Predicts Accuracy in Eyewitnesses’ Voices

AbstractAn important task in criminal justice is to evaluate the accuracy of eyewitness testimony. In this study, we examined if machine learning could be used to detect accuracy. Specifically, we examined if support vector machines (SVMs) could accurately classify testimony statements as correct or incorrect based purely on the nonverbal aspects of the voice. We analyzed 3,337 statements (76.61% accurate) from 51 eyewitness testimonies along 94 acoustic variables. We also examined the relative importance of each of the acoustic variables, using Lasso regression. Results showed that the machine learning algorithms were able to predict accuracy between 20 and 40% above chance level (AUC = 0.50). The most important predictors included acoustic variables related to the amplitude (loudness) of speech and the duration of pauses, with higher amplitude predicting correct recall and longer pauses predicting incorrect recall. Taken together, we find that machine learning methods are capable of predicting whether eyewitness testimonies are correct or incorrect with above-chance accuracy and comparable to human performance, but without detrimental human biases. This offers a proof-of-concept for machine learning in evaluations of eyewitness accuracy, and opens up new avenues of research that we hope might improve social justice.

Application of a Combined Approach in Pragmatic Rehabilitation in a Case of Autism Spectrum Disorder

This study focuses on a 12-year-old girl diagnosed with a pragmatic disorder caused by Autism Spectrum Disorder (ASD). Following an initial evaluation, a pragmatic rehabilitation program was implemented using a combined approach in 15 therapeutic sessions over a 4-month period. The program consisted of structured formats organized into modules to train the verbal, paralinguistic, and nonverbal aspects of communication. The results of the re-evaluation demonstrated the program’s effectiveness, with improvements in communicative intention, proxemic skills, prosodic variations, physical contact with the interlocutor, and verbal fluency in oral messages. Consequently, the implementation of the intervention program significantly enhanced the patients’ pragmatic communication skills in therapeutic, familial, and social contexts.

Incorporating verbal and nonverbal aspects to enhance a model of patient communication in cancer care: A grounded theory study.

High-quality communication is essential to patient-centered care. Existing communication models and research tends to focus on what is said verbally with little attention to nonverbal aspects of communication. In sensitive and emotionally intensive healthcare encounters, such as in cancer care, provider and patient nonverbal behavior may be particularly important for communicating with empathy. Therefore, the aim of this study was to develop a conceptual model of communication that accounts for nonverbal behavior. We followed a systematic grounded theory design that involved semi-structured interviews with 23 providers, including nurse practitioners, physicians, surgeons, and physician's assistants. Using constant comparative analysis, we analyzed transcripts and developed a grounded theory model of communication accounting for nonverbal behavior. The major themes included building rapport, gauging how patients will take bad news, ensuring patients' understanding of their conditions, staying honest but hopeful, centering but guiding patient through cancer care, conveying empathy while managing heightened emotions, and ensuring patient understanding. Throughout the process, providers synthesize both verbal and nonverbal information and apply what they learn to future encounters. The results extend existing models of patient-centered communication and invite communication intervention and research that incorporates nonverbal behavior. The model contributes an understanding of the full process of communication in clinical encounters.

Impact of YouTube on Non-verbal aspects of Pakistani ESL Learners’ Oral Presentation Skills

Impact of YouTube on Non-verbal aspects of Pakistani ESL Learners’ Oral Presentation Skills

Beyond musical training: Individual influences on the perception of the speech-to-song illusion

When a spoken phrase is repeated several times, listeners often report a perceptual illusion during which speech is transformed into song. The speech-to-song (STS) illusion is often attributed to prosodic elements of speech, though listeners can vary greatly in their STS experience. While previous research established robust links between music aptitude and STS, the present study asks whether other cognitive traits may also influence STS. Individual (in)sensitivity to nonverbal aspects of speech, specifically speech prosody, has been previously linked to autistic traits and emotional intelligence. We test whether the presence of autistic traits, the level of emotional intelligence and musical training, as well as syntactic complexity influence the likelihood, speed, and strength of STS among native British English listeners. The results provide evidence for the involvement of some but not all studied traits. We found sentence complexity to be interacting with a composite score of musical training, and emotional intelligence for the likelihood of STS, whereas sentence complexity influenced the strength of the transformation. These results suggest that individual listener variability may interact with the linguistic parameters of sentences in STS. Crucially, sensitivity to prosody through emotional intelligence or by the presence of autistic traits does not mediate the transformation.

Supporting Mixed-Presence Awareness across Wall-Sized Displays Using a Tracking Pipeline based on Depth Cameras

One of the main benefits of large interactive surfaces (e.g. wall-sized displays) lies in their support for collocated collaboration by facilitating simultaneous interactions with the displays and high awareness of other group members' actions. In the context of remote collaboration, this awareness information needs to be acquired through digital means such as video feeds, which typically offer very limited information on non-verbal communication aspects, including on workspace awareness. We describe a new approach we have implemented to tackle that challenge through a multimodal pipeline that deals with tracking, attributing, transmitting, and visualising non-verbal information through what we refer to as workspace awareness cues, across wall-sized displays placed at distant locations. Our approach relies on commodity depth cameras combined with screen configuration information to generate deictic cues such as pointing targets and gaze direction. It also leverages recent artificial intelligence breakthroughs to attribute such cues to identified individuals and augment them with additional gestural interactions. In the present paper, we expand on the details and rationale behind our approach, describe its technical implementation, validate its novelty with regards to the existing literature, and report on early but promising results from an evaluation we conducted based on a mixed-presence decision-making scenario across two distant wall-sized displays.

AI in situated action: a scoping review of ethnomethodological and conversation analytic studies

AbstractDespite its elusiveness as a concept, ‘artificial intelligence’ (AI) is becoming part of everyday life, and a range of empirical and methodological approaches to social studies of AI now span many disciplines. This article reviews the scope of ethnomethodological and conversation analytic (EM/CA) approaches that treat AI as a phenomenon emerging in and through the situated organization of social interaction. Although this approach has been very influential in the field of computational technology since the 1980s, AI has only recently emerged as such a pervasive part of daily life to warrant a sustained empirical focus in EM/CA. Reviewing over 50 peer-reviewed publications, we find that the studies focus on various social and group activities such as task-oriented situations, semi-experimental setups, play, and everyday interactions. They also involve a range of participant categories including children, older participants, and people with disabilities. Most of the reviewed studies apply CA’s conceptual apparatus, its approach to data analysis, and core topics such as turn-taking and repair. We find that across this corpus, studies center on three key themes: openings and closing the interaction, miscommunication, and non-verbal aspects of interaction. In the discussion, we reflect on EM studies that differ from those in our corpus by focusing on praxeological respecifications of AI-related phenomena. Concurrently, we offer a critical reflection on the work of literature reviewing, and explore the tortuous relationship between EM and CA in the area of research on AI.

Non-Verbal Communication Aspect in Paper Umbrella Craft as Intangible Cultural Heritage in Malang

Paper umbrellas are one of the crafts included in the intangible cultural heritage of Malang, East Java. Currently, it is known that there is only one group of craftsmen who still produce this paper umbrella craft. Although not many of them, this paper umbrella craft still exists among people who like traditional handicrafts. This is evident from how often paper umbrella crafts appear at craft exhibitions in cities in Indonesia. Consequently, there is a pressing need for in-depth research on paper umbrella craftsmanship in Malang City. A valuable avenue for exploration is the examination of non-verbal communication aspects inherent in paper umbrella craftsmanship. This study aimed to determine the non-verbal communication aspects contained in paper umbrella crafts. The research employs a descriptive qualitative approach, focusing on analyzing non-verbal communication aspects. Data was collected using unstructured interview methods, documentation, and field surveys. The collected data was reduced for analysis using nonverbal communication theory. The study findings are presented descriptively, detailing the observed non-verbal communication aspects. The findings reveal three distinct categories of non-verbal communication aspects in paper umbrella craftsmanship: fixed features, semi-fixed features, and non-fixed features. Fixed features include shapes depicted on the umbrella. Semi fixed feature is a choice of material used to make paper umbrellas, colors, and motifs. The materials used are bamboo and paper. The colors of the umbrellas are red and green. The motif drawn on the umbrella is a floral motif. Flowers are present because they are the favorite shapes of the craftsmen who make umbrellas. Non-fixed features encompass the entire process of crafting paper umbrellas, from material preparation to final finishing touches. Keywords: umbrella paper, craft, tangible cultural heritage

Conceptualizing museum translation

Abstract The scholarly debate in translation studies and related fields has extensively addressed the definition, scope, and limitations of translation. We contend that museum translation, which encompasses both the traditional “translation proper” as well as the non-verbal and multimodal aspects of translation, is central to this debate. Museum translation covers an extensive spectrum of perspectives, which contribute to the expansion of the concept of translation and the field of translation studies. It capitalizes on the intrinsic interdisciplinarity of museum studies and translation studies, fostering a profound exchange of disciplines and serving as an ideal foundation for discussing the boundaries of translation. It has a dynamic nature that can contract or expand to suit the researcher’s perspective and disciplinary concentration. A comprehensive examination of the intricate procedures encompassed by museum translation is, therefore, timely. In this article, we examine and compare different applications of this concept and provide an overview of how various disciplines and research foci have approached this area of study. We aim to contribute to the ongoing development of the concept of museum translation and its position in translation studies, a call further addressed by each author in this special issue titled “Museums as Spaces of Cultural Translation and Transfer.”

Psychiatrists' Illustration of Awe in Empathic Listening Assessments: A Pilot Study.

Background "Awe" is typically an inspiring emotional response to perceptually vast stimuli signifying the transcendence beyond all cognitive frames of reference when we encounter the unexpected. Physicians' experience of awe in clinical care interactions has not been studied in an empirical, evidence-based way. We aim to present a focused study of awe in a psychiatrist's empathic listening (EL) assessments and propose an evidence-based framework to study it. Methodology This is an exploratory case series of a psychiatrist's EL interactions (mean duration/x̄ of 46.17 minutes) with six patients (two males and four females) aged 32-72 years (x̄ =54.67, σ = 16.64). Using the method of autoethnography, the verbal and nonverbal aspects of the EL assessments were analyzed and open-coded to generate qualitative data. Results The study revealed that the data in all the case studies could be classed into two thematic groups, namely, mindfulness and transpersonal mindfulness. The emotions of "awe" and "non-agency" were ubiquitous in all six case studies both for the psychiatristand patients. Conclusions Recognizing the awe and non-agency in EL interaction is essential in conceptualizing the "mindfulness-to-transcendence" framework and the first step toward the evidence-based study of transcendence/metaphysics in phenomenological psychiatry.

Exploring the experiences and preferences of South Asian patients' of primary care in England since COVID-19.

Remote (digital and/or telephone) access and consultation models are being driven by national policy with the goal being that the National Health Service operateon a remote-first (digital-first) basis by 2029. Previous research has suggested that remote methods of access to care and consulting may act to widen health inequalities for certain patients and/or groups such as those from ethnic minorities. South Asian (SA) patients comprise the largest ethnic minority group in England. Understanding the experiences and needs of this group is critical to ensuring that general practice can deliver equitable, quality health care. Qualitative study. 37 participants (from Indian, Pakistani and/or Bangladeshi background) were recruited to take part in either in-person preferred language focus groups or remote semistructured interviews in the English language. Thematic analysis was conducted to identify themes in the qualitative data. Three major interlinked themes were identified: (1) reduced access, (2) reduced patient choiceand (3) quality and safety concerns. The findings highlight access issues split by (i) general issues with appointment access via any remote means and (ii) specific issues related to language barriers creating additional barriers to access and care. Some patients valued the convenience of remote access but also raised concerns regarding appointment availability and reduced patient choice. Face-to-face consultations were preferable but less available. The findings underscore how participants perceived remote care to be of lesser quality and less safe. Concerns were greatest for those with limited English proficiency (LEP), with the removal of non-verbal aspects of communication and 'hands-on' care leading to perceptions of reduced psycho-social safety. SA patients' experiences of remote-led primary care access and care delivery were negative with only a minority viewing it positively and for certain limited scenarios. Face-to-face models of care remain the preferred mode of consultation, particularly for those with LEP. Hybrid models of access offer patients the greatest choice, and are likely to meet the varying needs of the South-Asian patient population going forwards. The remote first approach to primary care may be achievable as a service ideal, but its limitations need to be recognised and accounted for to ensure that primary care can be an equitable service, both now and in the future. Members of the public were involved in all phases of research in the study. This included co-working in partnership throughout the study including, reviewing patient-facing documents, recruiting participants, data facilitation, translation work, interpretation of the data and co-authors on this manuscript. The key to the success of our study was collaborative teamwork, which involved experienced members of the public with SA cultural knowledge working together with and integral to the research team for all components.

"They must have seen it, you know." Body talk, extension talk, and action talk: A qualitative study on how palliative care patients and their significant others express experiencing these nonverbal cues.

Communication about life-threatening disease and palliative care is essential but often experienced as difficult by those concerned and has mainly been studied in terms of its verbal components. Despite the fundamentality of nonverbal communication, its dimensions in care, especially in the communication by patients and their significant others, has not been as extensively examined. Drawing on a secondary qualitative content analysis of data from 23 interviews-15 with patients in specialized palliative home care in Sweden and 8 with their significant others-this study aims at understanding and characterizing how patients verbally express experiences of conveying nonverbal cues about life-threatening disease and its consequences and how their significant others express perceiving these cues. Patients expressed experiences of nonverbal communication in the form of cues conveying meaning about their disease and its consequences, often beyond their control. Whether and how the patients reinforced these cues verbally, depended on individual needs, care for others, and evaluations of relationships. Significant others acknowledged the presence of nonverbal cues and tried to interpret their meaning. Both patients and significant others emphasized the importance of nonverbal cues and actively related to how cues in the form of bodily appearance, aids, objects and acts, serve communicative functions about disease and its consequences. These dimensions of nonverbal communication are characterized as: body talk, extension talk and action talk. This study contributes to an international knowledge base on the complexities of nonverbal communicative aspects in these dimensions and how it affects patients and significant others. Professionals should be aware that dimensions of care, such as prescribed aids, from the patients' perspective can be perceived as nonverbal cues that might "speak of" disease progression.

КАРЛ III И КОРОНАЦИЯ: МЕТАФОРИЧЕСКИЙ ОБРАЗ НА ПРИМЕРЕ КАРИКАТУР НОВОСТНЫХ ИЗДАНИЙ

This article considers the unique role of representing the coronation of Charles III within the news aspect of Internet discourse, focusing on the non-verbal aspects of the text. Caricature studies, appearing in both printed and electronic periodicals, are conducted through cognitive-discursive analysis of metaphor. Three distinct periods of cartoon releases are examined: following the death of Elizabeth II, on the eve of the coronation, and during the initial weeks after the coronation. Among the 126 analyzed images, those prevailed that conveyed pragmatic meanings of immaturity, unpreparedness, and inconsistency, primarily through attributive manifestations of royal power such as shoes, headgear (crown, hat), and throne. The authors highlight the predominant ironic and somewhat condescending vector of visual metaphors, attributing this to the public attitude developed over an extended period preceding the accession to the throne

Socio-Pragmatic Functions of Greeting Expressions in Teaching Turkish as a Foreign Language Textbooks

Greetings serve as a fundamental aspect of human communication, playing a pivotal role in establishing and maintaining social relationships. This research investigates the socio-pragmatic functions of greetings reflected in teaching Turkish as a Foreign Language (TFL) textbooks, aiming to shed light on how the intricate interplay between language, culture, and social interaction is reflected in teaching materials. With this aim, greeting exchanges from five different series of TFL textbooks were collected and analyzed. In the quantitative analyses, the frequency of each form and strategy of greetings were determined in the data. In the qualitative analyses, the classification and pragmatic functions of the greetings were investigated by analyzing different variables such as the gender of the speakers, time relations, familiarity between the speakers, formality/speaker roles, the speech context, and the photographic details accompanying greetings. The data was also analyzed according to Ebsworth et al.’s (1995) categorization of American greetings. The Common European Framework of Reference for Languages (CEFR) levels of the textbooks under focus were considered in the analyses. The findings showed that greeting forms have mostly been reflected in the A1 level according to the CEFR criteria and the most frequently reflected form of greeting in Turkish is merhaba (Ar. marhaba/Eng. hello) in the current data. In terms of the socio-linguistic/pragmatic and non-verbal aspects regarding greetings and the classification and the socio-pragmatic functions of greetings in TFL textbooks, various reflections of the role of greetings in shaping social interaction in Turkish culture were also displayed.

DRAMA FOR THE DEVELOPMENT OF COMMUNICATIVE COMPETENCE IN PRESCHOOL

Rapid changes in society force people to face increasingly complex life challenges that require the ability to adapt to changes and function effectively in a social context. The issue of communicative competence, on the level of which the quality of this adaptation and functioning depends to a large extent, is becoming more relevant. The development of communicative competence begins already in preschool. It is necessary to create an appropriate and supportive environment in which the development of verbal and non-verbal aspects of communication, including vocabulary, would be promoted in various ways according to the child's educational needs.The aim of the paper is to analyze the possibilities of using drama for the development of communicative competence in preschool. The results obtained show the usefulness of drama as a method for the development of communicative competence, as well as differences depending on the gender of a child: boys need more pedagogical support for the development of communicative competence than girls.

Movement through motherhood: Exploring mood, wellbeing, and prenatal emotional availability (EA) through EA-based dance intervention.

Emotional availability (EA) is a construct that describes the observed emotional connection in parent-child relationships. During pregnancy, EA is assessed only using caregiver sensitivity and nonhostility. We used the nonverbal aspects of these qualities to create a new dance/movement intervention ("EA-Based Dance Intervention"). Given the scarcity of pregnancy interventions, we provided training to participants on how to be emotionally engaged with their unborn babies through dance/movement. The EA-Based Dance Intervention alone comprised the first intervention arm (n=12). A second intervention arm involved the combination of EA-Based Dance Intervention with brief psychoeducation (n=10). The third arm was a control group, which received only the assessments (n=7). Measures of self-reported symptoms of depression and anxiety, emotional expressivity, flourishing, and the (newly developed) self-reported prenatal EA were used at pre- and posttest. The measure of observed prenatal EA was used to compare intervention versus control at posttest only. In this pilot study, we found that participants receiving the EA-Based Dance Intervention alone or combined with psychoeducation, self-reported improved anxiety symptoms and self-reported higher prenatal EA. When compared with the control group, those experiencing EA-Based Dance Intervention reported fewer depressive symptoms from pre- to posttest.

Communication aspects of doctor-patient interrelationship

The medical act is based, including, on the doctor-patient relationship, which can have positive or negative influences on patient satisfaction, compliance, clinical and, finally, economic results. This article presents a synthesis of publications from the relevant scientific literature, addresses the importance of the doctor-patient relationship and communication aspects. The analyzed sources confirm that the interaction between doctor and patient is the central and critical element of medical services, and communication skills (empathy, verbal and nonverbal aspects, motivational interviewing, decision-making collaboration, etc.) can be learned and developed, which will bring benefits for clinical outcomes and will increase the quality of life and patient satisfaction with the medical system.

Paralanguage in the Translation of Children’s Graphic Novels into Arabic: Jeff Kinney’s Diary of a Wimpy Kid

AbstractGraphic novels are marketed as helpful for reluctant young readers. The supplementation of text with visual stimuli as part of a multimodal narrative is often claimed to improve reading comprehension and motivation in children and young adolescents. The translation into Arabic of Jeff Kinney’s Diary of a Wimpy Kid series, by comparison, fails to deliver an equally engaging reading experience. In the Arabic versions of Rodrick Rules and Hard Luck, language acts as an obstacle to comprehension due to the misrepresentation of textual paralanguage, broadly defined as the written representation of nonverbal aspects of communication including tone, stress and volume. As paralanguage is also involved in character portrayal, this translation approach paints a rather dull image of the series’ protagonist Greg. Using the textual paralanguage typology proposed by Luangrath et al. (J Consum Psychol 27:98–107, 2017), the case is made here for closer attention in translation to the pragmatic meanings contained in textual paralanguage. As the novel evolves to incorporate an ever-expanding array of multimodal elements, so should the translation strategies involved in rendering these texts into other languages.