Nonverbal Data Research Articles

“I can tell he is in a good mood.” Embodied aspects of information in human-animal relationship

In a multispecies family, both humans and animals learn how to live together through embodied experiences and beyond the verbal transmission of information. This paper, based on a pilot study about information that makes meaning in multispecies families, aims to highlight embodied aspects of information that shape human-animal shared daily activities. Drawing on posthumanism and hermeneutic phenomenology; four multispecies families participated in semi-structured interviews about their family and video tours of their households. A combination of inductive and deductive coding was applied to the verbal and non-verbal data collected. The codes included a range of different senses, functions of the body, feelings from inside the body, the body’s appearance, etc. The results show how information moves across animal and human bodies. The categories of body as a thing, moving body, acting body, and sensing body shape different ways of experiencing, expressing and enacting information among human and nonhuman participants. Shared embodied information enables animals and humans to read the meaning of their intentions and actions and create intersubjective understanding and meaning in their relationship.

Power of nonverbal behavior in online business negotiations: understanding trust, honesty, satisfaction, and beyond

ABSTRACT Digital teamwork has become prevalent and is ever since becoming part of the human work- and life-style, globally. But in comparison with face-to-face setting, virtual teams face multifold challenges. To date, scarce empirical research has examined whether team-breaking challenges are associated with limited access to peer nonverbal signals. This study examines whether access to body signals is associated with effective teamwork, and whether limited access provokes key team challenges. We also examine what social-psychological team concepts can be detected from peers’ consciously or unconsciously displayed visual cues that cannot be as effectively gained without visual access. 14 dyadic teams of MBA students were examined in an online business negotiation task to reach an authentic commercial deal. Half of the teams negotiated only through voice and text, while the other half had camera access as well. Using an exploratory mixed methods analysis, we identified 12 unique team factors based on nonverbal data. We also found that teams with camera access could build mutual trust more rapidly, detect peer honesty better, and realize agreements on suggestions more accurately. Surprisingly, we also found instances where camera access became stressful and participants reported it as an additional burden. Conclusions and implications are reported at the end.

استراتجية تحسين مهارة الكلام باللغة العربية للطلاب المكثف في معهد جامعة الأمين الإسلامية برندوان سومنب مادورا

The purpose of this study is to understand the strategies of Al-Amien Prenduan For Islamic Studies to improve students' oral Arabic ability, as well as the supporting factors and constraints of Al-Amien Prenduan For Islamic Studies students' oral Arabic ability. This study adopts qualitative research methods and collects data in the form of interviews, observations and documents. The data analysis method used by researchers in the research is to analyze nonverbal data to verify the effectiveness of the data used by researchers. These data are undoubtedly original, and are widely used for participation, persistence, observation and triangulation. As for the results of this study, mad's strategy in improving students' Arabic speaking skills is to use writing skills to establish, provide vocabulary, update, hint or discuss, and make students understand Arabic. At a special gathering, we discussed how to improve the skills of all students at Al-Amien Prenduan For Islamic Studies. Among other students, factors that help improve Arabic students' oral skills include: the environment affects oral skills, useful numbers are hidden, punishment is frozen or punished, pure Flamingo books, behavior and language courses. Arabic competitions, such as story telling. Among other things, students are hindered in improving their oral Arabic skills: lack of enthusiasm for learning, lack of awareness, inadequate facilities and environmen.

Predicting home discharge after inpatient rehabilitation of stroke patients with aphasia

ABSTRACT The early identification of the discharge setting from Inpatient Rehabilitation Facilities is a primary goal in stroke-related research because of its clinical and socio-economic relevance. Several features have been identified as significant predictors of the discharge setting. Within cognitive deficits, aphasia is known to be a common and disabling condition that could influence rehabilitation outcome. However, it is often set as an exclusion criterion in stroke research. This study aims to investigate the predictive power of clinical variables, in particular specific language disturbances and nonlinguistic cognitive deficits, for discharge setting in post-acute stroke patients with aphasia after intensive multidisciplinary rehabilitation. In a sample of 158 patients, demographic, motor, language, and nonverbal cognitive data were retrospectively considered for the prediction of the discharge to home vs. another institutional setting. Univariate analysis identified relevant differences between groups and the significant variables were included in a logistic regression model. The results showed that better functional motor status, absence of dysphagia and unimpaired nonlinguistic cognitive profile independently predict the discharge to home. In particular, nonverbal cognitive functioning seemed to be specifically relevant within the aphasic population. The findings could be helpful for setting up the rehabilitation priorities and an adequate discharge arrangement.

Zaraza nadchodzi i odchodzi – myślenie o chorobach epidemicznych utrwalone w języku

In this article, I present selected aspects of the linguistic image of the plague (I am especially interested in names and their etymology, the causes of the disease, images of the plague, and remedies). I mainly rely on materials related to Polish folk culture, but I also mention some contemporary contexts to show a certain durability of beliefs related to the plague. I use the notion of a linguistic and cultural image of the world understood as a colloquial interpretation of reality that can be explicated not only using verbal data, but also with non-verbal data preserved in petrified texts of culture. In my considerations, I refer to the so-called cognitive definition. The material basis of the analysis presented (in line with Jerzy Bartmiński’s assumptions) consists of lexical and textual data: names (confirming the “perspective of reality”), information transmitted on an onomasiological basis, revealed in the etymological and word-formation analysis, meanings given in the definitions in Polish and dialectal dictionaries, word-formation derivatives, metaphorical extensions, phraseologisms, collocations (phrases), metaphors, proverbs, healing formulas, etc. In Polish folk culture, the plague was imagined as a living creature (woman) who could roam the land (come and go), come to the village, talk to people, put them to death, or save the ones she chose to live. These images of the plague made peasants try to secure their space and to create a safe zone for themselves and their community by means of various magical procedures.

Semiotics Analysis on Historical Memes in Eno Bening’s Tweet Replies

This research is entitled Semiotics Analysis on Historical Memes in Eno Bening’s Tweet Replies. The study concerns with all the way the researchers explore the meaning of representamen/signs on either non-verbal and verbal data of historical memes in Eno Bening’s tweet replies. The method used in this paper is descriptive qualitative analysis where the researchers describe the meaning of the memes. The researchers also use semiotics analysis proposed by Pierce’s semiotic analysis (1994) in order to discover the interpretation of meaning implied in the memes. From the analysis, the researchers conclude that the historical memes in Eno Bening’s tweet replies mostly used to retell a story of historical events that happened in the past. Furthermore, memes are also used to criticize, give an opinion and also satirize a historical event.

Comparing Manual and Automated Coding Methods of Nonverbal Synchrony

ABSTRACT The manual coding of nonverbal cues by trained human coders, such as counting the occurrence of a specific behavior or subjective rating about a speaker, is still a major method in the study of nonverbal synchrony. However, its time-consuming nature has been a serious barrier to the development of the field and has made it difficult for new scholars to adopt the technique. Recent advances in automated coding techniques allow researchers to collect nonverbal behavioral data effectively and objectively, but it is unclear how comparable the manual and automated coding methods are. This study, therefore, directly compared both methods of coding in a face-to-face conversation experiment. In the manual coding, a software system C-BAS was employed to count the occurrence of synchrony in gesture, posture, nodding, and other cues. In the automated coding, a cross-correlation analysis and a cross-wavelet coherence analysis were separately performed for the participant’s movement data. The results showed that the manual and automated coding were moderately correlated, and yielded similar significant differences between experimental conditions of conversational involvement in the degree of synchrony. Further, synchrony measured via both coding techniques was significantly associated with post-conversation self-reports. The advantages and disadvantages of both techniques are discussed.

Analyzing Self-Explanations in Mathematics: Gestures and Written Notes Do Matter

When learners self-explain, they try to make sense of new information. Although research has shown that bodily actions and written notes are an important part of learning, previous analyses of self-explanations rarely take into account written and non-verbal data produced spontaneously. In this paper, the extent to which interpretations of self-explanations are influenced by the systematic consideration of such data is investigated. The video recordings of 33 undergraduate students, who learned with worked-out examples dealing with complex numbers, were categorized successively including three different data bases: (a) verbal data, (b) verbal and written data, and (c) verbal, written and non-verbal data. Results reveal that including written data (notes) and non-verbal data (gestures and actions) leads to a more accurate analysis of self-explanations than an analysis solely based on verbal data. This influence is even stronger for the categorization of self-explanations as adequate or inadequate.

Personal identifiability of user tracking data during observation of 360-degree VR video

Virtual reality (VR) is a technology that is gaining traction in the consumer market. With it comes an unprecedented ability to track body motions. These body motions are diagnostic of personal identity, medical conditions, and mental states. Previous work has focused on the identifiability of body motions in idealized situations in which some action is chosen by the study designer. In contrast, our work tests the identifiability of users under typical VR viewing circumstances, with no specially designed identifying task. Out of a pool of 511 participants, the system identifies 95% of users correctly when trained on less than 5 min of tracking data per person. We argue these results show nonverbal data should be understood by the public and by researchers as personally identifying data.

Manifestation of Teacher’s Speech Hegemony in Learning Bahasa Indonesia in the Classroom

Abstract The purpose of this study was to study, describe and analyze the teacher's hegemony in the class discourse of gender perspective. To achieve that goal, this research attempts to describe and explain the acts and verbal forms of the subjects’ speech (teacher and students). In determining data and data analysis, a gender perspective is used as a basis for describing the conception of men and women as a reflection of the prevailing ideology in society. These conceptions related to gender identity, gender roles, and gender status all have implications for gaining access, participation, control, and benefits. This research data is in the form of oral discourse of teacher and students’ speech as verbal data and context as nonverbal data. Field notes are used as additional verbal and nonverbal data. The method used in this study is observation, interviews, and audio-visual recordings of students' activities in classroom learning. Forms of hegemony include directive speech, assertive speech, and expressive speech from female teachers to students. While male teachers show the use of expressive speech to hegemonize students in classroom learning.

INTEGRASI HIGH ORDER THINKING SKILLS (HOTS) DALAM LEMBAR KERJA SISWA CERDAS DAN KRITIS BERBAHASA INDONESIA UNTUK KELAS IX SMP/MTs

The purpose of this study is to describe the types and levels of high-level thinking exercises in LKS Teks Tanggapan: Cerdas dan Kritis Berbahasa Indonesia kelas IX SMP/MTs which is the result of the development of teaching materials in 2019. The integration of higher-order thinking skills is expected to provide input to the form of exercises to be designed for text learning to be more meaningful. This research is a qualitative analysis technique using content analysis to infer textual units into conceptual categories. The data form is exposure to nonverbal data of training in LKS. The results showed that there were six out of nine exercises that integrated the thinking processes of C4, C5, and C6 accompanied by additional information to the users of teaching materials

Mobile Application Use in Technology- Enhanced DCTs

In response to calls for improving the quality of DCTs as data-gathering instruments, this study investigates the effectiveness of technology-enhanced discourse completion tasks (TE-DCTs) as a method for eliciting nonverbal speaker data. We used a mobile application to administer four TE-DCTs to native speakers (L1) and intermediate and advanced second-language (L2) speakers of Spanish. Each TE-DCT contained two scenarios with the goal of capturing nonverbal devices used in the speech act of attention-getting (i.e., devices used to draw the interlocutor's attention). The written description of each DCT scenario was supplemented with a short video clip to provide participants with nonverbal factors such as distance to interlocutor, bodily stance, and orientation of interlocutors. To capture nonverbal cues as part of the participant responses, the participant video recorded their oral responses to each scenario. The mobile application used was successful in capturing a variety of attention-getting elements, including nonverbal devices, in the majority of both L1 and L2 participant responses for all DCT scenarios. Drawing on this data, we argue for the use of mobile applications as an ecologically valid way to measure one type of pragmatic ability. In addition, we advocate their integration into L2 pedagogical practice.

Neuropsychological outcomes on Head Start III: a prospective, multi-institutional clinical trial for young children diagnosed with malignant brain tumors.

Current pediatric brain tumor treatment focuses on titrating toxicity based on risk factors while simultaneously improving survivorship. The Head Start (HS) protocols I to IV (1991-present) use high-dose chemotherapy (HDCTx) with an aim of reducing or eliminating cranial irradiation in very young children, the most vulnerable to its effects. We examined estimated Full Scale IQ, overall Adaptive Functioning, Working Memory, Processing Speed, and Verbal and Nonverbal Memory outcome data for 43 HS III patients diagnosed between ages 2 months and 7 years from 15 institutions in the United States and Canada. At a mean of 5.12 years postdiagnosis, the HS III patients performed within the average to low-average ranges across these variables; however, individual variability was noted with scores ranging from superior to impaired, and the sample as a whole performed lower than age expectations. Performance did not significantly differ by sex or ethnicity, diagnosis, or for those treated with an intravenous methotrexate dose of 400 mg/kg vs 270 mg/kg. Additionally, performance did not significantly differ by age at diagnosis or length of follow-up. The results, indicating overall average to low-average neurocognitive functioning, are encouraging, though significant individual variability was noted. Those who were younger at diagnosis, received more intensive methotrexate, and were further out from treatment were not at significantly increased risk of cognitive decline within our sample, suggesting a strategy of using HDCTx and autologous hematopoietic progenitor cell rescue to reduce or eliminate irradiation may allow for continued CNS development in young children treated for a brain tumor.

Integrating Multimodal Information in Large Pretrained Transformers.

Recent Transformer-based contextual word representations, including BERT and XLNet, have shown state-of-the-art performance in multiple disciplines within NLP. Fine-tuning the trained contextual models on task-specific datasets has been the key to achieving superior performance downstream. While fine-tuning these pre-trained models is straight-forward for lexical applications (applications with only language modality), it is not trivial for multimodal language (a growing area in NLP focused on modeling face-to-face communication). Pre-trained models don't have the necessary components to accept two extra modalities of vision and acoustic. In this paper, we proposed an attachment to BERT and XLNet called Multimodal Adaptation Gate (MAG). MAG allows BERT and XLNet to accept multimodal nonverbal data during fine-tuning. It does so by generating a shift to internal representation of BERT and XLNet; a shift that is conditioned on the visual and acoustic modalities. In our experiments, we study the commonly used CMU-MOSI and CMU-MOSEI datasets for multimodal sentiment analysis. Fine-tuning MAG-BERT and MAG-XLNet significantly boosts the sentiment analysis performance over previous baselines as well as language-only fine-tuning of BERT and XLNet. On the CMU-MOSI dataset, MAG-XLNet achieves human-level multimodal sentiment analysis performance for the first time in the NLP community.

Insecurity and Self-Acceptance Portrayed in Samsung Galaxy A8 Advertisement “Lets You Be You”: A Multimodal Analysis

This study analyzed the issue of insecurity and self-acceptance portrayed in Samsung Galaxy A8 advertisement entitled “Lets You Be You”. The main theory for this study is the theory of multimodal discourse analysis by Paltridge (2012) and the theory of body language by Pease (2004) as the supporting theory. Qualitative approach is applied because this study involves the interpretation of both verbal and nonverbal data. The findings showed how the issue of insecurity is reflected through the reaction of the participants in the video before and after receiving a compliment. Furthermore, the construction of the changing process from insecurity to self-acceptance can be seen from the genuine reaction of the compliment, as well as the change of facial expression throughout the video. Key words: Insecurity, Self-acceptance, Multimodal Discourse Analysis, Advertisement, Samsung

Prediction of Who Will Be Next Speaker and When Using Mouth-Opening Pattern in Multi-Party Conversation

We investigated the mouth-opening transition pattern (MOTP), which represents the change of mouth-opening degree during the end of an utterance, and used it to predict the next speaker and utterance interval between the start time of the next speaker’s utterance and the end time of the current speaker’s utterance in a multi-party conversation. We first collected verbal and nonverbal data that include speech and the degree of mouth opening (closed, narrow-open, wide-open) of participants that were manually annotated in four-person conversation. A key finding of the MOTP analysis is that the current speaker often keeps her mouth narrow-open during turn-keeping and starts to close it after opening it narrowly or continues to open it widely during turn-changing. The next speaker often starts to open her mouth narrowly after closing it during turn-changing. Moreover, when the current speaker starts to close her mouth after opening it narrowly in turn-keeping, the utterance interval tends to be short. In contrast, when the current speaker and the listeners open their mouths narrowly after opening them narrowly and then widely, the utterance interval tends to be long. On the basis of these results, we implemented prediction models of the next-speaker and utterance interval using MOTPs. As a multimodal-feature fusion, we also implemented models using eye-gaze behavior, which is one of the most useful items of information for prediction of next-speaker and utterance interval according to our previous study, in addition to MOTPs. The evaluation result of the models suggests that the MOTPs of the current speaker and listeners are effective for predicting the next speaker and utterance interval in multi-party conversation. Our multimodal-feature fusion model using MOTPs and eye-gaze behavior is more useful for predicting the next speaker and utterance interval than using only one or the other.

Recognizing Facial Expression in Video Processing

Theoretical, the Micro-expressions convey explicit nonverbal data, for instance the facial development caused by agony. In any case, as a result of their neighborhood and short nature, it is hard to distinguish MEs. This paper displays a novel recognition technique by perceiving a nearby and worldly example of facial development. In our framework, with the reason of improving the discovery precision, fleeting neighborhood highlights are created from the video in a sliding window of 300ms (mean span of a ME). These highlights are separated from a projection in PCA space and structure a particular example amid ME which is the equivalent for all MEs. Utilizing a traditional characterization calculation (SVM), MEs are then recognized from other facial developments. At long last, a worldwide combination examination is connected on the entire face to dispose of false positives. Trials are performed on MATLAB. The discovery results demonstrate that the proposed technique beats the most prevalent discovery technique by the investigation of different measurements.

PROMOTING STUDENTS’ COLLABORATION SKILL THROUGH PROJECT BASED LEARNING OF ENGLISH WRITING

Abstract This research is focused on Project Based Learning and collaboration skill of students. It is aimed to describe how Project Based Learning promotes students’ collaboration skill with others as one of four Cs skills in 21st of Century Skills. The subject of this study was five students in the ninth grade in one of state Islamic schools in Kediri. The researcher collected the data from observation and the recording video of the process of creating the project, which was wall magazine. The observation was done twice and the activities during the process of making wall magazine will be written in field note and recorded by using video recorder. This research highlights more on the process of creating the project rather than the product. Therefore, all the data will be in the form of verbal and non-verbal data. After selecting the appropriate data, the result shows that the students can reach all of indicators of collaboration skills with eleven examples as the evidences. In short, it can be concluded that Project Based Learning can promote students’ collaboration.Keywords : Project Based Learning, Collaboration Skill, Wall Magazine, Junior High School

Patterns of Teacher-Students Interaction Based on The Textbook “When English Rings A Bell” for Seventh Grade: A Classroom Discourse Study

This study aimed to: 1) describe how teachers structure their classroom interaction based on the textbook “When English Rings a Bell” for Seventh Grade, and 2) reveal what affects their structuring classroom interaction.The study belongs to a case study. However, principles of discourse analysis are applied to data gathering and data analysis. Data were collected through interviews, document check, observation, note taking and videotaping of 80 minute-classroom interaction of four teachers, twice each, teaching seventh graders of four junior high schools. Verbal and non-verbal data were gathered, transcribed, noted and analyzed.Findings show that teachers structured their classroom interaction by consistently implementing the 2013 Curriculum and its aspects especially its scientific approach. More specifically, it was revealed that the teachers: (1) worked over the five stages of the scientific approach, in the order as it should be: observing, questioning, experimenting, associating, communicating; (2) started and ended the lessons using the same set of activities and expressions; (3) mostly used laptops and LCDs to provide language exposure by presenting songs, chants, texts, and tasks; (4) used Shaw’s textbook adaptation technique by modifying the content and format of the textbook material; (5) discussed interpersonal and transactional texts, through the texts’ social function, generic structure, and linguistic features. (6) integrated all four language competences of listening, reading, speaking, and writing, with the emphasis on oral and written skills; (7) assigned tasks requiring students’ active thinking rather that creative one; (8) were lack of time to measure students’ individual performance; (9) used bilinguals of English and Indonesian; (10) conducted indoors classes and arranged students to sit facing them except in group works. Further it was found out that teachers’ perception and language competence shaped teachers’ presentation in similar and different classroom interaction.

PENINGKATAN KEMAMPUAN MENULIS PUISI DENGAN TEKNIK AKROSTIK SISWA SMP KRISTEN EBEN HAEZAR MANADO

The aim of this research is to develop poetry writing ability on grade 7 students of Eben Haezar 2 Middle School in Manado. The design of this research is Class Action Research. The indicators such as diction, figurative language, rhyme, and image. The objects of this research are the 7 C students of Eben Haezar 2 Middle School which are comprised of 28 students. The data of this research are verbal and non-verbal data. The data were obtained by observing, recording, interview, and documentation. The data are analyzed using a qualitative method, such as classification, reduction, explanation and analyses, and conclusion. The result of this research shown that was ability increasing on poetry writing with acrostic technique including learning planning, implementing and the lesson learned.