Interaction Unfolds Research Articles

Dopamine and serotonin in human substantia nigra track social context and value signals during economic exchange.

Dopamine and serotonin are hypothesized to guide social behaviours. In humans, however, we have not yet been able to study neuromodulator dynamics as social interaction unfolds. Here, we obtained subsecond estimates of dopamine and serotonin from human substantia nigra pars reticulata during the ultimatum game. Participants, who were patients with Parkinson's disease undergoing awake brain surgery, had to accept or reject monetary offers of varying fairness from human and computer players. They rejected more offers in the human than the computer condition, an effect of social context associated with higher overall levels of dopamine but not serotonin. Regardless of the social context, relative changes in dopamine tracked trial-by-trial changes in offer value-akin to reward prediction errors-whereas serotonin tracked the current offer value. These results show that dopamine and serotonin fluctuations in one of the basal ganglia's main output structures reflect distinct social context and value signals.

Lean 4.0: a systematic literature review on the interaction between lean production and industry 4.0 pillars

PurposePrior to managing a company’s processes in the presence of a combination of paradigms, there is a need to understand their underlying interaction. This paper systematically reviews the existing literature that discusses the interaction between lean production (LP) and the fourth industrial revolution (i.e. Industry 4.0). The study aims to understand how the interaction unfolds and whether it is synergistic.Design/methodology/approachThe research relies on a systematic literature review of peer-reviewed articles from Scopus and Web of Science that discuss the interaction between the two paradigms. The final set of articles pertaining to the topic was analysed.FindingsThe article presents that the interaction between the two paradigms occurs through a representation of the pillars of the House of Lean (HoL) interacting with the nine technological pillars of Industry 4.0. There is a consensus on the synergistic nexus among the pillars and their positive impact on operational performance. We also demonstrate the weights of the interactions between the two paradigms and the areas of operations management where this interaction takes place through Sankey charts. Our research indicates that the largest synergistic interaction occurs between just-in-time and industrial Internet of Things (IIoT) and that companies should invest in IoT and cyber-physical systems as they have the greatest weight of interactions with the pillars of the HoL.Research limitations/implicationsThis research facilitates a deeper insight into the interaction between LP and Industry 4.0 by organising and discussing existing research on the subject matter. It serves as a starting point for future researchers to formulate hypotheses about the interaction among the various pillars of LP and Industry 4.0, apply these interactions and test them through empirical research.Practical implicationsIt could serve as a guide for managers to understand with which interactions they should start the digitalisation process.Originality/valueWith the rise in discussions on the interaction between the two paradigms, there is still an opportunity to understand the specificity of this interaction. Compared to the initial seminal works on the subject, such as Buer et al. (2018b), which investigated the direction of interaction between the two paradigms, this research contributes to further investigating this specificity and gaining a better understanding of the relationship governing the interaction between LP and Industry 4.0 by delineating the interaction state among the pillars of the two paradigms and its relevant importance.

Neuromodulation of the Left Inferior Frontal Cortex Affects Social Monitoring during Motor Interactions.

Motor interactions require observing and monitoring a partner's performance as the interaction unfolds. Studies in monkeys suggest that this form of social monitoring might be mediated by the activity of the ventral premotor cortex (vPMc), a critical brain region in action observation and motor planning. Our previous fMRI studies in humans showed that the left vPMc is indeed recruited during social monitoring, but its causal role is unexplored. In three experiments, we applied online anodal or cathodal transcranial direct current stimulation over the left lateral frontal cortex during a music-like interactive task to test the hypothesis that neuromodulation of the left vPMc affects participants' performance when a partner violates the agent's expectations. Participants played short musical sequences together with a virtual partner by playing one note each in turn-taking. In 50% of the trials, the partner violated the participant's expectations by generating the correct note through an unexpected movement. During sham stimulation, the partner's unexpected behavior led to a slowdown in the participant's performance (observation-induced posterror slowing). A significant interaction with the stimulation type showed that cathodal and anodal transcranial direct current stimulation induced modulation of the observation-induced posterror slowing in opposite directions by reducing or enhancing it, respectively. Cathodal stimulation significantly reduced the effect compared to sham stimulation. No effect of neuromodulation was found when the partner behaved as expected or when the observed violation occurred within a context that was perceptually matched but noninteractive in nature. These results provide evidence for the critical causal role that the left vPMc might play in social monitoring during motor interactions, possibly through the interplay with other brain regions in the posterior medial frontal cortex.

Exploring the Discourse of Debriefing Interactions: Areas for Improvement

Debriefing has been widely used as part of simulation-based education (SBE) to promote reflective thinking and prepare students for real clinical practice. This study examined a real debriefing transcript to identify its structure and gain insight into communication strategies used by the participants. The sample included an extended debriefing session in which a debriefer and undergraduate students, who participated in a critical care nursing simulation, engaged in a self-reflection phase. Adopting discourse analysis approaches, the analysis revealed how this interaction unfolds. The analysis also unveiled an asymmetric relationship during the debriefing that positioned the debriefer in a position of power and interactional dominance, and placed students in a passive role. Interactional features such as the use of open-ended questions, silent pauses, and informative feedback were identified as effective communication strategies to support the interaction; however, to achieve efficient self-debriefing, debriefers in this setting are encouraged to balance the use of questions to avoid restraining students from engaging and producing extended turns. Moreover, debriefers need to establish a safe environment that optimizes students’ involvement in self-reflection. This study recommends the use of other debriefing techniques to minimize the dominance of the debriefer during the interaction.

Invoking and identifying task-oriented interlocutor confusion in human-robot interaction.

Successful conversational interaction with a social robot requires not only an assessment of a user's contribution to an interaction, but also awareness of their emotional and attitudinal states as the interaction unfolds. To this end, our research aims to systematically trigger, but then interpret human behaviors to track different states of potential user confusion in interaction so that systems can be primed to adjust their policies in light of users entering confusion states. In this paper, we present a detailed human-robot interaction study to prompt, investigate, and eventually detect confusion states in users. The study itself employs a Wizard-of-Oz (WoZ) style design with a Pepper robot to prompt confusion states for task-oriented dialogues in a well-defined manner. The data collected from 81 participants includes audio and visual data, from both the robot's perspective and the environment, as well as participant survey data. From these data, we evaluated the correlations of induced confusion conditions with multimodal data, including eye gaze estimation, head pose estimation, facial emotion detection, silence duration time, and user speech analysis-including emotion and pitch analysis. Analysis shows significant differences of participants' behaviors in states of confusion based on these signals, as well as a strong correlation between confusion conditions and participants own self-reported confusion scores. The paper establishes strong correlations between confusion levels and these observable features, and lays the ground or a more complete social and affect oriented strategy for task-oriented human-robot interaction. The contributions of this paper include the methodology applied, dataset, and our systematic analysis.

“What do you think?” How interaction unfolds following opinion-seeking questions and implications for encouraging subjectification in education

This study investigates how classroom interaction unfolds following an opinion-seeking question asked by teachers or students. By using conversation analysis as a research method, the authors found that to an opinion-seeking question the preferred response of a student is to express an opinion as if it originated from their own thoughts. These responses are often followed by a non-minimal follow-up by both teachers and peers. We illustrate that the non-minimal follow-ups are formulated in two different ways: generic or specific, whereby a specific non-minimal follow-up appears to offer the best opportunity for subjectification. Subjectification is about the existence of the student as subject of his own life. If a student provides a specific non-minimal follow-up, the student expresses himself as a subject, with his own thoughts and a unique voice, which appears to prompt a dialogue in which fellow participants are also invited to express themselves.

Immersive machine learning for social attitude detection in virtual reality narrative games

People can understand how human interaction unfolds and can pinpoint social attitudes such as showing interest or social engagement with a conversational partner. However, summarising this with a set of rules is difficult, as our judgement is sometimes subtle and subconscious. Hence, it is challenging to program Non-Player Characters (NPCs) to react towards social signals appropriately, which is important for immersive narrative games in Virtual Reality (VR). We collaborated with two game studios to develop an immersive machine learning (ML) pipeline for detecting social engagement. We collected data from participants-NPC interaction in VR, which was then annotated in the same immersive environment. Game design is a creative process and it is vital to respect designer’s creative vision and judgement. We therefore view annotation as a key part of the creative process. We trained a reinforcement learning algorithm (PPO) with imitation learning rewards using raw data (e.g. head position) and socially meaningful derived data (e.g. proxemics); we compared different ML configurations including pre-training and a temporal memory (LSTM). The pre-training and LSTM configuration using derived data performed the best (84% F1-score, 83% accuracy). The models using raw data did not generalise. Overall, this work introduces an immersive ML pipeline for detecting social engagement and demonstrates how creatives could use ML and VR to expand their ability to design more engaging experiences. Given the pipeline’s results for social engagement detection, we generalise it for detecting human-defined social attitudes.

General Framework for the Optimization of the Human-Robot Collaboration Decision-Making Process Through the Ability to Change Performance Metrics.

This paper proposes a new decision-making framework in the context of Human-Robot Collaboration (HRC). State-of-the-art techniques consider the HRC as an optimization problem in which the utility function, also called reward function, is defined to accomplish the task regardless of how well the interaction is performed. When the performance metrics are considered, they cannot be easily changed within the same framework. In contrast, our decision-making framework can easily handle the change of the performance metrics from one case scenario to another. Our method treats HRC as a constrained optimization problem where the utility function is split into two main parts. Firstly, a constraint defines how to accomplish the task. Secondly, a reward evaluates the performance of the collaboration, which is the only part that is modified when changing the performance metrics. It gives control over the way the interaction unfolds, and it also guarantees the adaptation of the robot actions to the human ones in real-time. In this paper, the decision-making process is based on Nash Equilibrium and perfect-information extensive form from game theory. It can deal with collaborative interactions considering different performance metrics such as optimizing the time to complete the task, considering the probability of human errors, etc. Simulations and a real experimental study on “an assembly task” -i.e., a game based on a construction kit-illustrate the effectiveness of the proposed framework.

Women who remain in relationships with registered sexual offenders: Analysis of forum discussion

AbstractRegistered sexual offenders (RSOs) are inevitably on the receiving end of much negative evaluation within society. By association, individuals in close relationships with RSOs may experience what Goffman (1963) [Stigma: Notes on the management of spoiled identity. Simon & Schuster Ltd.] termed ‘courtesy stigma’, through which they are also negatively evaluated. The present study explores this phenomenon in the contemporary context of online discussion. Drawing on recent methodological developments in the microanalysis of online data, three specific threads from online parenting forums are examined, each opening with a specific account of their dilemma by women in intimate relationships with RSOs. Analysis of the sequential interaction within each thread demonstrates the way that stigma is performed by online parenting communities and how individuals manage that stigma as the interaction unfolds. We conclude that partners of RSOs, unlike family members, can mitigate courtesy stigma by ending the relationship, but otherwise risk being ostracised by community members.

Dialectics of the Development of the Integrated Social Systems

Introduction. The paper analyzes the specificity of the dialectical development of the integrated social systems of such a personality and society. The presence of positive (natural) contradictions is recognized as a necessary and creative factor in social practice. Under the influence of this type of contradiction, the old, outdated forms of social structure (individual components of the social system) are denied and transformed to new, more perfect ones occurs as a result of their successful resolution. Methods. In the analysis, the author relied on a system-holistic approach, traditional general philosophical methods: induction and deduction, theoretical analysis and synthesis, extrapolation, etc. Discussion. The social system as an integrated unity goes through a number of stages from inception, formation and maturity to the transition to a qualitatively new state. Accordingly, the process of the emergence and development of dialectical contradictions also has several stages: from insignificant differences between opposite sides at the beginning of the emergence of the system to their strengthening and exacerbation. The nature of the contradictions depends on the specifics of the opposing sides, as well as on the conditions in which their interaction unfolds. The determining factor here, in the opinion of the author, is the positive (natural) direction of social opposition, under the influence of which the essence of the contradictions themselves is formed. Conclusion. According to the dialectical approach, the source of social development is the unity and struggle of opposites within the social system. However, the presence of opposite sides is a necessary but insufficient condition for development. They create the preconditions for it, but do not act as its driving force. Only a change in one opposition relative to another creates alternative tension, giving rise to a dialectical contradiction. Therefore, the antagonistic or non-antagonistic character of the latter is due to the positive (natural) or negative character of the social opposition itself.

Responding to Information Requests: The Case of Inscribed Object Checks

This paper explores one way that participants use inscribed objects in their immediate environment as resources for interaction. In particular, it identifies and analyzes a type of embodied response turn found in information request sequences. The data come from a video recording of family members engaged in a joint cooking activity, where they are preparing an unfamiliar dish while following recipe instructions. In this setting, participants and inscribed objects hold varying levels of epistemic rights and access regarding the task at hand. This appears to have consequences for how the interaction unfolds. As participants ask questions about the recipe, respondents repeatedly employ a particular embodied practice of checking and reading aloud the recipe, which I call an inscribed object check. An analysis of this practice and its sequential variations shows how participants draw on verbal, embodied, and environmental resources to fill knowledge gaps made relevant by information requests when the knowledge lies within inscribed objects. The findings contribute to our understanding of the role that inscribed objects play in interaction, as well as how responses to information requests are managed in everyday settings when all participants are relatively unknowledgeable about the task at hand.

A variance decomposition of the Continuous Assessment of Interpersonal Dynamics.

The Continuous Assessment of Interpersonal Dynamics (CAID) is an observational coding method that enables continuous tracking of warmth and dominance in both members of a dyad as an interaction unfolds. Research using this tool has revealed dynamic patterns relevant to psychopathology and psychotherapy, suggesting considerable potential for clinical assessment and research. However, CAID data are sensitive to a variety of person and situational factors, and the way that these factors combine to influence CAID data is poorly understood. We examined data from 10 raters using CAID to assess moment-to-moment warmth and dominance in opposite-sex married dyads (N = 137 couples) interacting in four distinct situations. Using Generalizability Theory methods, we decomposed sources of variance in CAID data and estimated multiple forms of between- and within-person reliability. Results revealed how spouses' moment-to-moment behaviors varied as a function of person, sex, dyad, rater, situation, and relevant interactions between these factors. Based on these results, we provided guidelines for interpreting CAID data at different levels of aggregation in clinical research and practice. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Disability and influence in job interviews

PurposeThis purpose of this paper is to explore to efficacy of influence tactics at the outset of a job interview. Across three empirical studies, five influence tactics were manipulated during a simulated job interview to explore first impressions for candidates with or without a visible disability.Design/methodology/approachParticipants viewed videos of candidates (either in a wheelchair or not) responding to the opening question in a job interview by using one of five influence tactics (i.e. revealing a strong alternative, setting a numerical anchor, demonstrating approachability through imperfections, presenting hard skills that described job-related competencies or presenting soft skills including connecting well with and leading others). Perceptions of trustworthiness, fit for the current job and perceived appropriate salary amount were rated.FindingsResults show that, in general, tactics that might have beneficial effects when used at later moments, including the use of a strong alternate, anchor or imperfection display, may instead harm first impressions of anyone. When discussing specific skills, hard skills helped in both cases. However, the presentation of soft skills helped only the non-disabled job candidate. Trustworthiness acted as a mediator for most of these relationships in both populations.Originality/valueResults provide insight into how the use of these tactics very early in an interaction unfolds. Further, parsing the use of influence tactics into their effects on specific populations (such as people with disabilities) allows us to better understand the conditions under which they may help or hurt perceptions of employability.

Bevegelser mot ansvar: endrings­skapende dialoger i to terapier med menn som utøver vold i nære relasjoner [Opening up for responsibility: Co-creating change in two therapies with men who use violence against their intimate partner

There is a paucity of knowledge on psychotherapy aiming to help clients stop engaging in intimate partner violence (IPV). The purpose of this study is to enrich our understanding of the processes of violence-focused therapy by developing rich and clinically relevant descriptions that can inform and inspire other therapists. Using constructivist grounded theory, we shed light on how clients and therapist co-create change. The main finding of this study is that clients use language that can be understood as opening up toward or moving away from recognizing and experiencing responsibility. This can even occur within the same utterance. We describe how therapists meet these ways of speaking and how this interaction unfolds in sequences of dialogue. Use of language is an important gateway to change because it can both reflect and create clients’ experience of agency in their life. The findings can be useful for clinicians working with this and other client groups. It can also aid in further research on violence-focused therapy. Clinical implications are discussed.

The anatomy of antagonistic coregulation: Emergent coordination, path dependency, and the interplay of biomechanic parameters in Aikido

Using a video-supported cognitive ethnographic and phenomenological approach, we address the interactively generated dynamic of bouts in Aikido. This “soft” martial art enables a defender to blend with and then redirect an attacker’s aggressive energy so as to break his balance, while preserving an ethos of non-violence, mutuality, and respect. Our analysis explores the skills used to minutely adapt to the opponent, the causal-temporal structure of Aikido, notably the cumulative effect build-up and main decision points in a bout, as well as the perceptual cues from inter-body geometry, timing, and force dynamics that inform decisions. We then contrast different interaction scenarios by focusing on micro-events that shape defensive preferences. For a successful defense, technical modulations or even the preferred technique itself can be selected as the interaction unfolds (“decision-making-in-action”). For a closer look, we analyze the interplay of multiple parameters: flexibility of intention (i.e. early deciding vs. keeping options openlonger), technique (i.e. type of lever or throw), initial body symmetry, step combinations, spacing and timing relative to the attacker, degree of force, as well as possible skill differentials. We describe complex interdependencies between these parameters, which can be balanced in various ways as agents respond to the interaction dynamic.

Analysing the Impact of Music on the Perception of Red Wine via Temporal Dominance of Sensations

Several studies have examined how music may affect the evaluation of food and drink, but the vast majority have not observed how this interaction unfolds in time. This seems to be quite relevant, since both music and the consumer experience of food/drink are time-varying in nature. In the present study we sought to fix this gap, using Temporal Dominance of Sensations (TDS), a method developed to record the dominant sensory attribute at any given moment in time, to examine the impact of music on the wine taster's perception. More specifically, we assessed how the same red wine might be experienced differently when tasters were exposed to various sonic environments (two pieces of music plus a silent control condition). The results revealed diverse patterns of dominant flavours for each sound condition, with significant differences in flavour dominance in each music condition as compared to the silent control condition. Moreover, musical correspondence analysis revealed that differences in perceived dominance of acidity and bitterness in the wine were correlated in the temporality of the experience, with changes in basic auditory attributes. Potential implications for the role of attention in auditory flavour modification and opportunities for future studies are discussed.

Frontline Problem-Solving Effectiveness: A Dynamic Analysis of Verbal and Nonverbal Cues

This study examines the impact of frontline employees' problem solving on customer satisfaction (CSAT) during ongoing interactions prompted by service failures and complaints. Using outsourced regulation theory, the authors predict negative moderating effects of frontline relational work and displayed affect on the dynamic influence of frontline solving work on CSAT. Frontline employees' verbal (nonverbal) cues provide the basis to identify solving and relational work (displayed affect). The authors test hypotheses with data from video recordings of real-life problem-solving interactions involving airline customers as well as a controlled experimental study. They find that frontline solving work has a positive effect on CSAT, and it increases in magnitude as the interaction unfolds. However, this positive effect becomes weaker for relatively higher levels of frontline relational work or displayed affect and, conversely, stronger for relatively lower levels over time. In summary, overdoing relational work and overdisplaying positive affect diminish the efficacy of problem-solving interactions, a finding that provides implications for theory and practice.

Turn design and progression

The temporal character of talk is one fundamental feature of languagein situ. As interaction unfolds, participants need to not only monitor the temporal progression of talk toward a completion, but also attend to how the current turn ties back to the preceding turns. Whereas such dual-directional consideration is often a latent aspect of turn construction, at times efforts to clear up possible ambiguity are in order. This article introduces a Mandarin practice,aiyou-preface, which seems to be used just to this end, and demonstrates an intimate relationship between the prosodic design ofaiyou-preface and the displayed orientation to the intended directionality of the talk. The analysis draws upon a corpus of 35 hours of conversations collected in China.

A dynamic principal-agent framework for modeling the performance of infrastructure

This paper presents a novel approach to the problem of infrastructure development by integrating technical, economic and operational aspects, as well as the interactions between the entities who jointly carry out the project. The problem is defined within the context of a Public Private Partnership (PPP), where a public entity delegates the design, construction and maintenance of an infrastructure system to a private entity. Despite the benefits of this procurement method, the relationship between the two entities is inherently conflictive. Three main factors give rise to such conflict: the goals of the public and private party do not coincide, there is information asymmetry between them and their interaction unfolds in environments under uncertainty. The theory of contracts refers to this problem as a principal-agent problem; however, due to the complexity of the problem, it is necessary to recreate a dynamic interaction between the principal (i.e., the public entity) and the agent (i.e., the private entity) while including the monitoring of the infrastructure performance as an essential part of the interaction. The complex relationship between the sequential actions of players and the time-dependent behavior of a physical system is explored using a hybrid agent-based simulation model. The model is illustrated with several examples that show the versatility of the approach and its ability to accommodate the different decision strategies of the players (i.e., principal, agent) and the model of a physical infrastructure system.

Metaphor and the notion of control in trauma talk

AbstractMetaphor use in psychotherapy practice has been influenced by conceptual metaphor theory and the “internal target–external source” assumption, where targets comprise abstract therapeutic issues, while sources comprise concrete conceptual materials external to the therapeutic setting. The relevance of metaphor is hence questionable in trauma talk, since traumatic events involve intense bodily experiences which are already concrete and do not require any external inferential support. We examine transcripts of semi-structured interviews with 14 subjects following the 2010–2012 earthquakes in Christchurch, New Zealand, focusing on the role of metaphor in their conceptualization of a sense of “control” over their immediate physical environment, and more abstract aspects of their lives in the earthquakes’ aftermath. We discuss four discursive patterns which show how speakers used metaphor as a mechanism to extend or refocus initial discussion of physical control, to subsequent discussion of abstract control. This suggests that metaphor goes beyond a conceptualization role to play a “scaffolding” role in trauma talk, where an initial target topic may serve as a source concept for a subsequent target topic. Therapists therefore do not necessarily have to “look externally” for productive source domains, but could capitalize upon conceptual materials which present themselves as therapeutic interaction unfolds.