How virtual agents can learn to synchronize: An adaptive joint decision-making model of psychotherapy

Abstract

Joint decision-making can be seen as the synchronization of actions and emotions, usually via nonverbal interaction between people while they show empathy. The aim of the current paper was (1) to develop an adaptive computational model for the type of synchrony that can occur in joint decision-making for two persons modeled as agents, and (2) to visualize the two persons by avatars as virtual agents during their decision-making. How to model joint decision-making computationally while taking into account adaptivity is rarely addressed, although such models based on psychological literature have a lot of future applications like online coaching and therapeutics. We used an adaptive network-oriented modelling approach to build an adaptive joint decision-making model in an agent-based manner and simulated multiple scenarios of such joint decision-making processes using a dedicated software environment that was implemented in MATLAB. Programming in the Unity 3D engine was done to virtualize this process as nonverbal interaction between virtual agents, their internal and external states, and the scenario. Although our adaptive joint decision model has general application areas, we have selected a therapeutic session as example scenario to visualize and interpret the example simulations.