From Gestures to Gaming: Visible Embodiment of Remote Actions

Abstract

Teleoperation is the act of controlling an object that exists in a space, real or virtual, physically disconnected from the user. During such situations, it is not uncommon to observe those controlling the remote object exhibiting movement consistent with the behaviour of the remote object. Though this behaviour has no obvious impact on one's control of the remote object, it appears tied to one's intentions, thus, possibly representing an embodied representation of ongoing cognitive processes. In the present investigation, we applied a natural behaviour approach to test this notion, (a) first by identifying the representational basis for the behaviour and (b) by identifying factors that influence the occurrence of the behaviour. Each study involved observing participant behaviour while they played a racing video game. Results revealed that the spontaneous behaviour demonstrated in a teleoperation setting is tied to one's remote actions, rather than local actions or some combination of remote and local actions (Experiment 1). In addition, increasing task demand led to an increase in the occurrence of the spontaneous behaviour (Experiment 2). A third experiment was conducted to rule out the possible confound of greater immersion that tends to accompany greater demand (Experiment 3). The implications of these results not only suggest that spontaneous behaviour observed during teleoperation reflects a form of visible embodiment, sensitive to task demand, but also further emphasizes the utility of natural behaviour approaches for furthering our understanding of the relationship between the body and cognitive processes.