Appearance, motion, and embodiment: unpacking avatars by fine‐grained communication analysis

Abstract

SummaryThanks to the maturity of motion tracking technologies, it became easy and inexpensive to use avatars that reflect the user's facial and body motions in real time. There is a possibility that those real‐time avatars can serve as a substitute for videos in distant communication. We conducted two experiments to confirm positive effects of avatars on distant communication. In the first experiment, the subjects watched a conversation partner's video, avatar, photo, or nothing when speaking to the partner. Because the video and avatar delivered the partner's motion while the video and photo delivered the partner's appearance, we were able to observe the effects of the motion and appearance separately. As a result, we found that presenting the motion via a video or an avatar increased the degree of the smoothness of speaking to the partner, but the appearance did not significantly affect such an influence. In the second experiment, we compared the avatar and teleoperated robot to find how a physical embodiment influences the degree of the smoothness of speech. Teleoperated robots resemble avatars in transmitting the user's body motions without disclosing the user's appearance but differ in reflecting these motions onto a robot that has a physical embodiment. We predicted that the robot produces smoother speech because the physical embodiment might make the body motions recognizable. However, the robot decreased the degree of the smoothness of speech against our expectation. The results of these experiments showed that real‐time avatars that present only body motions are enough to smooth distant communication. Copyright © 2014 John Wiley & Sons, Ltd.