Perception of Emotional Expression of Mobile Humanoid Robot Using Gait-Induced Upper Body Motion

Satoshi Yagi,Yutaka Nakamura,Yoshihiro Nakata,Hiroshi Ishiguro

doi:10.1109/access.2021.3110160

Satoshi Yagi, Yutaka Nakamura + Show 2 more

Open Access

https://doi.org/10.1109/access.2021.3110160

Copy DOI

Abstract

Humans can express their emotions with not only facial expressions or gestures but also whole-body motion, even while walking, which are essential for our interpersonal relationships and our interaction with others. Communication with people is also considered an important task for robots, however emotional expressions by wheeled mobile humanoid robots when moving has not been well studied. In this paper, we implemented emotional human-like gait-induced upper body motion in a mobile android ibuki . We hypothesize that the gait-induced upper body motion with vertical oscillation enhances the human perception of a mobile robot’s emotional expressions. ibuki is a mobile robot, which has a vertical oscillation mechanism, which enables the robot to move its body with a human gait-induced upper body motion. We ran two experiments in which participants watched videos of ibuki moving in a room expressing different emotions - anger, happiness, and sadness–, before answering how they perceived the emotion and their respective confidence level in their answer. Our results show that for motions with vertical oscillation, recognition rates were: 56.0 % for anger, 77.7 % for happiness, and 97.0 % for sadness. We also found that the recognition rate and confidence level of motions expressing happiness with vertical oscillation were higher. Our results play an important role in opening up avenues for more natural ways of interaction between humans and robots. For example, by approaching humans closer while expressing emotions, a robot can naturally provide an opportunity to get started conversation with them.

Highlights

Humans express their intentions and emotions with facial expressions and gestures [1], even while walking with various gaits
To realize an android that can be such a partner to humans in society, we have developed a wheeled mobile android, ibuki [21], who is equipped with a mechanism that replicates a human-like upper body motion, which is induced by gait, while moving
2) We found that the emotional expression of happiness using the vertical-oscillation mechanism (VOM) was well perceived by humans and better than without vertical oscillation conditions

Summary

Introduction

Humans express their intentions and emotions with facial expressions and gestures [1], even while walking with various gaits (a person’s manner of walking). These emotional expressions are thought to contribute significantly to building interpersonal relationships and our interactions with others [2]. The associate editor coordinating the review of this manuscript and approving it for publication was Tao Liu. intentions expressed through human gait. Human gaits are emotionally expressive, and people may walk in various ways depending on their emotions. People can perceive the emotions from others through their gait. When you see your friend walking with a perceived happy gait, you might ask, ‘‘Did something good happen?’’

Objectives

Methods

Findings

Discussion

Conclusion