The Relationship between Human and Smart TVs Based on Emotion Recognition in HCI

Abstract

This study focuses on the relation between humans and smart TVs with emotion recognition function. The study hypothesizes that the emotion- based user interface is most effective in human interaction in comparison to other user-centered devices with passive user interface. Forty participants were given three types of user interfaces such as the remote controller, gesture recognition system, voice recognition system, and emotional recognition system to be used for watching the smart TV. They were given interesting contents and sad contents to choose from within a specific time limit. We use the Fraunhofer IIS SHORETM demo software to automatically detect the facial expressions of the participants they exhibited in response to the contents. A study on the preference of contents according to the individual emotional responses of the users was done simultaneously. Additionally, it figured out the relation between four types of emotion as emotion recognition UI on SMART TV screen, the contents, and the study concentrated on the satisfaction and usability of four different user interfaces. As a result of studying the relations of emotions and content preferences from this research, it is recognized that comedy programs are much more preferred based on the degree of happy emotion detected, and that men appear to have higher preference than women. When they were in sad emotion, the valid result value was not achieved though, which shows slight preference for exciting contents. It is noted that women have a little higher preference than men. These results were similar to the standard mood based management of Zilinman’s theory. Another result is that out of the four user interfaces, the emotion recognition-based user interface which selects the contents on the screens of the smart TV showed a higher satisfaction than other passive user interfaces.