Abstract
Can we really “read the mind in the eyes”? Moreover, can AI assist us in this task? This paper answers these two questions by introducing a machine learning system that predicts personality characteristics of individuals on the basis of their face. It does so by tracking the emotional response of the individual’s face through facial emotion recognition (FER) while watching a series of 15 short videos of different genres. To calibrate the system, we invited 85 people to watch the videos, while their emotional responses were analyzed through their facial expression. At the same time, these individuals also took four well-validated surveys of personality characteristics and moral values: the revised NEO FFI personality inventory, the Haidt moral foundations test, the Schwartz personal value system, and the domain-specific risk-taking scale (DOSPERT). We found that personality characteristics and moral values of an individual can be predicted through their emotional response to the videos as shown in their face, with an accuracy of up to 86% using gradient-boosted trees. We also found that different personality characteristics are better predicted by different videos, in other words, there is no single video that will provide accurate predictions for all personality characteristics, but it is the response to the mix of different videos that allows for accurate prediction.
Highlights
A face is like the outside of a house, and most faces, like most houses, give us an idea of what we can expect to find inside. ~ Loretta YoungThe face is the mirror of the mind, and eyes without speaking confess the secrets of the heart. ~ St
We present our results, demonstrating through correlations, regression, and machine learning that the emotional response in the face of the viewer, captured through face emotion recognition, will predict the personality and moral values of the viewer
We extend this work to measure the degree of enjoyment of the viewer, but the personality characteristics and moral values of the viewer—motivated by the insight that facial expressions will mirror moral values—combining face emotion recognition with ground truth obtained directly from surveys taken by the individual
Summary
A face is like the outside of a house, and most faces, like most houses, give us an idea of what we can expect to find inside. ~ Loretta Young. Just like the facade of a house might be misleading about what is inside the house, the mind behind the face might hide its true feelings. Humans are not good at reading emotions in other’s faces. Future Internet 2022, 14, 5 parts of the face, and comparing them directly, for instance on the basis of the facial action coding system FACS [4], facial emotion recognition has made huge progress over the last 10 years thanks to advances in AI and deep learning [5,6,7]. We present our results, demonstrating through correlations, regression, and machine learning that the emotional response in the face of the viewer, captured through face emotion recognition, will predict the personality and moral values of the viewer. We conclude the paper with a discussion of the results, limitations, and future work
Sign-in/Register to view highlights & summary Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
