Emotion Recognition from Human Behaviors Using Attention Model

Abstract

Human behaviors and the emotional states that they convey have been studied by psychologist and sociologists. The tracking of behaviors and emotions is becoming more pervasive with the advent of the Internet of Things (IoT), where small and always connected sensors can continuously capture information about human gestures, movements and postures. The captured information about readable behaviors conveys signicant information that can be represented as time series. Few studies in emotion recognition and affective computing have explored the connection between the time series sensors data and the emotional behavior they conveys. In this paper, an innovative approach is proposed to study the emotions and behaviors connected to the sensors time series data. A deep learning attention-based bidirectional LSTM is introduced to represent the correlations between data and emotions. The attention-based mechanism is then used to focus on the most significant information. The advantage of this model is that it can represent various human emotions by exploiting the data captured by sensors. The experimental results show that the proposed deep learning method outperforms shallow models and achieves a high degree of accuracy for modelling human behaviors and emotions.