Refinement of word embeddings with sentiment content using multi-output neural networks

Abstract

Word embeddings have been successfully used in diverse tasks of Natural Language Processing, including sentiment analysis and emotion classification, even though these embeddings do not contain any emotional or sentimental information. This article proposes a method to refine pre-trained embeddings with emotional and sentimental content. To this end, a Multi-output Neural Network is proposed to learn emotions and sentiments simultaneously. The resulting embeddings are tested in emotion classification and sentiment analysis tasks, showing an improvement compared with the pre-trained vectors and other proposes in the state-of-the-art for fine-grained emotion classification.