Abstract

Recent technological advancements in the Internet and Social media usage have resulted in the evolution of faster and efficient platforms of communication. These platforms include visual, textual and speech mediums and have brought a unique social phenomenon called Internet memes. Internet memes are in the form of images with witty, catchy, or sarcastic text descriptions. In this paper, we present a multi-modal sentiment analysis system using deep neural networks combining Computer Vision and Natural Language Processing. Our aim is different than the normal sentiment analysis goal of predicting whether a text expresses positive or negative sentiment; instead, we aim to classify the Internet meme as a positive, negative, or neutral, identify the type of humor expressed and quantify the extent to which a particular effect is being expressed. Our system has been developed using CNN and LSTM and outperformed the baseline score.

Highlights

  • According to Wikipedia article on Internet Memes, “A meme is an idea, behavior, or style that spreads from person to person within a culture often with the aim of conveying a particular phenomenon, theme, or meaning represented by the meme”.Meme is about the humorous picture, the Internet culture, or the sentiment that passes along, and about the richness and distinctiveness of its language: it is often greatly structured with unusual written style

  • We model each task in Memotion Analysis as a multi-class classification problem where given an Internet meme and text description, the model outputs probabilities of it belonging to output classes

  • The Multimodal Neural Network (MNN) systems performed very well on the noisy and imbalanced dataset and failed in some cases such as identifying sarcasm, extracting the emotion, and identifying visual cue in the Internet memes

Read more

Summary

Introduction

According to Wikipedia article on Internet Memes, “A meme is an idea, behavior, or style that spreads from person to person within a culture often with the aim of conveying a particular phenomenon, theme, or meaning represented by the meme”. Meme is about the humorous picture, the Internet culture, or the sentiment that passes along, and about the richness and distinctiveness of its language: it is often greatly structured with unusual written style. Internet memes come in almost every form of media, with modish formats continuously expanding. They work as a medium for humor to be shared, using cultural themes. They can be manipulated to further political ideals, company promotions, and social media marketing

Objectives
Results
Conclusion

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.