Abstract

Emojis are ideograms that are becoming ubiquitous in digital communication. However, no research has yet investigated how humans process semantic and pragmatic content of emojis in real time. We investigated neural responses to irony-producing emojis, the question being whether emoji-generated irony is processed similarly to word-generated irony. Previous ERP studies have routinely found P600 effects to verbal irony. Our research sought to identify whether the same neural responses could also be elicited by emoji-induced irony. In three experiments, participants read sentences that ended in either a congruent, incongruent, or ironic (wink) emoji. Results across all three experiments demonstrated clear P600 effects, the amplitudes of which were correlated with participants’ tendency to treat the emoji as a marker of irony, as indicated by behavioral comprehension question responses. These ironic wink emojis also elicited a strong P200 effect, also found in studies of verbal irony processing. Moreover, unexpected emojis (both mismatch and ironic emoji) also elicited late frontal positivities, which have been implicated processing unpredicted words in context. These results are the first to identify how linguistically-relevant ideograms are processed in real-time at the neural level, and specifically draw parallels between the processing of word- and emoji-induced irony.

Highlights

  • Emojis are graphical symbols inserted into Computer Mediated Communication that have recently exploded in use and popularity

  • The use of emojis in conjunction with “traditional” written language can be seen as a type of multimodal interaction that combines more than one modality systematically into a single communicative utterance (e.g., [4, 5, 6, 7])

  • We focus on the processing of emojis used to signal irony/sarcasm and ask 1) how emoji-related irony is processed at the neural level using event-related brain potentials (ERPs), and 2) whether emoji-induced irony elicits brain responses that are qualitatively similar to wordinduced irony seen in prior work

Read more

Summary

Introduction

Emojis are graphical symbols inserted into Computer Mediated Communication that have recently exploded in use and popularity.

Results
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call