Abstract
Interpersonal communication benefits greatly from the emotional information encoded by facial expression, body language, and tone of voice. However, these cues are often lost when sending text-based instant messages. This article describes a novel approach utilizing gestural and brain–computer interface (BCI) input to replace the missing emotional cues, with the aim of augmenting the instant messaging process. A set of exploratory studies were conducted using a commercially available BCI headset. An initial study validated the emotional data automatically captured by the device. Subsequently, an instant messaging application was developed, which detected emotions and facial gestures that are presented to the user's chat partner via progress bars and an avatar. Findings from an evaluation revealed that the novel approach facilitates communication containing a greater percentage of affective terms compared with traditional, text-based instant messaging environments. Strong levels of confidence were expressed when using the system to both convey and infer affective states, contributing to a rich subjective user experience.
Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callMore From: International Journal of Human–Computer Interaction
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
