Using eye-tracking technology to investigate the redundant effect of multimedia web pages on viewers’ cognitive processes

Abstract

This study utilized eye-tracking technology to determine the impact of redundant onscreen text information on viewers’ cognitive processes with respect to multimedia information. Sixteen college students participated in the study and their eye-movement data and self-reported cognitive load ratings were collected as they viewed three web pages into which different forms of verbal explanations of thunderstorm systems were integrated. A repeated measure design was utilized to support the research purposes. The eye-tracking data showed that viewers relied on text information as the main information resource for determining meaning. Students’ cognitive load reports reflected a redundant effect from the on screen text on their cognitive load level when both onscreen and narrative verbal messages were presented. However, eye-movement data revealed that viewers spent less time on the onscreen text when there was a narrative message presenting the same information. When the pictorial information was accompanied by both onscreen and narrative formats of verbal information, viewers seemed to be able to filter out redundant information. Additionally, replacing onscreen text with a voice-over seemed to globally orient viewers’ eye fixations toward the illustration. Discussions on results and suggestions for future studies are provided in this paper.