Effects of Picture Labeling on Science Text Processing and Learning: Evidence From Eye Movements

Abstract

AbstractThis study investigated the effects of reading a science text illustrated by either a labeled or unlabeled picture. Both the online process of reading the text and the offline conceptual learning from the text were examined. Eye‐tracking methodology was used to trace text and picture processing through indexes of first‐ and second‐pass reading or inspection. Fifty‐six sixth graders were randomly assigned to one of three reading conditions (text with a labeled illustration, text with an unlabeled illustration, or text only) in a pretest, immediate posttest, and delayed posttest design. Results showed no differences for factual knowledge as a function of reading condition. However, for the transfer of knowledge at both posttests, readers of the text with the labeled illustration outperformed readers in the other two conditions, who did not differentiate from each other. Eye‐fixation data showed that the labeled illustration promoted more integrative processing of the learning material, as revealed by the time spent refixating text segments while reinspecting the illustration. In addition, relations emerged between the indexes of integration of text and picture during online processing and the offline measures of factual knowledge and transfer of knowledge. Overall, in accordance with the theoretical assumptions of the multimedia principle, the study underlines the crucial role of integrative processing of words and graphics to sustain learning from illustrated text. Moreover, the study indicates that this integrative processing can be effectively supported by appropriate visual signaling.