Studying the expertise reversal of the multimedia signaling effect at a process level: evidence from eye tracking

Abstract

The purpose of this study was to shed light on the cognitive processes underlying the expertise reversal effect related to multimedia signaling. Multimedia signals highlight correspondences between text and pictures, which is supposed to support text-picture integration and thus learning from multimedia. Previous research suggests that learners’ prior knowledge moderates the multimedia signaling effect in that they only aid learners with low prior knowledge (LPK). We conducted an eye tracking study with students in secondary education who learned with a digital textbook in one of the two versions: (a) a basic version with mostly text signals only (e.g., bold face), or (b) an extended version with additional multimedia signals that aimed at supporting text-picture integration (e.g., color coding of corresponding text and picture elements). In addition to learning outcomes, we assessed students’ cognitive load and gaze behavior as process measures. Results revealed that only LPK learners were supported in learning whereas HPK learners were not affected by multimedia signals (partial expertise reversal). A moderated mediation analysis revealed that multimedia signals affected gaze behavior of LPK students in that they looked earlier at pictures. For high prior knowledge students multimedia signals lead to a higher subjective germane cognitive load. Thus, multimedia signals affected processing of materials. However, the process measures did not explain the expertise reversal of the signaling effect regarding learning outcome.