Eye Movement Modeling Examples Research Articles

Deeper reading of poetry and prose

The main result of this effectiveness study is that a reading program with a focus on students’ poetry reading processes, based on observational learning via eye movement modeling examples, can improve students’ reading comprehension for different text types. In a pretest-posttest design with an experimental group (ten classes) and a control group (five classes), students’ self-efficacy regarding their own reading process and their reading comprehension were measured. Over a six-week period, teachers of Dutch and their students worked with the six experimental lessons, instead of the regular reading program: students observed and evaluated contrasting peer reading processes, reflected on differences with their own reading process, and then they practiced aspects of a deep reading process. The program resulted in significant progress in the reading comprehension of “expository texts” (ES = .66), “short stories” (ES = .66), and especially “poetry” (ES = .81). Furthermore, the self-efficacy test results show that students in the experimental condition experienced significantly more learning effect after the intervention period than those in the control group. Moreover, based on the learning reports, evaluation tasks and interviews, it appears that the participants in the innovative program have become aware of their reading and how they improved their performance.

EFFECTS OF LEARNER-CENTERED INTERVENTIONS IN SCIENCE LEARNING: COMPARING EYE MOVEMENT IN EYE MOVEMENT MODELING EXAMPLES AND PROMPTING

An integrated understanding of illustrations and texts is crucial for students to comprehend science teaching learning materials. Intervention methods can be employed to facilitate this integrated understanding. This study examined the effects of Eye Movement Modeling Examples (EMME) and Prompting interventions on the learning of illustrated scientific texts among primary school students. Furthermore, the study compared the reading strategies and learning comprehension of fifth-grade students who utilized EMME, an approach that facilitates learning through observational methods, with those who used Prompting, a method that directly guides learning through linguistic information. The study analysis revealed that EMME had a significantly greater effect on integrated reading strategies and learning comprehension compared with Prompting. Specifically, the EMME group exhibited an integrated reading strategy that involved relating the illustrations and texts, whereas the Prompting group and the control group did not demonstrate the same strategy. In addition, the post-test results indicated that the EMME group achieved higher average scores in verbal and pictorial factors compared with the other two groups. Keywords: eye movement modeling examples, learner-oriented intervention, science education, science learning, South Korea

시선 이동 모델링 예제가 초등학생들의 그림자 개념 형성에 미치는 효과

Objectives This study aimed to examine the effects of eye movement modeling examples (EMME) on elementary school students' formation of the concept of shadows. Methods An EMME for concept learning in shadow formation was developed and applied to third-grade elementary school students. Post-tests were conducted immediately after the application, and delayed tests were conducted three weeks later. To compare the effects of EMME application, a control group was selected and underwent video-based learning without the presentation of EMME. They also underwent the same tests as the experimental group. Results In the post-test, there was a significant difference in the total fixation duration and fixation count for the light source in Task 1. However, in Tasks 2 and 3, although there was a difference in the average total fixation duration and fixation count for the light source, it was not statistically significant. Additionally, there was no difference in concept understanding between the two groups. In the delayed test, differences were found in the total fixation duration and fixation count for the light source in all three tasks. Furthermore, there was no statistically significant difference between the two groups in conceptual understanding. Conclusions Although EMME did not have an impact on the formation of the concept of shadows, it can be concluded that it is effective in inducing long-term gaze attention to the light source.

Medical imaging training with eye movement modeling examples: A randomized controlled study

Purpose To determine whether ultrasound training in which the expert’s eye movements are superimposed to the underlying ultrasound video (eye movement modeling examples; EMMEs) leads to better learner outcomes than traditional eye movement-free instructions. Materials and methods 106 undergraduate medical students were randomized in two groups; 51 students in the EMME group watched 5-min ultrasound examination videos combined with the eye movements of an expert performing the task. The identical videos without the eye movements were shown to 55 students in the control group. Performance and behavioral parameters were compared prepost interventional using ANOVAs. Additionally, cognitive load, and prior knowledge in anatomy were surveyed. Results After training, the EMME group identified more sonoanatomical structures correctly, and completed the tasks faster than the control group. This effect was partly mediated by a reduction of extraneous cognitive load. Participants with greater prior anatomical knowledge benefited the most from the EMME training. Conclusion Displaying experts’ eye movements in medical imaging training appears to be an effective way to foster medical interpretation skills of undergraduate medical students. One underlying mechanism might be that practicing with eye movements reduces cognitive load and helps learners activate their prior knowledge.

Using synchronized eye movements to assess attentional engagement.

The gradual emergence of online education in China in recent years requires new means of real-time monitoring and timely feedback to students. This research examines the effectiveness of synchronized eye movement assessment of attention engagement through two experiments. The first experiment used 24 university students in school as participants and made them watch the same video in high and low attentional engagement states (serial subtraction task) to compare the Inter-Subject Correlation (ISC) of participants' eye movements in different conditions. The results showed that the ISC of eye movements was significantly higher for participants in a high attentional engagement state than for participants in a low attentional engagement state. The second experiment had 26 university students in school as participants, as part of which they were made to watch video materials under the condition of having eye movement modeling examples. The results showed that the ISC of eye movements was significantly lower for participants in the group with eye movement modeling examples than those without eye movement modeling examples. However, overall test scores were significantly higher in the former than the latter. The first experiment showed that the eye movement trajectories of participants with high attentional engagement were more consistent than of those with low attentional engagement. Therefore, the ISC of participants' eye movements could be used as an objective indicator to assess and predict students' attentional conditions during online education. The second experiment showed that the eye movement modeling examples interfered with the participants' attention distribution to some extent; nevertheless, they positively affected the improvement in teaching effectiveness. Overall, the studies showed that the Inter-Subject Correlation is reliable to assess attentional engagement status in domestic online education.

Reducing cognitive load during video lectures in physiology with eye movement modeling and pauses: a randomized controlled study.

Lectures constitute a basic component of physiology instruction in scientific and healthcare curricula. Technological progress has allowed a switch from face to face to video lectures, yet there is no evidence of video efficacy in physiology. Because videos increase the cognitive load during a learning task, identifying tools that decrease students' cognitive load during video lectures is critical. Segmenting videos with pauses and inducing joint attention with eye movement modeling examples (EMME) could reduce the cognitive load and improve second-year medical students' learning in physiology video lectures. Second-year medical students were randomized into four groups [EMME + pauses (EMME+P), EMME without pause`s (EMME-NoP), pauses only (NoEMME+P), and no EMME and no pause (NoEMME-NoP)], took pretest quizzes, watched a renal physiology video lecture, and answered a cognitive load questionnaire and posttest quizzes on the Moodle learning management system. Student prior knowledge was assessed by a pretest, and learning gains were assessed by the difference between posttest and pretest scores. One hundred ninety-five students completed the experiment. Pauses improved learning gains (P < 0.01) but not EMME (P = 0.11). Student prior knowledge has several interactions with other variables: low-prior knowledge students obtained better learning gains (P < 0.001) and high-prior knowledge students had lower learning gains with EMME (P < 0.05). Our study shows the potential role of tools designed to reduce students' cognitive load during a renal physiology video lecture and the critical need for empirical validation of pedagogical solutions that are adapted to the specificities of physiology lectures.

Eye Movement Modeling Examples guide viewer eye movements but do not improve learning

Recent research has tested whether Eye Movement Modeling Examples (EMMEs) can effectively cue attention and improve learning. However, the effects of EMMEs are variable, and the degree to which viewers follow these cues remains unclear. In the current paper, we compared screen-captured instructional videos that included an EMME in the form of a transparent circular overlay depicting the instructor's gaze location with identical videos that lacked this cue. We observed that EMMEs drove viewer saccades to cued locations and resulted in shorter distances between viewer gaze and the EMME, but learning performance and video preference were unaffected by the presence of an EMME. We argue that EMMEs can effectively guide attention, but the range of circumstances under which they improve learning may be limited.

Integrating digital documents by means of concept maps: testing an intervention program with eye-movements modelling examples

When using the Internet to learn about a curricular topic students face the challenge of not only understanding each single document, but also of integrating the ideas in a combined representation. Several intervention studies have tested instructional methods, such as building concept maps, aimed at teaching integration of multiple documents to Secondary education and older students. However, building a concept map may be demanding for learners and requires competencies to build maps in an appropriate way. In the current study we explore the extent to which such integration processes relying a concept map mapping instruction can be efficiently taught to 6th grade students. Specifically, we tested a program which included eye-movement modeling examples (EMMEs) and self-explanation prompts on comprehension and concept mapping in a natural educational setting. An active control group received a similar instruction without EMMEs. Students were randomly assigned to the intervention (n = 34) or active control (n = 32) groups, and participated in 1-h sessions during four consecutive days. Results indicated that EMME group learnt better than the control group the phases to construct a concept map, as measured in a questionnaire. However, from pre to post test, the EMME group didn't improve comprehension as measured by open-ended reading comprehension questions or in a delayed summary. We conclude that EMMEs can be used to foster literacy strategy instruction of primary school students.

Do prior knowledge, model-observer similarity and social comparison influence the effectiveness of eye movement modeling examples for supporting multimedia learning?

We investigated in an experiment with 180 university students the joint role of prior knowledge, alleged model competence, and social comparison orientation regarding the effectiveness of Eye Movement Modeling Examples (EMME) for supporting multimedia learning. EMME consisted of short videos with gaze replays of an instructed model demonstrating effective multimedia processing strategies. Participants were either instructed that the model in the EMME-videos was a successful learner (competent model) or another participant (peer model). Participants in a control condition received no EMME. Furthermore, we activated domain-relevant prior knowledge in half of the participants before watching the EMME. Against our expectations, we found no influence of either prior knowledge activation or model-observer similarity. As expected, our results indicated that EMME fostered multimedia learning. This was also supported by findings from small-scale meta-analyses that were conducted with the focus on the effect of EMME for multimedia learning and potential moderators of the effect. Moreover, results showed first evidence that social comparison orientation interacts with (alleged) model competence regarding the effectiveness of EMME. Further research is needed to follow up on the influence of individual factors as well as social cues on the effectiveness of EMME.

Applying Eye Movement Modeling Examples to Guide Novices' Attention in the Comprehension of Process Models.

Process models are crucial artifacts in many domains, and hence, their proper comprehension is of importance. Process models mediate a plethora of aspects that are needed to be comprehended correctly. Novices especially face difficulties in the comprehension of process models, since the correct comprehension of such models requires process modeling expertise and visual observation capabilities to interpret these models correctly. Research from other domains demonstrated that the visual observation capabilities of experts can be conveyed to novices. In order to evaluate the latter in the context of process model comprehension, this paper presents the results from ongoing research, in which gaze data from experts are used as Eye Movement Modeling Examples (EMMEs) to convey visual observation capabilities to novices. Compared to prior results, the application of EMMEs improves process model comprehension significantly for novices. Novices achieved in some cases similar performances in process model comprehension to experts. The study’s insights highlight the positive effect of EMMEs on fostering the comprehension of process models.

How Experts Adapt Their Gaze Behavior When Modeling a Task to Novices.

Domain experts regularly teach novice students how to perform a task. This often requires them to adjust their behavior to the less knowledgeable audience and, hence, to behave in a more didactic manner. Eye movement modeling examples (EMMEs) are a contemporary educational tool for displaying experts’ (natural or didactic) problem‐solving behavior as well as their eye movements to learners. While research on expert‐novice communication mainly focused on experts’ changes in explicit, verbal communication behavior, it is as yet unclear whether and how exactly experts adjust their nonverbal behavior. This study first investigated whether and how experts change their eye movements and mouse clicks (that are displayed in EMMEs) when they perform a task naturally versus teach a task didactically. Programming experts and novices initially debugged short computer codes in a natural manner. We first characterized experts’ natural problem‐solving behavior by contrasting it with that of novices. Then, we explored the changes in experts’ behavior when being subsequently instructed to model their task solution didactically. Experts became more similar to novices on measures associated with experts’ automatized processes (i.e., shorter fixation durations, fewer transitions between code and output per click on the run button when behaving didactically). This adaptation might make it easier for novices to follow or imitate the expert behavior. In contrast, experts became less similar to novices for measures associated with more strategic behavior (i.e., code reading linearity, clicks on run button) when behaving didactically.

Guiding the learner's cognitive processing of a narrated animation

In this study, three experiments were conducted to explore whether adding eye movement modeling examples (EMME) to a short narrated animation could facilitate visual processing during multimedia learning and learning outcomes, and whether the effects of EMME depended on the pace of lesson or prior knowledge level of the learners. In Experiment 1, college students viewed a system-paced animation on synaptic transmission that either did or did not include EMME. The EMME group paid more attention to relevant elements and performed better on learning outcomes. In Experiment 2, EMME facilitated visual processing and learning outcomes with system-pacing but not learner-pacing. In Experiment 3, both low and high knowledge learners showed improved visual processing and learning outcomes with EMME. In conclusion, adding visual signaling (or cueing) in the form of EMME can guide visual processing and improve learning outcomes in multimedia learning with a short lesson.

Just follow my eyes: The influence of model-observer similarity on Eye Movement Modeling Examples

We investigated to what extent the effectiveness of Eye Movement Modeling Examples (EMME) is influenced by social cues such as model-observer similarity. In an eye tracking experiment with university students (N = 119), EMME were used to display multimedia-processing strategies as expressed in the eye movements of an instructed model. The model was either introduced as a successful learner (competent model), as another participant (peer model) or no EMME were presented (control group). Results indicated that only learners with lower domain knowledge benefitted from EMME, but only when model-observer similarity was experienced as high (i.e., when receiving EMME with a ‘peer’ model). Mediation analysis identified prolonged picture processing as potential explanation. Our results imply that weaker learners can benefit from EMME if they perceive the model as a ‘peer’ learner. This supports the assumption that social cues such as alleged model competence can influence the effectiveness of EMME.

Effectiveness of eye movement modeling examples in problem solving: The role of verbal ambiguity and prior knowledge

Eye movement modeling examples (EMME) are video modeling examples with the model's eye movements superimposed. Thus far, EMME on problem-solving tasks seem to be effective for guiding students' attention, but this does not translate into higher learning outcomes. We therefore investigated the role of ambiguity of the verbal explanation and prior knowledge in the effectiveness of EMME on geometry problems. In Experiment 1, 57 university students observed EMME or regular video modeling examples (ME) with ambiguous verbal explanations. Eye-tracking data revealed that –as in prior research with unambiguous explanations- EMME successfully guided students' attention but did not improve test performance, possibly due to students' high prior knowledge. Therefore, Experiment 2, was conducted with 108 secondary education students who had less prior knowledge, using a 2 (EMME/ME) x 2 (ambiguous/unambiguous explanations) between-subjects design. Verbal ambiguity did not affect learning, but students in the EMME conditions outperformed those in the ME conditions.

注意引导和认知加工：眼动榜样样例的教学作用

注意引导和认知加工：眼动榜样样例的教学作用

Effects of eye movement modeling examples on adaptive expertise in medical image diagnosis

Research indicates that expert performance is domain specific and hardly transfers to novel tasks or domains. However, due to technological changes in dynamic work settings, experts sometimes need to adapt and transfer their skills to new task affordances. The present mixed method study investigates whether eye movement modeling examples (EMME) can promote adaptive expertise in medical image diagnosis. Performance, eye tracking, and think-aloud protocol data were obtained from nine medical experts and fourteen medical students. Participants interpreted dynamic visualizations before (baseline) and after (retention, transfer) viewing an expert model's eye movements. Findings indicate that studying eye movement modeling examples had positive effects on performance, task-relevant fixations, and the use of cognitive and metacognitive comprehension strategies. Effects were stronger for the retention than for the transfer task. Medical experts benefitted more from the modeling examples than did medical students. Directions for future research and implications for related domains are discussed.

Using eye movements to model the sequence of text–picture processing for multimedia comprehension

AbstractThis study used eye movement modeling examples (EMME) to support students' integrative processing of verbal and graphical information during the reading of an illustrated text. EMME consists of a replay of eye movements of a model superimposed onto the materials that are processed for accomplishing the task. Specifically, the study investigated the effects of modeling the temporal sequence of text and picture processing as shown in various replays of a model's gazes. Eighty‐four 7th graders were randomly assigned to one of the four experimental conditions: text‐first processing sequence (text‐first EMME), picture‐first processing sequence (picture‐first EMME), picture‐last processing sequence (picture‐last EMME) and no‐EMME (control). Online and offline measures were used.Eye movement indices indicate that only readers in the picture‐first EMME condition spent significantly longer processing the picture and showed stronger integrative processing of verbal and graphical information than students in the no‐EMME condition. Moreover, readers in all EMME conditions outperformed those in the control condition for recall. However, for learning and transfer, only readers in the picture‐first EMME condition were significantly superior to readers of the control condition. Furthermore, both the frequency and duration of integrative processing of verbal and graphical information mediated the effect of condition on learning outcomes.

Eye tracking in Educational Science: Theoretical frameworks and research agendas

Eye tracking is increasingly being used in Educational Science and so has the interest of the eye tracking community grown in this topic. In this paper we briefly introduce the discipline of Educational Science and why it might be interesting to couple it with eye tracking research. We then introduce three major research areas in Educational Science that have already successfully used eye tracking: First, eye tracking has been used to improve the instructional design of computer-based learning and testing environments, often using hyper- or multimedia. Second, eye tracking has shed light on expertise and its development in visual domains, such as chess or medicine. Third, eye tracking has recently been also used to promote visual expertise by means of eye movement modeling examples. We outline the main educational theories for these research areas and indicate where further eye tracking research is needed to expand them.

Showing a model's eye movements in examples does not improve learning of problem-solving tasks

Eye movement modeling examples (EMME) are demonstrations of a computer-based task by a human model (e.g., a teacher), with the model's eye movements superimposed on the task to guide learners' attention. EMME have been shown to enhance learning of perceptual classification tasks; however, it is an open question whether EMME would also improve learning of procedural problem-solving tasks. We investigated this question in two experiments. In Experiment 1 (72 university students, Mage = 19.94), the effectiveness of EMME for learning simple geometry problems was addressed, in which the eye movements cued the underlying principle for calculating an angle. The only significant difference between the EMME and a no eye movement control condition was that participants in the EMME condition required less time for solving the transfer test problems. In Experiment 2 (68 university students, Mage = 21.12), we investigated the effectiveness of EMME for more complex geometry problems. Again, we found no significant effects on performance except for time spent on transfer test problems, although it was now in the opposite direction: participants who had studied EMME took longer to solve those items. These findings suggest that EMME may not be more effective than regular video examples for teaching procedural problem-solving skills.

Identification of effective visual problem solving strategies in a complex visual domain

Students in complex visual domains must acquire visual problem solving strategies that allow them to make fast decisions and come up with good solutions to real-time problems. In this study, 31 air traffic controllers at different levels of expertise (novice, intermediate, expert) were confronted with 9 problem situations depicted on a radar screen. Participants were asked to provide the optimal order of arrival of all depicted aircrafts. Eye-movements, time-on-task, perceived mental effort, and task performance were recorded. Eye-tracking data revealed that novices use inefficient means-end visual problem solving strategies in which they primarily focus on the destination of aircraft. Higher levels of expertise yield visual problem solving strategies characterized by more efficient retrieval of relevant information and more efficient scan paths. Furthermore, experts' solutions were more similar than intermediates' solutions and intermediates' solutions were more similar than novices' solutions. Performance measures showed that experts and intermediates reached better solutions than novices, and that experts were faster and invested less mental effort than intermediates and novices. These findings may help creating eye-movement modeling examples for the teaching of visual problem solving strategies in complex visual domains.