Unpacking cognitive skills engaged in web-search: how can log files, eye movements, and cued-retrospective reports help? An in-depth qualitative case study

Abstract

Searching the internet with a specific purpose has become an important activity. Educational research informs that a better understanding of the cognitive skills involved in this activity is needed, but it is not clear which research techniques can be used for this purpose. One student performed a web-search task and was registered by three different techniques: log files, eye movements, and cued-retrospective reports. With a qualitative analysis, we attempt to provide a two-fold contribution: 1) a thorough analysis about the information retrieved from the three techniques separately; 2) developing a methodology for integrating the information captured from the three techniques. Results showed that log files and eye movements gave insight into cognitive outcomes of skills, and cued-retrospective delivered self-explanations of cognitive and regulation activities. This integration provided an overall and comprehensive picture of the cognitive skills performed and allowed building a synergism among the information captured from each technique.