Validating Eye Tracking as an Objective Assessment Tool in Simulation

Abstract

BackgroundStandardized, objective measures of performance in a simulated experience are lacking. As eye tracking glasses (ETG) provide video, audio, and data capture of a simulation event and quantitative data of participant actions, this technology is well suited for assessment. Therefore, this study sought to begin validating ETG as an adjunct, objective performance assessment tool in simulation. MethodThis was a prospective, validation study with a two-group, convenience sample of novice and expert nurses who participated in a heart failure (HF) simulation scenario to validate ETG using a known-groups approach. A HF scenario designed to elicit seven basic nursing tasks was followed by a knowledge test and demographic questionnaire. ResultsThe groups were equivalent in basic HF knowledge as related to the care of a dyspneic patient. Of the seven tasks, all novices completed only one, while in the expert group, all participants completed four of the seven. Significance was found between groups for time to task in five of seven tasks and eye fixation times in key areas. ConclusionsThis pilot study begins the validation process of ETG technology as an objective assessment method as significant differences were elicited between known groups. ETG technology also provides meaningful data and visual images that can be used to inform nursing education in simulation. Additional research is needed to further establish the validity and reliability of ETG technology as an assessment tool in clinical simulation.