Musically Inspired Computer Interfaces: Reaction Time and Memory Enhancements in Visuo-Spatial Timelines (ViST) for Graphic User Interfaces

Abstract

A principal component of simulation-based training is the collaboration of distributed instructor teams. The cognitive workload of instructors during complex scenarios rapidly increases to levels that result in impaired performance. Empirical research on the investigation of cognitive performance and optimization for timeline GUI supported Human Computer Interaction (HCI) is limited. As part of the research and development of a specialized Graphic User Interface (GUI) for aviation instructors, we evaluated the differences between multi-timeline displays in a traditional, alphanumeric format and an alternative, visuo-spatial format. The current study investigated user cognitive efficiency (i.e., reactions times, memory performance) when interacting with traditional alphanumeric Timelines (AnT) and Visuo-Spatial Timelines (ViST). Stimuli complexity was controlled for density and set size. MANOVAs and ANOVAs revealed significant differences in favor of ViST conditions. For ViST users average reaction times decreased by 43.34% and 51.33% (3.78 s; 2.31 s) for last event and simultaneous events detection, respectively, and, cued recall performance increased on average by 22.5%. Inspired by musical notation, the alternative timeline design of ViST was designed to support human processing characteristics. Our findings indicate that individual users demonstrate enhanced performance compared to traditional, vertically oriented timelines. The findings presented have supported the Graphic Embedded Timeline (G.E.T.) Tools, a GUI module in use by the U.S. military. The ViST performance enhancements provoke the reevaluation of GUIs designed with list formats, such as drop-down menus, and emphasize research and design of visuo-spatial formats.