Real-time gaze-tracking performance under synchronous and asynchronous auditory feedback conditions

Abstract

Visual attention and manual coordination were tested in pianists and other instrumentalists tasked with reading baroque music. Musicians were assessed in their ability to perform a single melodic line relative to a two-clef, three voice score with bimanual coordination (an extension from past research). In this study, musicians were asked to read and perform music under three auditory feedback conditions: synchronous, delayed (one-beat behind), and prelayed (one-beat ahead). Real-time gaze-tracking analysis was conducted, in addition to measures of performance, under each auditory condition. Results from these analyses indicated several trends. Gaze-tracking measures were taken from visual fixations and regressions during performance. These measures indicated that musicians had more difficulty in the asynchronous auditory feedback conditions relative to the synchronous condition. Particularly the prelay auditory feedback condition tended to cause an increase in the number of visual fixations per measure and required more effortful gaze. This effect was found to be consistent across different instrumental performances. In addition, indications of cognitive effort increased in the bimanual conditions. These results indicate the challenge musicians face when reading music in conditions of higher cognitive and manual load.