Exploring the use of structured musical stimuli to communicate simple diagrams: the role of context

Abstract

The results from previous experiments using structured musical stimuli to communicate coordinate locations within a graphical grid, navigation of an auditory cursor and simple shapes are used as a basis for further exploratory research to communicate diagrams. An experimental framework program (called AudioGraph) provided a platform for investigating musical information processing for blind users. Under this platform, simple arrangements of shapes (forming diagrams) were communicated to users using structured musical stimuli. Meaningfully arranged graphical shapes (at least for the visual sense) were communicated in the absence, and in the presence of a particular perceptual context or different perceptual contexts. The results indicated that perceptual context played an important role in the interpretation of the structured musical stimuli that communicated simple diagrams. The paper concludes with a discussion on the implications of the results, the role of context and the use of structured musical stimuli to communicate graphical information to visually impaired users.