A sonification system for process monitoring as secondary task

Abstract

This paper presents a novel process monitoring system to explore and evaluate the potential of real-time sonifications (i.e. non-verbal auditory representations) for supporting awareness of process states and for detecting and resolving critical process situations. Different from established auditory alarms and warnings, our sonifications convey analogue, i.e. continuous information in form of a process-data-driven soundscape that can be easily blended out in favor of a primary task, yet which is designed to attract the user's attention even before things become critical. We argue that a subsymbolic, implicit and rich display connects better to the human sense to establish auditory categories and develop sensitivity to changes within and in between. In consequence, users may profit from prerational automatic information processing mechanisms so that the cognitive resources remain free for another ‘primary task’. Our system allows to generate a prototypical process in real-time, and we present it by two novel sonification approaches. It encompasses software components to log user performance on the monitoring task, and to engage the user in a primary task. We discuss our sonification designs and first experiences with test users, and outlook on studies that are planned to be conducted using our system.