OpenMATB: A Multi-Attribute Task Battery promoting task customization, software extensibility and experiment replicability

Abstract

OpenMATB is an open-source variant of the Multi-Attribute Task Battery (MATB) and is available under a free software license. MATB consists of a set of tasks representative of those performed in aircraft piloting. It is used, in particular, to study the effect of automation on decision-making, mental workload, and vigilance. Since the publication of MATB 20 years ago, the subject of automation has grown considerably in importance. After introducing the task battery, this article highlights three main requirements for an up-to-date implementation of MATB. First, there is a need for task customization, to make it possible to change the values, appearance or integrated components (such as rating scales) of the tasks. Second, researchers need software extensibility to enable them to integrate specific features, such as synchronization with psychophysiological devices. Third, to achieve experiment replicability, it is necessary that the source code and the scenario files are easily available and auditable. In the present paper, we explain how these aspects are implemented in OpenMATB by presenting the software architecture and features, while placing special emphasis on the crucial role of the plugin system and the simplicity of the format used in the script files. Finally, we present a number of general trends for the future study of automation in human factors research and ergonomics.