Mixed-method usability investigation of ARROWS: augmented reality for roadway work zone safety

Abstract

This article explores the usability and user experience challenges of ARROWS, a novel augmented reality (AR) and wearable technology (WT) safety system for roadway work zones, an area with limited existing usability research. We utilized a mixed-method approach with two complementary experiments in indoor and outdoor settings, using the Wizard of Oz methodology and a high-fidelity prototype. We focused on identifying usability challenges, factors contributing to user experience and the distinct needs of highway workers, documenting results using the system usability scale (SUS), the rating scale mental effort (RSME) and a trust score. Participants rated the usability of ARROWS above average in both settings, while making a reasonable level of mental effort. The findings also indicate a significant correlation between perceived trust and usability, highlighting the importance of trust in user experience.