Human-AI Teamwork Interface Design Using Patterns of Interactions

Abstract

Increasingly capable Artificial Intelligence (AI) agents are reaching new performance levels and humans need to work effectively with them in a variety of collaborative team structures. Of particular interest is “shared control collaboration”, where actions taken by the team depend on the blended combination of inputs from all team entities. We conducted an experiment where participants played a game and maneuvered a spacecraft while working in concert with an AI agent and simultaneously performing a secondary task. The experiment results (i) show different patterns of interactions across user interface designs, agent capabilities, and participants’ game experience, (ii) underscore the importance of providing information about the shared control collaborative task to humans who are working with a less-capable agent, and (iii) imply the potential of real-time communication about agent’s state to achieve better teamwork. Our findings are expected to be transferable to other shared control collaboration settings, including AI-enabled autopilots.