Cognitive and behavioral markers for human detection error in AI-assisted bridge inspection

Abstract

Integrating Artificial Intelligence (AI) and drone technology into bridge inspections offers numerous advantages, including increased efficiency and enhanced safety. However, it is essential to recognize that this integration changes the cognitive ergonomics of the inspection task. Gaining a deeper understanding of how humans process information and behave when collaborating with drones and AI systems is necessary for designing and implementing effective AI-assisted inspection drones. To further understand human-drone-AI intricate dynamics, an experiment was conducted in which participants’ biometric and behavioral data were collected during a simulated drone-enabled bridge inspection under two conditions: with an 80% accurate AI assistance and with no AI assistance. Results indicate that cognitive and behavioral factors, including vigilance, cognitive processing intensity, gaze patterns, and visual scanning efficiency can influence inspectors' performance respectively in either condition. This highlights the importance of designing inspection protocols, drones and AI systems based on a comprehensive understanding of the cognitive processes required in each condition to prevent cognitive overload and minimize errors. We also remark on the visual scanning and gaze patterns associated with a higher chance of missing critical information in each condition, insights that inspectors can use to enhance their inspection performance.