ViDAQ: A Framework for Monitoring Human Machine Interfaces

Abstract

A novel case for visual data acquisition (ViDAQ) as an non-intrusive, scalable and reliable means of monitoring Human Machine Interfaces (HMIs) is envisioned. ViDAQ is a step towards achieving real-time cross-validation of human operator commands with respect to HMI states in large scale industrial control room environments. HMIs are integral in allowing human operators to safely command and monitor various critical processes, such as in nuclear power plants, commercial aviation, public transit vehicles, etc. However, HMI related perceptual dynamics presents a challenge to the designed safeguards against human-in-the-loop errors, which, ultimately is dependent on operator situational awareness. We envision, an expert supervisory framework for HMIs (EYE-on-HMI) utilizing ViDAQ, that is scalable and extensible to various industrial applications with prospective safety improvement to next generation commercial automation especially those with driverless operational modes. To this end, we present the design, implementation and evaluation of the ViDAQ to visually read rotary multi-dial meters herein.