Cognitive untunneling multi-view system for teleoperators of heavy machines based on visual momentum and saliency

Abstract

Abstract Work efficiency in unmanned construction is about 40% less than that in boarding operation owing to a lack of visual information. Thus, previous studies have developed methods to display rich visual information by adding multiple views. However, providing excess visual information can cause ‘cognitive tunneling’ in operators, which makes operators subconsciously attend to a limited view and ignore others. Therefore, we developed a cognitive untunneling multi-view system that enables operators to voluntarily select appropriate views depending on situations. The experimental results using a scale model indicate that the proposed view system could decrease work time, stoppage time and help operators switch views frequently and release their attention from a cab view compared with a conventional view system. These results suggest that the proposed view system can increase work efficiency and help operators avoid cognitive tunneling. In the future, we will develop a system to identify situations and change views automatically.