Situation Awareness Queries Research Articles

The impact of digital image configuration on submarine periscope operator workload, situation awareness, meta-awareness and performance

Submarine periscopes are moving from analog to digital, but there is a lack of empirical evidence regarding the relative advantages that different digital human–machine interface configurations might provide to the operator. We experimentally compared the effectiveness of two digital concepts for displaying and analysing periscope imagery during a simulated submarine mission. OPTIX modelled a traditional periscope by presenting a narrow (20° horizontal arc) rotating image of the horizon. OPTIMUS displayed the full 360° panoramic representation of the horizon and was augmented with digital analysis tools. OPTIMUS supported faster and more accurate performance by participants (N = 32) and lowered perceived workload, compared to when the same participants used OPTIX. However, time taken to respond to situation awareness queries and awareness of one’s own performance (meta-awareness) was poorer when using OPTIMUS. OPTIMUS holds an advantage in that it can improve performance whilst reducing workload, but the SA and meta-awareness decrements are potentially problematic.

Effect of Automating Procedural Work on Situation Awareness and Workload.

In future deep space exploration missions, crew will have to work more autonomously from Earth. Greater crew autonomy will increase dependence on automated systems. This study investigates the performance effects of different strategies to automate procedural work for space exploration operations. The following strategies are investigated for performing procedural work:• Manual Work uses no procedure automation and crew performs all actions.• Shared Work uses procedure automation to perform some actions within a procedure while crew performs other actions.• Supervised Work uses procedure automation to perform procedure actions while crew supervises the automation. Twenty-seven participants participated in a planetary habitat scenario-based simulation using electronic procedures with automatable actions to investigate the effect of these strategies on situation awareness (SA) and workload. This study used a modification of the Situation Presence Assessment Method to measure SA and the Bedford Workload Scale to measure subjective workload. Mean response times and accuracy for SA queries show no significant difference among the three strategies. Bedford Workload ratings compared across the three strategies indicate that participants rated their workload as highest in the Manual Work condition, followed by the Shared Work condition, and lowest in the Supervised Work condition. The study hypothesized that increased levels of automation would lead to lower subjective workload and decreased SA. Although no significant difference in SA was observed, subjective workload was lower in automation strategies. Based on subjective ratings, 93% of participants preferred some form of automation, with 56% preferring the Shared Work automation condition.

Comparison of SAGAT and SPAM for Seeking Effective Way to Evaluate Situation Awareness and Workload During Air Traffic Control Task

Evaluation of air traffic controller’s situation awareness (SA) is becoming important for air traffic management with the growth of air traffic. This study compared two SA evaluation methods: Situation Awareness Global Assessment Technique (SAGAT) and Situation Present Assessment Method (SPAM) to understand how these techniques affect controllers’ predictability in different traffic density settings. Twenty students undertook simple air traffic control simulations by using both techniques. We investigated how these techniques affect their workload with Subjective Workload Assessment Technique (SWAT) and NASA-TLX. SWAT scores showed that high traffic density increased participants’ workload, and extra workload was posed right after answering SA queries. NASA-TLX scores were larger when SAGAT was used than when SPAM was used throughout the simulation. We found that the workload with SAGAT interferes with main tasks more than that of SPAM. The results of query scores suggested that SPAM is more predictive to the assessment of the controller’s SA.

Using an Integrated Cognitive Architecture to Model the Effect of Environmental Complexity on Drivers’ Situation Awareness

The goal of this research is to computationally model and simulate drivers’ situation awareness (SA). In order to achieve this, we have developed a computational cognitive model in a cognitive architecture that can be connected to interact with a driving simulator, as means to infer quantitative predictions of drivers’ SA. We demonstrate the theory of modelling and predicting SA through the lens of human cognition utilizing the QN-ACTR (Queueing Network-Adaptive Control of Thought-Rational) framework as a foundation. We integrate a dynamic visual sampling model (SEEV) to create QN-ACTR-SA in order to allow the model to simulate realistic attention allocation patterns of human drivers. A driver model is also incorporated within QN-ACTR-SA architecture that can simulate human driving behavior by interacting with a driving simulator with the help of virtual modalities such as motor, visual and memory functions. A preliminary validation study is conducted to determine whether SA results of the model correspond to empirical data. The model is probed with SA queries similar to how a Situation Awareness Global Assessment Technique (SAGAT) is conducted on human participants. A comparative assessment demonstrates the model’s ability to simulate drivers’ SA in both easy (with fewer traffic vehicles and signboards) and complex (with more traffic vehicles and signboards) driving conditions.

The Impact of Uncertain Contact Location on Situation Awareness and Performance in Simulated Submarine Track Management.

The aim of these studies was to examine the extent to which uncertainty in contact location in submarine track management affected operator situation awareness (SA), workload, and performance and whether operator SA predicted unique variance in performance. We extend prior research by manipulating uncertainty in contact location and by including a sample of expert track managers in a submarine combat system. In Experiment 1, university students completed a track management task. In Experiment 2, expert submariners were embedded in a real submarine combat system. Uncertainty was manipulated and SA was measured using the situation present assessment method. Increased uncertainty led to higher student workload and moderately impaired SA and performance, and SA predicted incremental variance in performance. Uncertainty had no effect on expert SA or the accuracy of the tactical picture compiled. On average, experts took 20 s to accept SA queries (compared with 2.18 s for students). The time taken for experts to accept SA queries, but not their subsequent response to SA queries, was positively associated with their tactical picture accuracy. Uncertainty can negatively impact SA, workload, and performance. Some key findings from the laboratory were replicated using experts, but the fact that experts took on average 20 s to accept SA queries presents a challenge for using SPAM in submarine control rooms. Contact location is uncertain due to the use of passive sonar and hostile deception. It is essential to measure track manager SA in order to inform work design and training.

Inter-rater reliability of query/probe-based techniques for measuring situation awareness

Query- or probe-based situation awareness (SA) measures sometimes rely on process experts to evaluate operator actions and system states when used in representative settings. This introduces variability of human judgement into the measurements that require inter-rater reliability assessment. However, the literature neglects inter-rater reliability of query/probe-based SA measures. We recruited process experts to provide reference keys to SA queries in trials of a full-scope nuclear power plant simulator experiment to investigate the inter-rater reliability of a query-based SA measure. The query-based SA measure demonstrated only ‘moderate’ inter-rater reliability even though the queries were seemingly direct. The level of agreement was significantly different across pairs of experts who had different levels of exposure to the experiment. The results caution that inter-rater reliability of query/probe-based techniques for measuring SA cannot be assumed in representative settings. Knowledge about the experiment as well as the domain is critical to forming reliable expert judgements.

Using the situation present assessment method to measure situation awareness in simulated submarine track management

Extant query-based measures of situation awareness that require interruption of dynamic tasks can be inappropriate in certain work contexts. A candidate real-time query-based method, the situation present assessment method (SPAM), was used to examine participants’ situation awareness in simulated submarine track management. The simulation and situation awareness queries were based upon a goal-directed task analysis conducted with expert submariners. Participants decided whether to engage enemy vessels using rules based on clear firing corridors for submarine torpedoes, and responded to SPAM queries that assessed their awareness of the current and future display situation. Participants were less accurate and slower to respond to SPAM queries that assessed awareness of the future display situation compared to the current display situation. Consistent with theoretical frameworks of visual sampling and attention-situation awareness integration, the relative predictive utility of current- and future- SPAM queries depended on the nature of the display information relevant to performance goals.

Investigation of automation deployment in the main control room of nuclear power plants by using adaptive automation

AbstractRecently, with the progress of computer technology, the digitalization of human–system interface (HSI) in the main control room (MCR) of advanced nuclear power plants (NPPs) has become an important issue. A higher level of automation means that the computers execute the greater part of the task. The frequency, however, of automation‐induced system failures, including human errors, prompts us to more closely investigate the influences of automation. The objective of this study is to measure the effects of adaptive automation on the primary task performance, operator situation awareness (SA), and workload in an advanced MCR of an advanced NPP to reduce the number of failures and improve human performance. This study selects automatic mode and semi‐automatic mode to compose five different types of automation allocations. The experiment scenario is a reactor shutdown task. A personal computer transient analyzer (PCTran) is used to simulate the HSI of an MCR. Twelve participants are required to perform the experiment scenario on the automation allocation types. The dependent variables were the primary task performance; the subjective workload was measured using an NASA‐Task Load Index (NASA‐TLX) questionnaire; and three levels of SA were estimated by SA queries. Experimental results revealed that the automation allocations made up of higher ratio automatic modes led to superior primary task performance, lower operator workload, and lower frequency of human errors. In the high ratio automatic mode allocation, the operators have the lowest SA queries score. This study provides additional information for future digital HSI design in the MCRs of advanced NPPs. © 2011 Wiley Periodicals, Inc.

Effects of physical workload on cognitive task performance and situation awareness

Sixteen participants performed a military operations simulation directing loading of helicopters to weight capacity within an allotted timeframe and subject to a set of decision rules. The participants stood, walked or jogged on a treadmill while performing the simulated cognitive task. Task performance was measured in terms of helicopter loading rate and accuracy. Situation awareness (SA) was measured using a simulation freeze technique and SA queries. Subjective workload was measured using the NASA-TLX. Results indicated a general trend of decreasing SA with increasing physical workload for perceptual knowledge, comprehension and overall SA. Results also revealed higher subjective workload during jogging than during the walking and standing conditions. However, the physical workload manipulations did not appear to affect cognitive task performance. This study has practical implications for defining physical and cognitive workloads in specific dynamic, complex work environments to support operator SA and performance.

Effects of Robot Control Mode on Situation Awareness and Performance in a Navigation Task

Our ability to complete tasks in remote environments has improved with increased sophistication of robotic systems. The quality of remote task performance is driven by the quality of human interaction with robots which can be dependent upon the operator's ability to acquire situation awareness (SA) for task completion. There are, however, often critical limitations in development of SA, which are projected to have a magnified effect when operators must task and control multiple unmanned systems. In this study, we investigated the effects the mode of robot control on operator performance and ability to develop SA while navigating two robots through two mazes. Participants were randomly assigned to groups to control the robots in serial (one after another) or in parallel (at the same time) either manually or using two types of automation. The participants also viewed a systems interface to monitor the status of the robots. Results indicate that participants under serial control produced higher SA scores, though not significantly different from SA scores observed under parallel control modes. The best navigation performance was observed under parallel control with a high level of autonomy that followed a prescribed set of navigation rules. This control mode also resulted in the lowest workload scores. Participants were better able to correctly respond to SA queries for lower level, perceptual items in the robotics task as compared to higher level comprehension and projection items. Performance in the monitoring task was found to be significantly, positively correlated to participant SA.

Situation Awareness in Driving While Using Adaptive Cruise Control and a Cell Phone

This research investigated the effects of an adaptive cruise control (ACC) system, and cell phone use in driving, on a direct objective measure of situation awareness (SA). Subjects drove a virtual car in a medium-fidelity driving simulation and performed a following task. Half of the subjects were required to respond to cell phone calls and all subjects completed trials with and without use of the ACC system. SA was measured using a simulation freeze technique and SA queries on the driving situation. Results indicated use of the ACC system to improve driving task SA under normal driving conditions, and cell phone conversations degraded SA. Results also revealed the ACC system to improve safe driving headway distance. Although the deviations in headway distance from an optimum were greater during cell phone conversations, this did not prove to be significant in terms of performance under normal driving conditions.

Situation awareness and workload in driving while using adaptive cruise control and a cell phone

Little work has empirically examined the cognitive construct of situation awareness (SA) in driving tasks involving the use of advanced in-vehicle automated technologies and personal communication devices. This research investigated the effects of an adaptive cruise control (ACC) system, and cell phone use in driving, on a direct and objective measure of SA, and assessed the competition of multiple driving and communication tasks for limited mental resources in terms of driving performance. Eighteen participants drove a virtual car in a driving simulation and performed a following task involving changes in speed and lateral position. Half of the participants were required to respond to cell phone calls and all completed trials with and without use of the ACC system. Task performance was measured in terms of lane deviations and speed control in tracking a lead vehicle, as well as headway distance in the following task. SA was measured using a simulation freeze technique and SA queries on the driving situation. Subjective workload was measured using a uni-dimensional mental workload rating. Results indicated use of the ACC system to improve driving task SA under typical driving conditions, and to reduce driver mental workload. However, the cell phone conversation caused deleterious effects on driving SA and increased driver mental load. The cell phone conversation (secondary task) competed for limited mental resources of drivers, leading to less attention to, and accurate knowledge of, the driving situation. Results also revealed the ACC system to improve driving performance along multiple dimensions; however, the cell phone did not have an effect. The latter result may be attributed to a short duration of the cell phone conversations during the experiment. This study has implications for the implementation of in-vehicle automation to support driver SA under normal driving conditions and regulations on the use of cell phones while driving. Relevance to Industry The results of this study have relevance to the introduction of advanced automation in commercial vehicles for supporting driver SA and regulation of cell phone use in driving. The study brings to light the critical role of attention-demanding distracter tasks, such as cell phone conversation while driving and using in-vehicle automation.

Interruption and Reorientation Effects of a Situation Awareness Probe on Driving Hazard Anticipation

A driving-based Hazard Perception Test of anticipation (HPT) was applied alongside an interruption-based Situation Awareness (SA) probe to investigate the effects of interruption and reorienting the operator to the task. Content of the SA probe was manipulated in four conditions: No queries, SA queries, orienting queries, and irrelevant queries. The findings were firstly that the HPT scores correlated with the SA probe scores in the SA queries condition. Secondly, there was a negative effect of interruption on HPT scores. Finally, HPT scores increased during SA queries and orienting queries but not during irrelevant queries. The results imply that previous research showing no interruption effects from SA probe methods may be due to the orienting effects of the queries compensating for a decrease in scores caused by interruption.

Calibration of Confidence in Situation Awareness Queries

Two experiments using a simulated Air Traffic Control task were conducted to examine the relationship between situation awareness and confidence under conditions of high and low temporal and perceptual demand. In the first experiment, participants were required to actively manipulate the aircraft on the radar screen. In the second experiment, the participants were required to passively observe the simulated air traffic. In both experiments, Endsley's SAGAT was used to query the subjects' SA and confidence in their responses. The results of this study revealed that whereas SA was affected primarily by perceptual demand, confidence was affected by both time pressure and workload. Moreover, the participants' under/overconfidence was affected primarily by perceptual demand. However, the participants were clearly overconfident in response to difficult SA queries and predominantly underconfident to easy SA queries. These results have implications for our understanding of the relationship between SA and performance in aviation research.