Control Room Crews Research Articles

Measuring team situation awareness through team communication: A study on nuclear main control room crews.

Situation awareness (SA) in complex socio-technical systems is considered a key cognitive activity, as control crews are often engaged in simultaneous task processes and are required to monitor and evaluate system parameters, making decisions and projections for the future accordingly. However, measuring SA at the team level is still a challenging area of research within the topic. In our research, we applied verbal protocol analysis as an alternative method to assess nuclear power plant control room crews' team SA. We conducted a study of 10 control room crews, examining their intrateam communication and its relatedness to team performance. We have found that communication categories related to the second and third levels of team SA increased significantly after the onset of an emergency event. Furthermore, while none of the team communication categories was related to team performance before the emergency event, all of them showed a strong positive correlation with team performance after the emergency situation occurred. Our results underline the importance of adequate verbalization of key information within the team, so as to support the rapid and accurate development of team SA during emergency situations.

Coordination of I&C Design With the Obligatory Consideration of Human Factors: A Project Management Approach

Human factors engineering (HFE), such as other engineering disciplines involved in plant design, cannot be considered retroactively. The engineering principles and methods derived from deep knowledge of the cognitive and perceptual capabilities and limitations of the plant’s “human element” are applied instead throughout the plant design. Focusing HFE efforts, the plant’s HMI is designed to ensure effective and error-free performance of the monitoring, control, and administrative tasks allocated to the control-room crew. A project’s HFE program prescribes three main steps (1) The task analysis and the analyses of plant monitoring and control functions to identify those to be performed manually (all others are performed automatically, or in a combination of manual and automatic, while still manually monitored) and determine in turn the HMI inventory of information displays, controls, alarms, and operating procedures required to support their performance. (2) The guided design of the plant’s HMI, ensuring its compliance with HFE principles and the completeness and correctness of the task support it provides. (3) The subsequent evaluation of operator performance, trained to follow the operating procedures and use of the HMI. Authors’ experience shows that the three following required steps pose challenges to project execution: (1) the acquisition and analysis of the multidisciplinary functional requirements (related to plant monitoring and control); (2) the likely interdisciplinary analysis and how fulfillment of these requirements shall be allocated to I&C automation systems or operators (or both); and (3) the HFE-guided HMI design and validation. An additional fourth challenge poses a timely and cost-effective application of HFE to I&C engineering, which can be achieved by adequate planning and project management procedures. This paper aims to summarize some of our industrial experiences gained in new builds and modernization projects of nuclear power plants around the world.

The use of a process mining technique to characterize the work process of main control room crews: A feasibility study

In terms of supporting HRA (Human Reliability Analysis) practitioners, one of the urgent issues is to establish a set of objective criteria for determining the proper level of PSFs (Performance Shaping Factors), which are crucial for estimating the likelihood of HEPs (Human Error Probabilities). From this concern, the feasibility study of process mining techniques to characterize the work process of MCR (Main Control Room) crews is presented in this study. Three kinds of information requirements that are essential for determining the quality of the work process are first identified, and the application of process mining techniques is then introduced to address those requirements. As a case study, we illustrate the process mining techniques with communication logs that were collected from MCR crews exposed to simulated off-normal conditions. As a result, three kinds of insightful information (i.e., a work flow, time and spatial information along with a given work flow, and the flow of keywords describing what kinds of symptoms and/or knowledge were considered by MCR crews) are soundly extracted from communication logs. Consequently, it is expected that process mining techniques are effective for identifying a set of necessary information that would helpful for assessing the quality of the work process in an objective manner.

ICONE23-1912 Coordination of I&C Design with the Obligatory Consideration of Human Factors : A Project Management Approach

Human Factors Engineering (HFE), like other engineering disciplines involved in plant design, cannot be considered retroactively. The engineering principles and methods derived from deep knowledge of the cognitive and perceptual capabilities and limitations of the plant's "human element" are applied instead throughout plant design. Focusing HFE efforts on the plant's I&C, the plant's HMI is designed to ensure effective and error-free performance of the monitoring, control, and administrative tasks allocated to the control room crew. Generally speaking, a project's HFE program prescribes three main steps: (i) the analyses of plant monitoring and control functions in order to identify those to be performed manually (all others are performed automatically while still manually monitored) and determine in turn the HMI inventory of information displays, controls, alarms, and operating procedures required to support their performance, (ii) the guided design of the plant's HMI, ensuring its compliance with HFE principles and the completeness and correctness of the task support it provides, and (iii) the subsequent evaluation of operators performance, trained to follow the operating procedures and use the HMI referred to. The I&C systems designed to monitor and control the plant processes and implement, among other functions, the plant's HMI, are likely validated, governed by I&C norms and the project's V&V guidelines. Past experience shows that the three following obligatory steps pose challenges to project execution: (i) the acquisition and analysis of the multidisciplinary functional requirements (related to plant monitoring and control); (ii) the likely interdisciplinary analysis whether and how fulfillment of these requirements shall be allocated to I&C automation systems or operators (or both), and (iii) the HFE-guided HMI design and validation. A timely and cost-effective application of HFE to I&C engineering can be achieved by adequate planning and project management. This paper aims to summarize some of our experiences

Human factors applied to alarm panel modernization of nuclear control room

Human factors deal with issues related to humans, their behavior and the physical aspect of the environment in which they work. A control room is a complex system where operators perform plant operation using control systems and carry out monitoring and administrative responsibilities. For safe operation of industrial installation, the performance of the control room crew plays an important role. In this respect, a well designed control room is crucial for safe and efficient operation. The aim of this paper is to propose a methodological framework applied to nuclear control room evaluation, through participatory ergonomics, using operator activity analysis and human factors questionnaire as aid tools. We describe a case study in which the methodology framework was used in the evaluation process of a nuclear control room. The information gathered made possible a series of recommendation for the adequacy of the control room design, assisting in the safety assessment of the nuclear plant operation and justifying the alarm panel modernization.

가동 중 원자력발전소의 인적 오류 예방 기술 개발

This paper describes several current research activities and the field techniques for the prevention of human errors during the operation of nuclear power plants(NPPs). The human aspects such as 'fitness for the duties', 'job competence and suitability', 'types of communication', 'behaviors of field workers', 'teamwork of main control room crews', 'task procedures', etc. have been investigated for improving the performance of operating personnel in NPPs. We decide to develop a set of the complementary techniques for the reduction of human errors. The set of techniques developed includes teamwork criteria, jobs fitness analysis, procedure enhancement guide, 3-way communication, campaign posters, a behavior based safety program, a procedure guideline, and a task hazard identification method for the field practitioners in NPPs. These can offer a set of significant human error countermeasures to be considered for analyzing and reducing human error in NPPs as well as other fields of industry.

Person-in-the-Loop Testing of a Digital Power Plant Control Room

There is renewed interest in building new commercial nuclear power plants. Unlike existing plants that have traditional control rooms with large control boards, new plants will have compact digital control rooms. The transition to digital control rooms introduce opportunities for enhanced support (e.g., integrated displays; improved alarm systems; computerized procedures) as well as potential new challenges (e.g., shift from open to private workspaces; changes in workload distribution resulting from reduced control room crew size). This paper describes two simulator tests that were conducted as part of a person-in-the-loop test program to support development and validation of a control room for the US-APWR evolutionary pressurized water reactor plant. While the results are presented in the context of evaluation of a particular digital control room design, they have applicability to design of compact digital control rooms more generally, and point to areas where more research is needed.

A Simulator Experiment Investigating the Effects of Masked Indicators in a NPP Emergency Control Task: Scenario and Design

This paper describes the scenario and participants of a simulator experiment investigating the performance of nuclear power plant (NPP) control room crews in a realistic accident scenario where multiple failures lead to masking of relevant diagnostic information. These conditions challenge emergency operating procedures and require crews to engage in knowledge-based problem solving. The study placed particular emphasis on generating rich operational descriptions of crew behavior and performance-shaping factors.

Framework and Application for Modeling Control Room Crew Performance at Nuclear Power Plants

This paper summarizes an emerging project regarding the utilization of high-fidelity MIDAS simulations for visualizing and modeling control room crew performance at nuclear power plants. The key envisioned uses for MIDAS-based control room simulations are: (i) the estimation of human error associated with advanced control room equipment and configurations, (ii) the investigative determination of contributory cognitive factors for risk significant scenarios involving control room operating crews, and (iii) the certification of reduced staffing levels in advanced control rooms. It is proposed that MIDAS serves as a key component for the effective modeling of cognition, elements of situation awareness, and risk associated with human performance in next generation control rooms.

The use of a simulator to include human factors issues in the interface design of a nuclear power plant control room

Technology plays an important role in advanced control rooms that relies on complex technical equipment and interfaces. Human error has many causes such as performance shaping factors, organizational factors and interface design. In the safe operation of nuclear power plant, the performance of the control room crew plays an important role. In this respect, a well-designed control room and human–system interfaces (HSIs) are crucial for safe and efficient operation of the plant, reducing the occurrence of incidents, accidents and the risks of human error. Therefore, it is essential that the interfaces design must be conducted in a well-structured way, applying human factors principles in all phases of the control room life cycle. The aim of this paper is to present an approach to design the interfaces for a nuclear reactor control room. The methodological framework includes human factors guidelines and standards, checklists and ergonomics as an aid tool, based on the operator activity analysis. In this paper, we describe the application of the proposed methodology in an advanced control room of a nuclear power plant simulator.

Nuclear power plant communications in normative and actual practice: A field study of control room operators' communications

AbstractThe safety and availability of sociotechnical critical systems still relies on human operators, both through human reliability and human ability to handle adequately unexpected events. In this article, the authors focus on ergonomic field studies of nuclear power plant control room operator activities, and more specifically on the analysis of communications within control room crews. They show how operators use vague and porous verbal exchanges to produce continuous, redundant, and diverse interactions to successfully construct and maintain individual and mutual awareness, which is paramount to achieve system stability and safety. Such continuous interactions enable the operators to prevent, detect, and reverse system errors or flaws by anticipation or regulation. This study helps in providing cues for the design of more workable systems for human cooperation in nuclear power plant operation. © 2007 Wiley Periodicals, Inc. Hum Factors Man 17: 43–78, 2007.

Power plant simulators: Data collection and insights from data

The paper is mainly concerned with the uses of simulators for training of Main Control Room (MCR) crews and the role of data in the improvement in the quality of control room personnel and quality of training programs. In the authors' opinion training departments should be committed to the continuous improvement in both. The collection and analysis of the data relating to crew responses during simulated accidents can be used to better understand the influences that can lead to errors. In turn, the resulting information can be part of the Human Reliability Assessment (HRA) process, so then the Probabilistic Risk Assessments (PRA) will reflect the actual crews' performance rather than some anonymous generic crew.To provide a background to the field of simulator data collection, the paper covers some of the developments in simulator technology from the early simulators to the later more sophisticated units. The use of simulators in the training of control room crews was strongly affected by the Three Mile Unit #2 accident. One of the steps taken in training improvements is use of the Systematic Approach to Training (SAT). Amongst other things SAT emphasizes the function of feedback from simulator training as a way to identify performance deficiencies and excellent performance of MCR crews.The paper discusses the need for good data collection systems for both MCR crew performance improvement but also for monitoring the health of the Training program. The paper describes the purpose of data collection, a design of an advanced data collection and analysis system along with data collected during the course of simulator sessions. The paper touches on the use of data for HRA purposes and finishes with some comments and conclusions on data collection and its uses.

Ergonomic field studies in a nuclear power plant control room

The safety and availability of sociotechnical critical systems still relies on human operators, both through human reliability and human ability to handle adequately unexpected events. This paper focuses on ergonomic field studies of nuclear power plant control room operator activities, and more specifically on the analysis of verbal communications within control room crews during micro incidents in normal operation. We show how operators use verbal exchanges to produce continuous, redundant, and recursive interactions to successfully construct and maintain individual and mutual awareness, which is paramount to achieve system stability and safety. Such continuous interactions enable the operators to prevent, detect and reverse system errors or flaws by anticipation or regulation. This study helps in providing cues for the design of more workable systems for nuclear power plant operation.

Effects of Adaptive Behaviors and Shared Mental Models on Control Crew Performance

Control crews are highly trained teams responsible for monitoring complex systems, performing routine procedures, and quickly responding to nonroutine situations. Previous literature suggests that higher-performing control crews engage in adaptive behavior during high-workload or crisis situations. Other work suggests that higher-performing crews use periods of lower workloads to prepare for future problems. To understand which behaviors performed during which situations better differentiate lower- from higher-performing crews, we conducted a study of 14 nuclear power plant control room crews and examined adaptive behaviors and shared mental model development in the crews as they faced monitoring, routine, and nonroutine situations. Our results suggest that few differences in adaptive behaviors exist between higher- and lower-performing crews during monitoring or routine situations, but that information collection and shared mental model development activities, and intracrew processes used during model development, differ significantly between lower- and higher-performing control crews during nonroutine situations.

Some insights from recent applications of HRA methods in PSA effort and plant operation feedback in Czech Republic

Abstract The methods of human reliability analysis (HRA) form an integral part of probabilistic safety assessment. These methods are currently still under development and there is significant lack of data needed for applications. As a consequence, no unique formal approach for solution of many aspects related to plant staff human performance does exist. In this contribution, some examples of fruitful work are given, which reflect the needs and possibilities specific for HRA field. In the first two examples, methodology, course and results of analysis of concrete matters related to pre-accident errors and shutdown control room crew performance are described. The last example is oriented to one potential human performance related data source-observation of control room crew full-scope simulator exercise. Some conclusions of general validity are presented in the final part of the contribution.

Team Interaction Skills Evaluation Criteria for Nuclear Power Plant Control Room Operators

Previous research has shown the value of good team interaction skills to group performance, yet little progress has been made in measuring such skills. Dimensions of team interaction skills developed in an earlier study (Montgomery, et al., 1990) were extensively revised and cast into a Behaviorally Anchored Rating scales (BARS) and a Behavioral Frequency scale format. Rating data were collected using training instructors at a nuclear plant, who rated videotape scenarios of control room performance and later rated control room crews during requalification training. High levels of interrater agreement on both rating scales was, although the hypothesized factor structure did not emerge. Analysis of ratings of the videotapes using Cronbach's components of accuracy (Cronbach, 1955) indicated that BARS ratings generally exhibited less error than did the Behavioral Frequency ratings. The results are discussed in terms of both field and research implications.

The Effects of Supervisor Experience and the Presence of a Shift Technical Advisor on the Performance of Two-Man Crews in a Nuclear Power Plant Simulator

This report describes a training simulator experiment to evaluate the effects of the experience level of the Senior Reactor Operator (SRO) and the presence of a Shift Technical Advisor (STA) on the performance of nuclear power plant control room crews. Sixteen two-man crews of licensed operators were employed in a 2 × 2 factorial design. The SROs leading the crews were split into “high” and “low” experience groups on the basis of their years of experience as an SRO. One half of the high- and low-SRO experience groups were assisted by an STA or an SRO acting as an STA. The crews responded to four simulated plant casualties. A five-variable set of content-referenced performance measures was derived from task analyses of the procedurally correct responses to the four casualties. System parameters and control manipulations were recorded by the computer controlling the simulator. Data on communications and procedure use were obtained from analysis of videotapes of the exercises. Questionnaires were used to collect subject biographical information and data on subjective workload during each simulated casualty. For four of the five performance measures, no significant differences were found between groups led by “high” (25–114 months) and “low” (1–17 months as an SRO) experience SROs. However, crews led by “low” experience SROs tended to have significantly shorter task performance times than crews led by “high” experience SROs. The presence of the STA had no significant effect on overall team performance in responding to the four simulated casualties.

Task Analysis of Nuclear Power Plant Control Room Crews Data Collection Approach and Methodology

This paper describes the data collection approach and methodology used to conduct a task analysis of nuclear power plant control room crews. The objective of the research project, funded by the NRC Office of Nuclear Regulatory Research, is to provide task data for evaluating six areas: (1) Human engineering designs of new control rooms and retrofitting of current control rooms, (2) The numbers and types of control room operators required with requisite skills and knowledges, (3) Operator qualification and training requirements, (4) Normal, off-normal, and emergency operating procedures, (5) Job performance aids, and (6) Communications. The task analysis methodology used in this project is discussed and compared to traditional task analysis and job analysis methods. A data collection approach is described which focusses on a generic structural framework for assembling the multitude of task data that will be observed. Control room crew task data is observed and recorded within the context of an “operating sequence.” The data collection will be conducted at eight power plant sites by teams comprised of human factors and operations personnel. Plants were sampled according to NSSS vendor, vintage, simulator availability, architect-engineer, and control room configuration. The results of the data collection effort will be compiled in a computerized task data base. Preliminary discussion of illustrative examples to demonstrate suitability for data analysis will be presented.