Event Analysis Of Systemic Teamwork Research Articles

The effect of information integration on team communication in a simulated submarine control room task

Submarine control rooms are characterised by dedicated individual roles for information types (e.g. Sonar operator processes sound energy), with individuals verbally reporting the information that they receive to other team members to help resolve uncertainty in the operational environment (low information integration). We compared this work design with one that ensured critical information was more readily available to all team members (high information integration). We used the Event Analysis of Systemic Teamwork (EAST) method to analyse task, information, and social networks for novice teams operating within a simulated submarine control room under low versus high information integration. Integration impacted team member centrality (importance relative to other operators) and the nature of information shared. Team members with greater centrality reported higher workload. Higher integration across consoles altered how team members interacted and their relative status, the information shared, and how workload was distributed. However, overall network structures remained intact.

Understanding complexity in a safety critical setting: A systems approach to medication administration

‘Medication errors’ are a significant concern and are associated with a higher incidence of adverse events and unintentional patient harm than any other aspect of healthcare. While much research has focused on adverse medication errors, limited studies have specifically examined ‘normal’ medication delivery performance and the interactions between tasks, agents, and information within the medication administration system. This article describes a study that applied the Event Analysis of Systemic Teamwork (EAST) model to study the hospital medication administration system to identify opportunities to optimise performance and patient safety. Key findings of this study demonstrate that this is a highly complex system, comprising many social agents and a relatively closely linked series of tasks and information. However, most of the workload relies on a small proportion of healthcare professionals. Significantly, the patient has a minimal role in the medication administration system during their hospital stay. The research has shown that this approach enables mapping networks and their interdependencies to optimise the system as a whole rather than its parts in isolation.

Analysing dynamic work systems using DynEAST: a demonstration of concept

The capability of current Ergonomics methods to capture dynamism is limited, stifling our understanding of work-as-done, distributed situational awareness and organisational drift. This paper provides a demonstration of concept of DynEAST; an extension of the EAST framework underpinned by principles from Dynamic Network Analysis, to capture elements of dynamism within work systems. The DynEAST concept is applied to a railway maintenance case study. Case study findings demonstrate how DynEAST outputs can be used to advance our understanding of the aforementioned phenomena and better equip practitioners for current and future Ergonomics challenges. Practitioner summary: This paper introduces the DynEAST method. DynEAST enables HF/E practitioners to model and analyse dynamic features of complex work systems. The development of DynEAST is timely due to the concurrent proliferation of increasingly complex sociotechnical systems and stagnation of HF/E methods development; particularly those able to model systemic dynamism. Abbreviations: DynEAST: dynamic event analysis of systemic teamwork; EAST: dynamic event analysis of systemic teamwork; HF/E: human factors and ergonomics; HF: human factors; DNA: dynamic network analysis; HTA: hierarchal task analysis; CWA: cognitive work analysis; CAST: causal analysis based on system theory; STAMP: system theoretic accident model and processes; FRAM: functional resonance analysis method; SNA: social network analysis; DSA: distributed situational awareness; PPO: possession protection officer; PO: protection officer; RTS: railway track signals; LPA: local possession authority; SMEs: subject matter experts

Teaming with industrial cobots: A socio‐technical perspective on safety analysis

AbstractCollaborative human–machine interaction will be progressively intensified in industrial applications. The aim of this article is to examine current approaches to cobot safety by showing that these approaches can additionally benefit from systems thinking methods. The first part of this article covers a narrative literature review on predominantly techno‐centric robot safety approaches, with a strong focus on containing kinetic energy and ensuring separation with humans. The second part introduces systems thinking methods to analyze a socio‐technical perspective on cobot safety, including joint cognitive systems and distributed cognition perspectives. This explorative research dimension is expected to overcome an overly narrow interpretation of safety issues, anticipating the challenges ahead in ever more complex cobot applications. This article embraces a socio‐technical perspective to explore the potential of Joint Cognitive Systems to manage risk and safety in cobot applications. Three systemic safety analysis approaches are presented and tested with a demonstrator case study concerning their feasibility for cobot applications: System‐Theoretic Accident Model and Processes (STAMP); Functional Resonance Analysis Method (FRAM); and Event Analysis of Systemic Teamwork (EAST). These methods each provide interesting extensions to complement the traditional understanding of risk as required by current and future industrial cobot implementations. The power of systemic methods for safer and more efficient cobot operations lies in revealing the distributed and emergent result from joint actions and overcoming the reductionist view from individual failures or single agent responsibilities. The safe operation of cobot applications can only be achieved through alignment of design, training, and operation of such applications.

The quest for the ring: a case study of a new submarine control room configuration

Submarine control room layouts have remained similar across decades of operation, despite the introduction of new technologies that allow for the co-location of the sound and control room. Operation of an inwards, rather than outwards, facing ring control room configuration was examined in three scenarios: Return to Periscope Depth, Inshore Operations, and Dived Tracking. A case study design employed a serving team of qualified submariners participated in all three scenarios with high and low demand. Communications and activities in the control room were recorded and analysed using the Event Analysis of Systemic Teamwork (EAST) method. EAST models collaborative teamwork through social, information, and task networks. The results from the ring configuration were compared to an outward facing baseline of the contemporary control room layout with a separate sound and control room. The ring control room configuration increased communications between operators, leading to a more information exchanged, and more tasks completed. Practitioner summary: Control room design on submarines, and other domains, has traditionally been outward facing with supervisory staff looking over the shoulders of their subordinates. In this paper, and inward looking control room design was explored, with subordinate staff facing their supervisors. This design resulted in more information exchange and productive work.

A Delphi study of human factors methods for the evaluation of adaptation in safety-related organisations

Advances in safety science point towards an approach to the management of safety-related risks within complex sociotechnical systems that focuses on the understanding of adaptation. The study of adaptation would benefit from the use of structured and formalised approaches at, and across, all levels of the organisational hierarchy (individual, team and organisation). However, with a large number of potential Human Factors methods available to the safety practitioner, it is unclear which methods are most appropriate for an exploration of this important tenet of systems thinking. A 3-round ranking Delphi study has been conducted to survey the range of methods to determine a soft consensus amongst subject matter experts. In each of the three rounds the list was successively refined. Cognitive Work Analysis (CWA) and Critical Decision Method (CDM) were recommended for the micro level (which could be complemented by HTA). At the meso level, CDM and CWA together with complementary methods, such as Systems Theoretic Accident Modelling and Processes (STAMP), Functional Resonance Analysis Method (FRAM) and the Event Analysis for Systemic Teamwork (EAST) method. STAMP and FRAM were recommended at the macro level, which could be complemented with Hierarchical Task Analysis (HTA), Ethnographic Analysis, EAST and the Human Factors Analysis and Classification System (HFACS). The methods, taken together, should provide a means of exploring adaptation at all of the sociotechnical system levels. This work provides safety practitioners with consolidated guidance on the methods that could be used to explore adaptation as a source of safety in complex sociotechnical systems.

Team Performance in a Simulated Maritime Control Room: The Effect of Information Integration and Operator Configuration

How team cognition is conceptualized has evolved rapidly in the last decade with the emerging use of a systems approach, moving the focus from the cognition residing in the heads of individuals, to that distributed across the team. This is referred to as ‘distributed cognition’. Increasingly, network approaches are being explored in attempts to model team distributed cognition. The specific domain of interest in the present study is the sociotechnical system within a maritime control room. This comprises human, machine and software agents interacting to interpret sensor data in order to develop a timely and accurate picture of surrounding contacts at sea. To achieve the goal, information is shared or integrated across the maritime control room consoles. The aim of this study was to develop and apply a suite of workload, situation awareness and team performance measures, including network analysis techniques, to examine how the distributed cognition of a team might change as a function of console configuration and information integration within a control room, and how these changes, if any, impact overall team performance. Sixteen teams of six novices conducted two one-hour scenarios operating generic maritime control room positions. Each team completed a one-hour simulation in each of two console configuration layouts with the order counter-balanced (within-subject design). Half the teams conducted the two scenarios in a high integration condition, and half in a low integration condition (between-subjects). The human machine interface (HMI) designs for the high integration condition emerged from a series of task analyses and user-centered design workshops. The emergent cognitively –oriented HMI designs are based on the assumption that each console can freely share information with other consoles. To create an analogue of current, less-integrated, and more stove-piped systems, a low integration condition was created where not all information was shared across consoles, but instead was shared verbally by console operators. Contacts detected at sea were introduced into the simulation and the team’s task was to assess, report and derive a solution (location, course, and speed) for each detected contact. Individual situation awareness was measured through the Situation Present Assessment Method (SPAM) and individual workload through the Air Traffic Workload Indicator Task (ATWIT). Team interaction from the scenarios were video recorded and we applied the Event Analysis of Systemic Teamwork (EAST) approach to examine the task, social and information networks which emerged. Team performance was measured as the accuracy and timeliness of the solutions We found higher information integration lowered average team workload, and improved average team situation awareness and team performance (faster solutions and a more accurate tactical picture). We found no impact of console configuration on team performance or any other dependent measure. The EAST method uncovered patterns in the network analysis that are potentially explanatory for the team workload, situation awareness and performance findings as a function of the information integration manipulation. This experiment showed that there can be reductions in workload, and improvements to situation awareness and performance when information is shared between consoles in a considered design. This has implications for HMI design within a team setting. The set of diagnostic metrics developed were largely effective in examining teamwork and team performance. Acknowledgements. The authors would like to thank Justin Hill (Royal Australian Navy) for his subject matter expertise, Graeme Muller (elmTEK) for his software, technical and infrastructure support, David Munro-Ford (Total Technology Partners) for his simulation programming, Dr Aaron Roberts for his advice on general aspects of the experiment, and Professor Paul Salmon for his advice on EAST.

Better together? Investigating new control room configurations and reduced crew size in submarine command and control

The separation of the sound and control rooms in Royal Navy submarines seems to be artefactually reducing the effectiveness of information transition and the overall productivity of the team. A proposed integrated sound and control room was tested in three scenarios: Return to Periscope Depth (RTPD), Inshore Operations (INSO) and Dived Tracking (DT). The activities and communications of a team of serving submariners were recorded in a control room, in a single case study design, comparing co-location and reduced crewing with a baseline of the separate sound and control room configurations that is representative of current submarines. The Event Analysis of Systemic Teamwork (EAST) method was used to examine changes in social, information and task networks. In general terms, the co-location of the submariner team led to more efficient communication and completion of tasks. Reducing the crew was more challenging in the higher demand scenarios. Practitioner Summary: There are constraints acting on control rooms, both in terms of physical space and crew size. This study compared conventional control room with co-location and reduced crew in turn. Teamwork improved in the collocated control room but the reduced crew struggled most under conditions of high demand. Abbreviations: DT: dived tracking; EAST: event analysis for systemic teamwork; H: high; INSO: inshore operations; L: low; OOW: office of the watch; OpsO: operations officer; Peri: periscope operator; RTPD: return to periscope depth; RN: royal navy; SoC: sonar controller; SoP: sonar operator; TMA: time-motion analyst

The effects of team co-location and reduced crewing on team communication characteristics

The manner in which control rooms are configured can impact the flow of information between command teams. Previous research revealed bottlenecks of communications between the Sonar Controller (SOC) and the Operations Officer (OPSO) in submarine control rooms. One way to relieve such bottlenecks is to co-locate operators reliant on one another for task relevant information. The aim of the current studies was to use multiple command teams to empirically examine a novel submarine control room configuration and a reduced crew size in comparison to a baseline of contemporary operations to see if such bottlenecks could be removed. Ten teams performed high and low demand Dived Tracking (DT) scenarios in a simulated submarine control room. Activities and communications of the teams were recorded and quantified using the Event Analysis of Systemic Teamwork (EAST) method affording statistical comparisons with a baseline condition of contemporary operations. The findings showed that the co-location of operators relieved the bottleneck of communications between the SOC and the OPSO. Although overall communications increased, this was more balanced across the team and was more adaptive to scenario demand. This was coupled with a significant increase in task completion, even with a reduced crew size, suggesting greater efficiency and productivity. Future research should seek to validate the changes observed with objective measures of task performance.

Using the Event Analysis of Systemic Teamwork (EAST) broken-links approach to understand vulnerabilities to disruption in a darknet market

Darknet markets provide an anonymous, online platform for users to trade illicit drugs, fraudulent identity data, and other commodities. Although law enforcement agencies have been successful in seising many markets, the Darknet is an agile and dynamic environment and market activities often persist and emerge in a new form. Given this constantly changing environment, new ways of disrupting darknet markets are required. This study used Event Analysis of Systemic Teamwork (EAST) to analyse market activity and understand vulnerabilities to disruption. This involved using the EAST broken-links approach to assess the effects of compromising the transmission of information between tasks and between agents. The analysis identified critical vulnerabilities in the system, which included information involved in registering, depositing funds, communicating listing details to buyers, and communicating dispute resolution messages. This study indicates that systems ergonomics methods—in particular, EAST—can provide insight into system vulnerabilities that might be targeted for disruption.Practitioner summaryThis study provides a conceptualisation of the processes, people, structures, and information involved in the buying and selling of goods on a darknet market. Law enforcement agencies may use broken-links analyses to systematically consider the effects of their interventions.

Evaluating sociotechnical dynamics in a simulated remotely-piloted aircraft system: a layered dynamics approach

As coordination mechanisms change and technology failures occur, a sociotechnical system must reorganise itself across human and technological layers to maintain effectiveness. We present a study examining reorganisation across communication, controls and vehicle layers of a remotely-piloted aircraft system (RPAS) using a layered dynamics approach. Team members (pilot; navigator; photographer) performed 5 simulated RPAS missions using different operator configurations, including all-human and human-autonomy teams. Reorganization (operationally defined using entropy) time series measured the changing system reorganisation profiles under different operator configurations and following autonomy failures. Correlations between these reorganisation profiles and team effectiveness scores describe the manner in which the system had to be coordinated to maintain effectiveness under these changing conditions. Four unplanned autonomy failures were analysed to visualise system reorganisation following a technology failure. With its objective and real-time modelling and measurement capabilities, layered dynamics complements existing systems thinking tools for understanding sociotechnical complexity and enhancing system effectiveness.Practitioner summary: A layered dynamics approach for understanding how a sociotechnical system dynamically reorganises itself is presented. The layered dynamics of RPAS were analysed under different operator configurations and following autonomy failures. Layered dynamics complements existing system-thinking tools for modelling sociotechnical system complexity and effectiveness.Abbreviation: RPAS: remotely-piloted aircraft system; HIS: human-systems integration; EAST: event analysis of systemic teamwork; H1: hypothesis 1; H2: hypothesis 2; H3: hypothesis 3; CERTT-STE: cognitive engineering research on team tasks--synthetic task environment; AVO: air vehicle operator; PLO: payload operator; DEMPC: data exploitation, mission planning, and communications; ACT-R: adaptive control of thought-rational; sec: seconds; ANOVA: analysis of variance

Analysis of driver roles: modelling the changing role of the driver in automated driving systems using EAST

ABSTRACTThe purpose of this paper is to analyse the role of the driver within automated driving systems using the Event Analysis of Systemic Teamwork (EAST) method. We already know that as the level of automation increases within the driving task, the role of the driver shifts from that of an active operator (i.e. a driver driving) to more of a passive monitor (i.e. a driver monitoring). Task, social and information networks were constructed using the Hierarchical Task Analysis of Driving and evidence from driver verbalisations collected during a previous study to further explore the changing role of the driver using network analysis. A ‘broken links’ approach was conducted to show that momentary engagement in non-driving-related secondary tasks within an automated driving system can dramatically change the structure of driving system.

Distributed cognition in aviation operations: a gate-to-gate study with implications for distributed crewing

The network analysis method, Event Analysis of Systemic Teamwork (EAST), was used to examine routine aviation operations from multiple perspectives from six key areas (i.e. Dispatch, ATC, ATM, Maintenance, Loading, and the Cockpit). Data was collected over a five-day observational field trial at an international air cargo operator. Researchers recorded the activities of agents operating within the six key areas over three outbound and two inbound flights. Three networks (i.e. social, information and task) were created for four key phases of flight: (i) pre-flight checks and engines start (ii) taxi, take-off and assent, (iii) descent, landing and taxi, and (iv) park and shut down. The networks represent a ‘work audit’ of short-haul cargo operations, which enabled a detailed understanding of the interactions and connections within the current system. Implications for the future of distributed crewing concepts are discussed.Practitioner Summary: An analysis of the aviation system was undertaken using the amalgamated data from three outbound and two inbound flights. These analyses show the social, information and task interactions for cargo operations. This has been used to specify requirements for future distributed crewing options.

The Dark Side Of The Net: Event Analysis Of Systemic Teamwork (East) Applied To Illicit Trading On A Darknet Market

Darknet markets are increasingly being used to facilitate the trade of illicit drugs and fraudulent identity data. Despite this, the processes underlying such trading remain poorly understood, as does how best to disrupt these activities. The aim of this study was to use Event Analysis of Systemic Teamwork (EAST) to describe the task, social, and information networks involved in the buying and selling of illicit goods on a Darknet market. The results demonstrated that many elements of Darknet market activity interact and targeting any one of these elements may result in a variety of disruptive outcomes. This study has implications for understanding the complexity of the Darknet market ecosystem and its vulnerability to disruption.

Examining Social, Information, and Task Networks in Submarine Command and Control

Submarine control room operations have not changed much over the past 50 years, despite introduction of new technologies. This study sought to catalog current operations as a baseline for comparing new ways of working. Three scenarios were selected to be examined in both high and low demand: returning to periscope depth, dived tracking, and inshore operations. The scenarios were run in a submarine simulator with currently serving submariners from the Royal Navy. The flow of throughout the submarine command team was examined using event analysis for systemic teamwork (EAST). EAST models collaborative teamwork via three networks: task, social, and information. Results show that the social interactions, information transition, and focus of tasks are different depending on the particular operation being completed and the work demand placed on the command team. There are particular information elements that are fundamental across all scenario types. Task and communication load is not evenly distributed across the team, with potential bottlenecks identified between the sonar controller and operations officer roles. Implications of the results are discussed alongside recommendations for future research.

Applying systems ergonomics methods in sport: A systematic review

IntroductionAs sports systems become increasingly more complex, competitive, and technology-centric, there is a greater need for systems ergonomics methods to consider the performance, health, and safety of athletes in context with the wider settings in which they operate. Therefore, the purpose of this systematic review was to identify and critically evaluate studies which have applied a systems ergonomics research approach in the context of sports performance and injury management. Material and methodsFive databases (PubMed, Scopus, ScienceDirect, Web of Science, and SPORTDiscus) were searched for the dates 01 January 1990 to 01 August 2017, inclusive, for original peer-reviewed journal articles and conference papers. Reported analyses were underpinned by a recognised systems ergonomics method, and study aims were related to the optimisation of sports performance (e.g. communication, playing style, technique, tactics, or equipment), and/or the management of sports injury (i.e. identification, prevention, or treatment). ResultsA total of seven articles were identified. Two articles were focussed on understanding and optimising sports performance, whereas five examined sports injury management. The methods used were the Event Analysis of Systemic Teamwork, Cognitive Work Analysis (the Work Domain Analysis Abstraction Hierarchy), Rasmussen's Risk Management Framework, and the Systems Theoretic Accident Model and Processes method. The individual sport application was distance running, whereas the team sports contexts examined were cycling, football, Australian Football League, and rugby union. ConclusionsThe included systems ergonomics applications were highly flexible, covering both amateur and elite sports contexts. The studies were rated as valuable, providing descriptions of injury controls and causation, the factors influencing injury management, the allocation of responsibilities for injury prevention, as well as the factors and their interactions underpinning sports performance. Implications and future directions for research are described.

Go Deeper, Go Deeper: Understanding submarine command and control during the completion of dived tracking operations

This is a world's first-of-a-kind study providing empirical evidence for understanding submarine control room performance when completing higher and lower demand Dived Tracking (DT) scenarios. A submarine control room simulator was built, using a non-commercial version of Dangerous Waters as the simulation engine. The creation of networked workstations allowed a team of nine operators to perform tasks completed by submarine command teams during DT. The Event Analysis of Systemic Teamwork (EAST) method was used to model the social, task and information networks and describe command team performance. Ten teams were recruited for the study, affording statistical comparisons of how command team roles and level of demand affected performance. Results indicate that command teams can covertly DT a contact differently depending on demand (e.g. volume of contacts). In low demand it was possible to use periscope more often than in high demand, in a ‘duck-and-run’ fashion. Therefore, the type of information and frequency of particular task completion, was significantly different between the higher and lower demand conditions. This resulted in different operators in the command team experiencing greater demand depending on how the DT mission objective was completed. Potential bottlenecks in the command team were identified and implications are discussed alongside suggestions for future work.

Distributed Cognition on the road: Using EAST to explore future road transportation systems

Connected and Autonomous Vehicles (CAV) are set to revolutionise the way in which we use our transportation system. However, we do not fully understand how the integration of wireless and autonomous technology into the road transportation network affects overall network dynamism. This paper uses the theoretical principles underlying Distributed Cognition to explore the dependencies and interdependencies that exist between system agents located within the road environment, traffic management centres and other external agencies in both non-connected and connected transportation systems. This represents a significant step forward in modelling complex sociotechnical systems as it shows that the principles underlying Distributed Cognition can be applied to macro-level systems using the visual representations afforded by the Event Analysis of Systemic Teamwork (EAST) method.

Distributed cognition in Search and Rescue: loosely coupled tasks and tightly coupled roles

The perceptual cycle model (PCM) underpins much Ergonomics research, particularly in a team context, for example in its theoretical underpinning of distributed situation awareness. Despite this, the PCM framework it has not been explicitly applied to explore team processes, which is surprising given the prevalence of teamwork in safety critical systems. This paper explores team processes in the context of search and rescue (SAR) by applying the PCM and an association classification scheme with a network analysis approach utilising the event analysis of systemic teamwork (EAST) method. Data were collected via observations and communication recordings during training flights with SAR crews and were amalgamated into a representative case study. The analysis demonstrates how the SAR team function within a distributed perceptual cycle whereby the actions of one team member become world information for another team member. Advancements to the EAST method are proposed and the implications of the research are discussed.Practitioner Summary: This paper explores the perceptual cycle interactions of SAR crews using a novel EAST approach. The analysis demonstrates how the crew function as a distributed cognitive unit and applications in terms of training and design are discussed.

The Application of a Systems Thinking Design Toolkit to Improve Situation Awareness and Safety at Road Intersections

Incompatibility in situation awareness at intersections has been identified as playing a role in road crashes. One of the key factors underpinning these incompatibilities is the design of the road environment. In this study, findings from the analysis of road user situation awareness using schema theory, event analysis of systemic teamwork and cognitive work analysis were used within a participatory design process involving the Cognitive Work Analysis Design Toolkit (CWA-DT) to generate new design concepts. This paper provides a summary of the design process and outcomes as well as findings from an evaluation of the CWA-DT based on participants’ subjective experience of the process.