Principles Of Ecological Interface Design Research Articles

Decision Support for Flexible Manufacturing Systems: Application of the Cognitive Systems Engineering and Ecological Interface Design Approach

We applied the cognitive systems engineering (CSE)/ecological interface design (EID) approach to the work domain of flexible manufacturing systems (FMS). Work domain analyses (WDA) and activity analyses were conducted. Previous concerns regarding the suitability of CSE for FMS are addressed. Principles of EID (i.e., direct perception, direct manipulation, and visual momentum) were applied in designing an ecological interface for a flexible manufacturing system (EcoFlex). The critical links between the products of a WDA and the content of an ecological interface (a key innovation of EID) are made explicit. The evaluations of this interface were very positive across a wide variety of traditional and novel dependent variables (please see the companion manuscript). The overall success of this research program clearly demonstrates that the CSE/EID approach is capable of being applied to FMS. Contributions of this manuscript include both theoretical insights (defining properties of the FMS work domain, concrete examples of the principles of EID, critical links between CSE and EID, resolution of concerns about the overall framework) and practical applications (specific design solutions for FMS and similar work domains, and successful examples of the CSE/EID approach which can be studied and leveraged by students).

Decision Support for Flexible Manufacturing Systems: The Evaluation of an Ecological Interface and Principles of Ecological Interface Design

The cognitive systems engineering (CSE)/ecological interface design (EID) approach was applied in developing decision support for the flexible manufacturing system (FMS) work domain. Four interfaces were designed via the factorial application/non-application of direct perception (DP) and direct manipulation (DM). The capability of these interfaces to support performance in a simulated FMS was evaluated using a variety of traditional and novel dependent variables. The ecological interface (with DP, DM and an intact perception-action loop) provided clearly superior decision support (32 favorable significant results) relative to the other three interfaces (a combined total of 28 favorable significant results). The novel dependent variables were very sensitive. The results are interpreted from three different perspectives: traditional EID, the quality of constraint matching between triadic system components and closed-loop, dynamical control systems. The rationale for an expanded theoretical framework which complements, but does not replace, the original principles of CSE/EID is discussed. The potential for both specific interface features and novel dependent variables to generalize to real-world FMS applications is addressed. The expanded theoretical framework is universally relevant for the development of decision making and problem solving support in all computer-mediated work domains.

Novel Display Design for Spatial Assessment in Virtual Environments

In this work in progress paper, we share novel conceptual display design ideas (pending validation and testing) to aid users with their spatial assessment in either two or three-dimensional spaces such as Virtual Reality (VR) environments. The example scenario used is to help a remote human team player (2nd user) to work with an asset Unmanned Aerial Vehicle (UAV) and human team player (1st user) in the field. The scenario’s goal is to deliver relief packages (i.e., medical, clothing, and food supplies) at a fixed location in an urban and hostile terrain containing adversary UAV and their human team players. Inspired by the Lens theory and Ecological Interface Design principles, the proposed display design ideas allow the user to retain past and present asset and adversary location information whilst knowing when the adversary was too close to assets and civilians and the precision of display views based on the number of sensors available.

Defining information needs in neonatal resuscitation with work domain analysis.

To gain a deeper understanding of the information requirements of clinicians conducting neonatal resuscitation in the first 10 min after birth. During the resuscitation of a newborn infant in the first minutes after birth, clinicians must monitor crucial physiological adjustments that are relatively unobservable, unpredictable, and highly variable. Clinicians' access to information regarding the physiological status of the infant is also crucial to determining which interventions are most appropriate. To design displays to support clinicians during newborn resuscitation, we must first carefully consider the information requirements. We conducted a work domain analysis (WDA) for the neonatal transition in the first 10 min after birth. We split the work domain into two 'subdomains'; the physiology of the neonatal transition, and the clinical resources supporting the neonatal transition. A WDA can reveal information requirements that are not yet supported by resources. The physiological WDA acted as a conceptual tool to model the exact processes and functions that clinicians must monitor and potentially support during the neonatal transition. Importantly, the clinical resources WDA revealed several capabilities and limitations of the physical objects in the work domain-ultimately revealing which physiological functions currently have no existing sensor to provide clinicians with information regarding their status. We propose two potential approaches to improving the clinician's information environment: (1) developing new sensors for the information we lack, and (2) employing principles of ecological interface design to present currently available information to the clinician in a more effective way.

Visualizing distances as a function of speed: Design and evaluation of a distance-speedometer

This paper contributes to the research on transportation and human factors by designing and evaluating an ecological human-machine interface for speed and distance control. In the future, traffic management will determine optima for speed and safety distances. Wirelessly broadcasted, the question remains how to present this information to drivers in a way that is easily understood and intuitively followed. To this end, a human-machine interface, called distance-speedometer, was first developed according to the principles of ecological interface design and then evaluated in a driving simulator study with forty-nine participants. It presents augmented distances derived from speed in a head-up display. Using a within-subject design, the distance-speedometer and standard speedometer were compared against each other in two scenarios (car-following & sign-following). Each scenario triggered several speed changes. When reacting to speed signs, driving performance did not differ between the two interfaces. However, with the distance-speedometer, visual workload was reduced as more secondary tasks could be completed. When reacting to speed changes of a car ahead, the engagement in the secondary task did not differ significantly between the two interfaces. However, the variance of speed deviations was significantly lower with the distance-speedometer. Results can be explained by the ability to process the distance-speedometer in a skill-based manner, whereas the normal speedometer demands rule-based behaviour to control the speed. With regard to traffic management, the distance-speedometer might be used to unconsciously influence the driver’s choice of speed in order to increase traffic safety and efficiency.

Ecological Interface Design for Computer Network Defense.

A prototype ecological interface for computer network defense (CND) was developed. Concerns about CND run high. Although there is a vast literature on CND, there is some indication that this research is not being translated into operational contexts. Part of the reason may be that CND has historically been treated as a strictly technical problem, rather than as a socio-technical problem. The cognitive systems engineering (CSE)/ecological interface design (EID) framework was used in the analysis and design of the prototype interface. A brief overview of CSE/EID is provided. EID principles of design (i.e., direct perception, direct manipulation and visual momentum) are described and illustrated through concrete examples from the ecological interface. Key features of the ecological interface include (a) a wide variety of alternative visual displays, (b) controls that allow easy, dynamic reconfiguration of these displays, (c) visual highlighting of functionally related information across displays, (d) control mechanisms to selectively filter massive data sets, and (e) the capability for easy expansion. Cyber attacks from a well-known data set are illustrated through screen shots. CND support needs to be developed with a triadic focus (i.e., humans interacting with technology to accomplish work) if it is to be effective. Iterative design and formal evaluation is also required. The discipline of human factors has a long tradition of success on both counts; it is time that HF became fully involved in CND. Direct application in supporting cyber analysts.

Applying Ecological Interface Design principles to the design of rural highway-rail grade crossing infrastructure

Countries such as Australia and USA have many rail level crossings (a.k.a. highway-rail grade crossings) with limited protection (e.g., static signs only or flashing lights but no physical barriers). Lower cost design solutions are required as upgrading crossings using current infrastructure treatments is cost-prohibitive. Here we applied Ecological Interface Design (EID) principles to develop a novel rail level crossing design for high-speed rural roads, and then evaluated the design via two driving simulator studies. Experiment 1 provided an initial concept evaluation of the crossing, then Experiment 2 evaluated the crossing in safetycritical situations, including when a distractor was present and when crossing infrastructure was damaged through vandalism. Driving performance, subjective workload, and usability were compared against existing rural crossing designs. Findings suggest the EID crossing provides a feasible alternative to existing designs, with the potential to encourage safer decision-making by road users and thus reduce collisions.

Keeping the Lights On Across the Continent

Operators need new visualizations to help them monitor increasingly complex power grids at wider geographical scopes. We developed a work domain analysis of power grid operations from interviews, focus groups, and observations. The work domain analysis helped determine information requirements for a wide-area monitoring design concept that follows ecological interface design principles. We validated the design concept in a usability evaluation, achieving an above-benchmark System Usability Scale score of 77 out of 90. This work domain analysis and ecological interface design process will equally apply to the design of other power grid monitoring displays.

Emergent features and perceptual objects: re-examining fundamental principles in analogical display design

Two sets of design principles for analogical visual displays, based on the concepts of emergent features and perceptual objects, are described. An interpretation of previous empirical findings for three displays (bar graph, polar graphic, alphanumeric) is provided from both perspectives. A fourth display (configural coordinate) was designed using principles of ecological interface design (i.e. direct perception). An experiment was conducted to evaluate performance (accuracy and latency of state identification) with these four displays. Numerous significant effects were obtained and a clear rank ordering of performance emerged (from best to worst): configural coordinate, bar graph, alphanumeric and polar graphic. These findings are consistent with principles of design based on emergent features; they are inconsistent with principles based on perceptual objects. Some limitations of the configural coordinate display are discussed and a redesign is provided.

Veils

This paper briefly describes a prototype interface for computer network defense (CND) that has been developed using the cognitive systems engineering (CSE) / ecological interface design (EID) framework. This ecological interface is referred to as VEILS (Versatile Ecological Interface for Lockdown network Security). VEILS supports CND by collecting and integrating network defense information from a variety of sources including intruder detection / protection systems, firewalls, and system logs. VEILS was designed to be consistent with three principles of EID. The innovative displays represent the affordances of the work domain in a manner that is compatible with human visual processes (i.e., direct perception). The capability to specify both information content (different types) and information extent (scope) is supported entirely through intuitive and natural control input including point, click, and drag (i.e., direct manipulation). Finally, interface resources are used to choose alternative viewing perspectives, to highlight functional relationships across displays and to support effective navigation (i.e., visual momentum).

A Cognitive Modeling Approach to Decision Support Tool Design for Anesthesia Provider Crisis Management

Prior research has revealed existing operating room (OR) patient monitors to provide limited support for prompt and accurate decision making by anesthesia providers during crises. Decision support tools (DSTs) developed for this purpose typically alert the anesthesia provider to existence of a problem but do not recommend a treatment plan. There is a need for a human-centered approach to the design and development of a crisis management DST. A hierarchical task analysis was conducted to identify anesthesia provider procedures in detecting, diagnosing, and treating a critical incident and a cognitive task analysis to elicit goals, decisions, and information requirements. This information was coded in a computational cognitive model using GOMS (Goals, Operators, Methods, Selection rules) Language. An OR monitor interface was prototyped to present output from the cognitive model following ecological interface design principles. A preliminary assessment of the DST was performed with anesthesiology and usability experts. The anesthesiologists indicated they would use the tool in the perioperative environment and would recommend its use by junior anesthesia providers. Future research will focus on formal validation of the DST design approach and comparison of tool output to actual anesthesia provider decisions in real or simulated crises.

Improving information recognition and performance of recycling chimneys

The aim of this study was to assess and improve how recyclers (individuals carrying out the task of recycling) make use of visual cues to carryout recycling tasks in relation to ‘recycling chimneys’ (repositories for recycled waste). An initial task analysis was conducted through an activity sampling study and an eye tracking experiment using a mobile eye tracker to capture fixations of recyclers during recycling tasks. Following data collection using the eye tracker, a set of recommendations for improving information representation were then identified using the widely researched skills, rules, knowledge framework, and for a comparative study to assess the performance of improved interfaces for recycling chimneys based on Ecological Interface Design principles. Practitioner Summary: Information representation on recycling chimneys determines how we recycle waste. This study describes an eco-ergonomics-based approach to improve the design of interfaces for recycling chimneys. The results are valuable for improving the performance of waste collection processes in terms of minimising contamination and increasing the quantity of recyclables.

Ecological Interface Design for Teaching Assembly Operations to Industrial Robot

This study analyzes the work domain of position teaching in terms of means-end relations for the purpose of developing a practical support tool for human workers engaged in industrial robot teaching. A mechanical explanation model is introduced into the analysis to capture the force-displacement relationship inherent in and informative on the work system. The resulting models are used for the analysis of the robot operators’ decisions in search of accurate operation positions, and this in turn helps to clarify a rational operation strategy for making use of an invariant frame of reference in the position search space. After these findings, a prototype GUI is proposed that can provide effective information supports for different granularities of the activity in position teaching. Based on the principles of Ecological Interface Design, the proposed GUI represents the activity-related information in a way that encourages the robot operators’ intuitive and strategic operations.

Ecological Interface Design for Military Command and Control

The authors use the cognitive systems engineering framework to design and evaluate an interface for military command and control. They discuss analytic tools and principles of this framework and provide concrete examples (e.g., work domain analyses for U.S. Army tactical operations at the battalion level). They also discuss principles of ecological interface design, including direct perception, direct manipulation, and the perception-action loop. The translation between work domain analyses and the specific characteristics of the interface are made explicit. The authors describe the potential for this interface to support effective decision making and problem solving, including links with naturalistic decision-making approaches. Evaluations of the interface have been positive and are described briefly. Actual or potential applications of this research include both specific interface design strategies for military command and control and general interface design principles for this category of work domain.

Extending Ecological Interface Design principles: A manufacturing case study

Identifying information requirements is a well-understood activity, but the practice of converting data into visual form based on these requirements is less defined. The Ecological Interface Design (EID) framework attempts to bridge this design gap by offering a set of visual design principles. While these principles supply high-level goals to be achieved by the display, they do not describe the design process per se. EID case studies tend to report the work domain analysis, the design solution and the relationship between these two artefacts. Unfortunately, the presentation of a final solution does not reveal the rationale for decisions made during the design process. This, coupled with the complexity of the systems involved, can make it difficult to transfer design knowledge to other work domains. Here a methodology is proposed to guide the design of visual interface components that make up an ecological display. A structured approach for matching requirements to visual form based on work domain analysis, task analysis, scale matching, and data transformations is presented. A case study reveals the rationale behind the redesign of a process control health reporting system using this methodology.

Extending clinical information systems design in the ICU

Miller and Sanderson (2003b) presented promising results for a prototype clinical information design developed according to Ecological Interface Design principles, but the size of the prototype made it impractical for onscreen display. This paper replicates the previous study using an onscreen presentation of the original EID divided according to functional systems. As in the original study, nurses' ability to detect patient change events was enhanced using the onscreen EID. However, there are differences between doctors' performance using the original and using the onscreen EID. Unlike the original participants, doctors were better able to agree about physiological systems failure, but also unlike the original participants, showed no significant differences in their ability to agree about the patients' current diagnostic state using the onscreen EID or conventional charts. This later ability is clinically more important. It was concluded that while dividing the original EID had no appreciable effect on nurses and enhanced some abilities among doctors, this was at the expense of more clinically significant abilities. It may be necessary to rethink the appropriateness of limited real-estate, office style computer terminals in intensive care units.

Designing for Attention With Sound: Challenges and Extensions to Ecological Interface Design

We explore whether ecological interface design (EID) principles can be applied to the design of an auditory display for anesthesia monitoring. EID examples focus almost exclusively on visual displays. In the anesthesia work environment, however, auditory displays may provide better individual and team awareness of patient state. Using a work domain analysis of physiological monitoring in anesthesia, we identify information to display. Using the skills, rules, and knowledge distinction we identify cognitive control needed. Using semantic mapping we map physiological variables and constraints to auditory dimensions. EID principles do not address when information should be displayed and to whom. An attentional mapping stage helps to specify answers to these questions so that a workable auditory display for anesthesia monitoring is achieved. EID principles of representing work domain functional structure and minimizing resource-demanding cognitive control are necessary but insufficient to specify requirements for an effective auditory display. Also needed are analyses of control tasks, strategies, and the social organization of work. Such analyses are an integral part of the broader cognitive work analysis framework from which EID emerged. Actual or potential uses of this research include the design of displays that support continuous peripheral awareness in collaborative multimodal work environments.

Design of a Cognitive Model-Based Decision Support Tool for Anesthesiology Crisis Management

A decision support tool was developed for use by anesthesia providers in crisis situations. The tool alerts anesthetists to a developing crisis, manifested by changes in patient physiological variables, and provides them with a list of preventive measures for dealing with the crisis. A novel approach to the design of the tool was defined, including: (1) performing a hierarchical task analysis to identify anesthetist procedures in detecting, diagnosing and treating a critical incident; (2) carrying out a cognitive task analysis to elicit goals, decisions, and information requirements of anesthetists during crisis management procedures; (3) coding of natural language information recorded in the task analyses in a computational GOMS (goals, operators, methods, selection rules) cognitive model; and (4) prototyping an interface to present output from the cognitive model using ecological interface design principles. A preliminary validation of the tool and interface was performed with anesthesiology and usability experts.

Aiding planning in air traffic control: an experimental investigation of the effects of perceptual information integration.

Prior research examined how controllers plan in their traditional environment and identified various information uncertainties as detriments to planning. A planning aid was designed to reduce this uncertainty by perceptually representing important constraints. This included integrating spatial information on the radar screen with discrete information (planned sequences of air traffic). Previous research reported improved planning performance and decreased workload in the planning aid condition. The purpose of this paper was to determine the source of these performance improvements. Analysis of computer interactions using log-linear modeling showed that the planning interface led to less repetitive--but more integrated--information retrieval compared with the traditional planning environment. Ecological interface design principles helped explain how the integrated information retrieval gave rise to the performance improvements. Actual or potential applications of this research include the design and evaluation of interface automation that keeps users in active control by modification of perceptual task characteristics.

Work domain analysis and sensors II: pasteurizer II case study

In this paper we use sensor-annotated abstraction hierarchies (Reising & Sanderson, 1996, 2002a, b) to show that unless appropriately instrumented, configural displays designed according to the principles of ecological interface design (EID) might be vulnerable to misinterpretation when sensors become unreliable or are unavailable. Building on foundations established in Reising and Sanderson (2002a) we use a pasteurization process control example to show how sensor-annotated AHs help the analyst determine the impact of different instrumentation engineering policies on a configural display that is part of an ecological interface. Our analyses suggest that configural displays showing higher-order properties of a system are especially vulnerable under some conservative instrumentation configurations. However, sensor-annotated AHs can be used to indicate where corrective instrumentation might be placed. We argue that if EID is to be effectively employed in the design of displays for complex systems, then the information needs of the human operator need to be considered while instrumentation requirements are being formulated. Rasmussen's abstraction hierarchy--and particularly its extension to the analysis of information captured by sensors and derived from sensors--may therefore be a useful adjunct to upstream instrumentation design.