Task Analysis Methods Research Articles

Extension of TACOM to the complexity of tasks designed for abnormal situations in nuclear power plants

TACOM (TAsk COMplexity) is a measure for evaluating the complexity of tasks prescribed for emergency situations in nuclear power plants. Five sub-measures constituting TACOM represent five different aspects of the task complexity exhibited in operating procedures for emergency situations. The practicality of TACOM has been verified through a series of empirical studies. However, tasks designed for abnormal situations that can significantly affect the safety of nuclear power plants, also need a proper measure for evaluating their complexity. TACOM provides a process, a systematic cognitive task analysis method and a set of guidelines to support its application. Therefore, although the characteristics of abnormal task situations are not the same as those of emergency situations, TACOM seems to be reasonably applied to abnormal situations or at least to offer meaningful insights for developing a measure for evaluating the complexity of tasks in abnormal situations. Thus this study examined the applicability of TACOM to abnormal situations through case studies. Particular attention was paid to the sufficiency and appropriateness of the three methodological tools, which are the process, the cognitive task analysis method and the set of guidelines. Collective consideration of the case studies and the characteristics of tasks prescribed for abnormal situations led us to draw the conclusion that TACOM could be reliably used for abnormal situations as well. This paper reports the process of how to apply TACOM to the tasks of abnormal situations and discusses some lessons learned through this application.

Effect of a Simulation Educational Intervention on Knowledge, Attitude, and Patient Transfer Skills

Musculoskeletal injury in the workplace is the primary work-related factor in loss of nursing personnel from the workforce. Moving or transferring patients is the dominant contributing event. A simulation educational approach has not been closely studied in this area but may have advantages over traditional approaches. Specific aims were to (1) evaluate the effect of a simulation intervention on success of patient transfers in a clinical setting and (2) measure change in participants' knowledge and attitude as a result of the intervention. A prospective, observational, longitudinal design was used. Baseline patient transfer observations were conducted on control and intervention units. An optimum task set was developed using hierarchical task analysis methods. Subjects (N = 71) completed pre- and postintervention knowledge and attitude assessments. The intervention consisted of simulated patient transfers using a mannequin, education, and training, followed by repeated simulated transfers using a mannequin with debriefing. Observations of patient transfers in patient care areas were repeated at 4 and 12 weeks. Patient transfer success improved from 66% at baseline to 88% at the 4-week measurement point (t = 7.447, P ≤ 0.0004). At 12 weeks, transfer success had decreased to 71%, with addition of new employees between weeks 4 and 12 confounding the 12-week measurement. Knowledge improved from a baseline of 65% to 95% postsimulation intervention (z = -6.634, P ≤ 0.0004). Attitude change was also evaluated with significance seen with 12 of 15 items (P ≤ 0.05). A simulation intervention was successful in significantly improving knowledge and changing subject perceptions with regard to this task. Skills acquired through simulation successfully transferred to the clinical setting. Improvement in success for patient moves not trained in the simulation laboratory suggests that acquired skills were generalizable and supports application to different settings.

職務分析・課題分析の活用可能性への考察 大手小売店における知的障害者雇用事例から

職務分析・課題分析の活用可能性への考察 大手小売店における知的障害者雇用事例から

Eliciting and modelling expertise for serious games in project management

Without achieving a clear understanding of the learning domain, it is difficult to develop a successful serious game that enables users to achieve the desired learning outcomes. Thus, the first step in serious game design is to establish an understanding of the particular learning domain, usually through consultation with domain experts. Whilst game design is inherently a creative process, we believe the capturing of the knowledge domain can be systematised and we present a structured approach to knowledge elicitation and representation as a basis for serious game design. We have adapted and extended the applied cognitive task analysis (ACTA) method and have combined it with additional knowledge representation frameworks. We explain how the outputs of this approach can inform the game mechanic and the development of non-player characters, and apply it to the design of a serious game aimed at reducing time-to-competence in soft project management skills for professionals working in corporate environments. A total of 26 domain experts from five different countries were involved in a two-stage interview process. The interviews yielded more than 300 task elements, and information about the cognition underlying the more challenging tasks. This data was incorporated into several representation frameworks and used to indicate features to be implemented in the game and the game mechanics of the supported features.

Extending hierarchical task analysis to identify cognitive demands and information design requirements

While hierarchical task analysis (HTA) is well established as a general task analysis method, there appears a need to make more explicit both the cognitive elements of a task and design requirements that arise from an analysis. One way of achieving this is to make use of extensions to the standard HTA. The aim of the current study is to evaluate the use of two such extensions – the sub-goal template (SGT) and the skills–rules–knowledge (SRK) framework – to analyse the cognitive activity that takes place during the planning and delivery of anaesthesia. In quantitative terms, the two methods were found to have relatively poor inter-rater reliability; however, qualitative evidence suggests that the two methods were nevertheless of value in generating insights about anaesthetists’ information handling and cognitive performance. Implications for the use of an extended HTA to analyse work systems are discussed.

Bridging the gap between Human — Automation Interface Analysis and Flight Deck Design Guidance

Next generation aviation operations will place a much greater dependence on automation usage, and therefore additional emphasis needs to be placed on the evaluation of human automation interaction in the design and evaluation of these systems. Additionally, new airworthiness regulations and regulatory certification processes are beginning to focus on the design and verification testing of the pilot-automation interaction. Current human computer interaction analyses (computational human performance models and task analysis methods) are not effectively usable within the constrained timeline of real world design and certification processes. Fundamental and theoretical work is needed to develop methods and tools that will provide designers and regulators with the means of testing and providing useful feedback about the efficacy of these interactions.

Assessing performance of an Electronic Health Record (EHR) using Cognitive Task Analysis

Background Many Electronic Health Record (EHR) systems fail to provide user-friendly interfaces due to the lack of systematic consideration of human-centered computing issues. Such interfaces can be improved to provide easy to use, easy to learn, and error-resistant EHR systems to the users. Objective To evaluate the usability of an EHR system and suggest areas of improvement in the user interface. Methods The user interface of the AHLTA (Armed Forces Health Longitudinal Technology Application) was analyzed using the Cognitive Task Analysis (CTA) method called GOMS (Goals, Operators, Methods, and Selection rules) and an associated technique called KLM (Keystroke Level Model). The GOMS method was used to evaluate the AHLTA user interface by classifying each step of a given task into Mental (Internal) or Physical (External) operators. This analysis was performed by two analysts independently and the inter-rater reliability was computed to verify the reliability of the GOMS method. Further evaluation was performed using KLM to estimate the execution time required to perform the given task through application of its standard set of operators. Results The results are based on the analysis of 14 prototypical tasks performed by AHLTA users. The results show that on average a user needs to go through 106 steps to complete a task. To perform all 14 tasks, they would spend about 22 min (independent of system response time) for data entry, of which 11 min are spent on more effortful mental operators. The inter-rater reliability analysis performed for all 14 tasks was 0.8 (kappa), indicating good reliability of the method. Conclusion This paper empirically reveals and identifies the following finding related to the performance of AHLTA: (1) large number of average total steps to complete common tasks, (2) high average execution time and (3) large percentage of mental operators. The user interface can be improved by reducing (a) the total number of steps and (b) the percentage of mental effort, required for the tasks.

Intra-operative decision making: More than meets the eye

Operating room teams consist of team members with diverse training backgrounds. In addition to differences in training, each team member has unique and complex decision making paths. As such, team members may function in the same environment largely unaware of their team members’ perspectives. The goal of our work was to use a theory-based approach to better understand the complexity of knowledge-based intra-operative decision making. Cognitive task analysis methods were used to extract the knowledge, thought processes, goal structures and critical decisions that provide the foundation for surgical task performance. A triangulated and iterative approach is presented.

Mesoscopic Strains Maps in Woven Composite Laminas During Off-axis Tension

The mechanics of woven carbon-fiber reinforced plastic (CFRP) composites is influenced by the complex architecture of the reinforcement phase. Computational (i.e. finite element based) approaches have been used increasingly to model not only the global laminate stiffness, but also damage evolution and laminate strength. The modeling combines the identification of the architectural unit cell (UC), the selection of suitable constitutive models of the different phases, the creation of a fine discretization of the UC in finite elements, the application of an incremental solution procedure that solves iteratively for the stresses and strains in the UC, [1].The experimental validation of computational models is carried out mainly at the macroscopical level, i.e. simulation of the macroscopic stress-strain curve. Damage, however, is a localized, straindependent phenomenon and therefore only accurate strain distribution within the UC (at the mesolevel) can identify critical conditions in terms of damage location, extension and evolution.The validation of computational damage procedures is a key task and full-field optical strain analysis methods appear the ideal instrument. However, only limited examples of direct finte element method (FEM) vs experimental strain correlation are found because of the limited sensitivity and spatial resolution of some techniques and the complexity and applicative difficulty of others.The aim of the present paper is to present the application of the digital image correlation (DIC) technique, [2], to the full-field strain analysis at the mesoscopic level (i.e. within the UC) of a woven CFRP lamina when the direction of loading forms an angle to the material direction.The material under consideration is a woven carbon fiber reinforced epoxy composite. Orthogonal yarns, each made of of several thousand fibers, are woven according the twill-weave architecture is shown in Fig. 1a. Single-ply laminas were manufactured and tested to eliminate the random 3D influence of multiple-ply laminates and to favor computational model validation.Specimens with different loading directions with respect to the material principal directions were prepared and tested in a servo-hydraulic testing machine. Specimen surface preparation consisted in a speckle pattern generation to allow the application of the DIC tecnique. During the tensile experiment, the speckle pattern is recorded (frame rate of 0.1 picture/second) using a CCD camera equipped with a microscopic lens and adjustable light sources. In-house DIC software was used for in-plane displacement and strain determination and mapping.For brevity only the case of loading in the tow yarn direction is considered here. Fig. 1b shows a tipical strain map obtained with the DIC technique at an applied macroscopic strain of 0.9%. The strains are small but the DIC dechnique is sensitive enough and suitable filtering reduce the noise level of the strain maps. Strong local strain gradients are determined and referred to the yarn architecture in Fig. 1c. The DIC measurements were validated by averaging the strain over the field of view and comparing it with the macroscopic strain given by a high-sensitivity MTS extensometer.The mesoscopic srain data obtained with DIC are used to assess and validate parallel material model development by direct FEM vs experimental strain correlation. Fig. 2a shows the FEM model of the unit cell for the twill-weave architecture with a detail of the yarn geometry and finite element discretization. Suitable boundary conditions are applied to the UC model contours before the analysis, [1]. Fig. 2b shows and example of the comparison of the local longitudinal FEM/DIC strain distribution along a transverse line of Fig. 1c. The comparison shows the excellent correlation achieved both in terms of gradients and absolute strain values, [3].

Comparing, Merging, and Adapting Methods of Cognitive Task Analysis

Cognitive systems engineering projects have found a need for and a value in combining particular methods of cognitive task analysis (CTA). A principle reason that is given is that different CTA methods have different strengths in terms of how they inform the study, analysis or design of cognitive work systems. Focus questions include: What specific CTA methods have been combined or merged for some particular research project? What was the rationale for the selection of methods? How did researchers do the combining? Were methods actually merged into a single procedure, or were multiple methods conducted separately, what the resulting analyses or representations merged subsequently?

Comparing, Merging, and Adapting Methods of Cognitive Task Analysis

Cognitive systems engineering projects have found a need for and a value in combining particular methods of cognitive task analysis (CTA). A principle reason that is given is that different CTA methods have different strengths in terms of how they inform the study, analysis or design of cognitive work systems. Focus questions include: What specific CTA methods have been combined or merged for some particular research project? What was the rationale for the selection of methods? How did researchers do the combining? Were methods actually merged into a single procedure, or were multiple methods conducted separately, what the resulting analyses or representations merged subsequently?

Cognitive Task Analysis of Low and High Literacy Users: Experiences in Using Grounded Theory and Emergent Themes Analysis

The purpose of this paper is to describe the advantages, experiences, observations and the findings made during the use of two different qualitative data analysis approaches: Grounded Theory and Emergent Themes Analysis. The study carried out evaluated low and high literacy user information seeking behaviour characteristics of UKs “Adviceguide” website. We discuss the use of more than one Cognitive Task Analysis (CTA) method, such as process tracing, observation and interviews, can overcame limitations of each method and optimise the outcomes.

Improving outpatient safety through effective electronic communication: a study protocol

BackgroundHealth information technology and electronic medical records (EMRs) are potentially powerful systems-based interventions to facilitate diagnosis and treatment because they ensure the delivery of key new findings and other health related information to the practitioner. However, effective communication involves more than just information transfer; despite a state of the art EMR system, communication breakdowns can still occur. [1-3] In this project, we will adapt a model developed by the Systems Engineering Initiative for Patient Safety (SEIPS) to understand and improve the relationship between work systems and processes of care involved with electronic communication in EMRs. We plan to study three communication activities in the Veterans Health Administration's (VA) EMR: electronic communication of abnormal imaging and laboratory test results via automated notifications (i.e., alerts); electronic referral requests; and provider-to-pharmacy communication via computerized provider order entry (CPOE).AimOur specific aim is to propose a protocol to evaluate the systems and processes affecting outcomes of electronic communication in the computerized patient record system (related to diagnostic test results, electronic referral requests, and CPOE prescriptions) using a human factors engineering approach, and hence guide the development of interventions for work system redesign.DesignThis research will consist of multiple qualitative methods of task analysis to identify potential sources of error related to diagnostic test result alerts, electronic referral requests, and CPOE; this will be followed by a series of focus groups to identify barriers, facilitators, and suggestions for improving the electronic communication system. Transcripts from all task analyses and focus groups will be analyzed using methods adapted from grounded theory and content analysis.

Example of a Human Factors Engineering approach to a medication administration work system: Potential impact on patient safety

Objective The objectives of this paper are: 1. To describe a Human Factors Engineering (HFE) approach to a medication administration work system, in the context of a hospital medication Computerized Provider Order Entry (CPOE) project. 2. To identify the determinants of this work system potentially impacting both the efficiency and the safety of the medication use process. In this approach, the implementation of such a complex IT solution is considered a major redesign of the work system. The paper describes the Human Factor (HF) tasks embedded in the project lifecycle: (1) analysis and modelling of the current work system and usability assessment of the medication CPOE solution; (2) HF recommendations for work re-design and usability recommendations for IT system re-engineering both aiming at a safer and more efficient work situation. Methods Standard ethnographic methods were used to support the analysis of the current work system and work situations, coupled with cognitive task analysis methods and documents review. Usability inspection (heuristic evaluation) and both in-lab (simulated tasks) and on-site (real tasks) usability tests were performed for the evaluation of the CPOE candidate. Adapted software engineering models were used in combination with usual textual descriptions, tasks models and mock-ups to support the recommendations for work and product re-design. Results The analysis of the work situations identified different work organisations and procedures across the hospital's departments. The most important differences concerned the doctor–nurse communications and cooperation modes and the procedures for preparing and administering the medications. The assessment of the medication CPOE functions uncovered a number of usability problems including severe ones leading to impossible to detect or to catch errors. Models of the actual and possible distribution of tasks and roles were used to support decision making in the work design process. The results of the usability assessment were translated into requirements to support the necessary re-engineering of the IT application. Conclusion The HFE approach to medication CPOE efficiently identifies and distinguishes currently unsafe or uncomfortable work situations that could obviously benefit from an IT solution from other work situations incorporating efficient work procedures that might be impaired by the implementation of the CPOE. In this context, a careful redesign of the work situation and of the entire work system is necessary to actually benefit from the installation of the product in terms of patient safety and human performances. In parallel, a usability assessment of the product to be implemented is mandatory to identify potentially dangerous usability flaws and to fix them before the installation.

A method to fuse fMRI tasks through spatial correlations: applied to schizophrenia.

Single task analysis methods of functional MRI brain data, though useful, are not able to evaluate the joint information between tasks. Data fusion of multiple tasks that probe different cognitive processes provides knowledge of the joint information and may be important in order to better understand complex disorders such as schizophrenia. In this article, we introduce a simple but effective technique to fuse two tasks by computing the histogram of correlations for all possible combinations of whole brain voxels. The approach was applied to data derived from healthy controls and patients with schizophrenia from four different tasks, auditory oddball (target), auditory oddball (novel), Sternberg working memory, and sensorimotor. It was found that in four out of six task combinations patients' intertask correlations were more positively correlated than controls', in one combination the controls showed more positive correlations and in another there was no significant difference. The robustness of this result was checked with several testing techniques. The four task combinations for which patients had more positive correlation occurred at different scanning sessions and the task combination that showed the opposite result occurred within the same scanning session. Brain regions that showed high intertask correlations were found for both groups and regions that correlated differently between the two groups were identified. The approach introduced finds interesting results and new differential features that cannot be achieved through traditional methods.

Comparative Analysis of Infrastructure Assessment Methodologies at the Small Unit Level

This paper presents a comparative analysis of three different infrastructure assessment tools currently used by the U.S. Army’s combat engineer small units (squad, platoon, company). The infrastructure assessment tools included one pen and paper checklist and two software-based tools based on specialized handheld hardware for data collection in combat conditions. Evaluation was conducted using macroergonomic and applied cognitive task analysis methods with soldiers of varying levels of infrastructure assessment expertise. Each assessment method was evaluated based on performance (time, errors, and accuracy) and usability (ergonomic and cognitive challenges). We found that soldiers documented more accurate data using handheld digital devices instead of pen-and-paper assessment forms, but there was little difference in time between the methods. Contrary to initial expectation, we also found that most soldiers prefer a slightly more difficult to use handheld assessment device with customized checklists rathe...

Collaborating With Physicians to Redesign a Sign-Out Tool

Physician sign-out is a mechanism for transferring patient information from one group of hospital care-givers to another at shift changes. Support tools are critical to the success of sign-out. To ensure that a tool is effective, designers must collaborate with end users, but collaboration can be difficult when working with users who are busy and have irregular schedules. In this article, we report on a collaborative effort between physicians and engineers to redesign a sign-out support tool. Strategies included focus groups, interviews, "on-the-fly" feedback, and an iterative design process, which engaged end users in the design process. Task analysis methods enabled us to quantify the differences in functionality between the original tool and the prototype.

Software operation time evaluation based on MTM

Many usability approaches have been devised to enable software developers to evaluate and improve user interfaces. Techniques have been focused on design recommendations not always supported by empirical evidences. However, in different environments based on Internet/web browser access, software applications are the support for repetitive tasks (in many cases supporting industrial or engineering processes, e.g. hosted in Intranets) where operation time and learning curve are important items to be controlled. In this paper, a new method for measuring required operation time as basis for improving interaction and interface design is presented. The basis of the method has been inspired on the adaptation of the well-known MTM method for time measurement and task analysis in industrial environments. Empirical evidences support the relationship between the proposed measure and the time required for operations by software users.

The Use of Task Analysis Procedures by Instructional Designers

The purpose of this study was to learn about the use of task analysis procedures by instructional designers. Task analysis is regarded by many to be the most integral part of the instructional design process and the most technical aspect of the instructional designer's job. It is also thought to be the most ambiguous of the instructional design, processes. A questionnaire was developed that surveyed 164 members of the International Society for Performance Improvement (ISPI) and the Association for Educational Communications and Technology (AECT) with instructional design responsibilities. This research learned what instructional design activities designers associate with task analysis and the percentage of time instructional designers devote to task analysis. It also learned what task analysis methods are most and least often used by instructional designers and identified those task analysis methods not known by instructional designers. Finally, this study determined how instructional designers learn to conduct task analyses and the factors that impact task analysis practices.

AN APPROACH FOR HUMAN ERROR MODES AND EFFECTS ANALYSIS USING HTA+ETA

A framework for human error modes and effects analysis is presented. The methods of hierarchical task analysis and event tree analysis are introduced as the basic analytical tools, and a novel generic framework for human errors classification is presented as the guidance to identify human errors. Firstly, the process of human error modes and effects analysis is discussed, and the hierarchical task analysis method is introduced briefly. Secondly, the framework for human errors classification is discussed in detail. Thirdly, the multi-states event tree is designed to model the accident scenario. Finally, two scenarios are selected as the examples to illustrate the proposed process of human error modes and effects analysis.