Human Factors Evaluation Research Articles

Worker-centered evaluation and redesign of manufacturing tasks for ergonomics improvement using axiomatic design principles

Humans are considered the most valuable resource in manufacturing systems thanks to their craftsmanship, dexterity, and autonomy significantly affecting productivity, quality, and the overall company competitiveness. This paper introduces the SAGE (Systematic Approach to Generating Ergonomic Manufacturing tasks) methodology, a structured approach based on Axiomatic Design principles to integrate Human Factors evaluation early in the operations design phase and redesign manufacturing tasks to improve operators well-being. The primary objective is to mitigate discomfort and safety risks that often lead to musculoskeletal disorders, absenteeism, and production delays. SAGE provides a comprehensive framework for assessing ergonomic aspects of manufacturing tasks and identifying the need for redesign. It offers a detailed set of Functional Requirements (FRs) for reference, assesses FR satisfaction, evaluates task complexity using the Independence Axiom, and examines the intensity of FR satisfaction through the Information Axiom. The methodology includes specific implementation guidelines, ensuring its applicability across diverse manufacturing contexts. Its effectiveness is demonstrated through a large-scale parts assembly case study inspired by the bus and coach industrial sector, where a production engineer evaluated a windows assembly task and identified ergonomic design interventions. A comparative analysis with other relevant methods is finally presented, highlighting the approach's effectiveness.

Multi-Stage Evaluation Using GONUKE

Multi-stage validation (MSV) has become an important concept in nuclear power plant control room design and modernization. MSV consists of multiple stages of collecting evidence that establish reasonable confidence in the design. The Guideline for Operational Nuclear Usability and Knowledge Elicitation (GONUKE) was created as a framework to support different types of human factors evaluations across different stages of the design and development life cycle. The GONUKE framework did not originally address MSV, but it espoused safety case approaches that build different evidences toward design completion, which is a complementary approach to MSV. In this paper, we show how GONUKE specifically aligns to MSV. We then expand the discussion to include multi-stage evaluation. As defined in GONUKE, there are three types of evaluation. Validation is empirical evidence collected through human-in-the-loop studies, whereas verification is expert comparison of a design against formalized standards, and epistemiation is expert knowledge transfer to design.

Designing a Data Dashboard for Health Departments and Overdose Fatality Review Teams

IntroductionOverdose Fatality Review (OFR) teams within health departments rely on data from multiple isolated sources to study the opioid crisis. Recently, we linked electronic health record data with state agency data to form a regional Substance Misuse Data Commons (SMDC) using privacy-preserving record linkage. Our goal in this study was to use human factors design principles to design a data dashboard for OFR teams using the linked datasets that will overcome current barriers within OFR workflows. MethodsWe utilized NASA task load surveys, semi-structured interviews, and design sessions with end users to identify data needs for an optimal dashboard design. We assessed current workloads, data collection processes, and desired future state. We subsequently performed iterative design sessions for the generation and evaluation of low-fidelity prototypes. To overcome issues with privacy and security, we used synthetic data in a cloud-based platform to represent the SMDC for simulation. ResultsEleven OFR organizers participated. Pre-dashboard surveys on existing workflow showed high mental workload associated with data aggregation and case review, identifying a need for more accessible, comprehensive data. In our low-fidelity dashboard demo with synthetic data, iterative design adjustments were made in data visualization, storyline organizations, and theme-based data aggregation across pre-hospital and hospital data. ConclusionsWe refined the data dashboard prototype into a high-fidelity version, set for further usability and human factors evaluation. We addressed privacy and security concerns through synthetic data use while the real-world data is maintained in a HIPAA-secure Azure cloud environment with access for approved users.

A proposed framework for data-driven human factors evaluation

AbstractHuman-centred approaches within the design cycle are crucial to enhance usability and inclusivity of products. However, the qualitative nature of traditional human factors evaluation can create bottle necks, prompting the need for more data driven methods. A framework for data-driven human factors is presented, looking to integrate mixed-method approaches. Case studies illustrate its usage in real-world scenarios and challenges are summarised, calling for robust data collection methods, balancing of mixed methods, a need for explainable systems, and interdisciplinary expertise.

In-situ ergonomics assessment of industrial manual tasks through AR-headset integrated sensor-systems

This paper presents an approach that is based on the use of sensors integrated into Augmented Reality (AR) headsets to acquire data for in-situ ergonomics assessment of industrial tasks. In the context of human factors evaluation, it is typically required to collect data related to anthropometric characteristics of the operators e.g. height, length of arms, width of shoulders etc., as well as data related to the execution of manufacturing tasks including working postures, task repetition, task duration, and so forth. To this end, it is needed to develop a plug and play system to collect ergonomics data from the field. The proposed approach relies on head-mounted AR devices and their integrated RGB and Depth sensors, image and point cloud processing, and skeleton tracking techniques to calculate the required data, which are later visualized in a user-friendly interface. The proposed approach was tested in a case study where the objective was to identify the proper mechanical adjustments of an exoskeleton on the spot for comfortable fitting for each operator. Five operators participated in the testing that was held under varying lighting conditions. The solution showcased improved efficiency in decision-making compared to the commonplace procedures for skeleton fitting, faster setup time compared to typical camera-based approaches, and satisfactory performance.

Development and Human Factors Evaluation of a Portable Auditory Localization Training System.

To design and develop a Portable Auditory Localization Acclimation Training (PALAT) system capable of producing psychoacoustically accurate localization cues; evaluate the training effect against a proven full-scale, laboratory-grade system under three listening conditions; and determine if the PALAT system is sensitive to differences among electronic level-dependent hearing protection devices (HPDs). In-laboratory auditory localization training has demonstrated the ability to improve localization performance with the open (natural) ear, that is, unoccluded, and while wearing HPDs. The military requires a portable system capable of imparting similar training benefits as those demonstrated in laboratory experiments. In a full-factorial repeated measures design experiment, 12 audiometrically normal participants completed localization training and testing using an identical, optimized training protocol on two training systems under three listening conditions (open ear, TEP-100, and ComTac™ III). Statistical tests were performed on mean absolute accuracy score and front-back reversal errors. No statistical difference existed between the PALAT and laboratory-grade DRILCOM systems on two dependent localization accuracy measurements at all stages of training. In addition, the PALAT system detected the same localization performance differences among the three listening conditions. The PALAT system imparted similar training benefits as the DRILCOM system and was sensitive to HPD localization performance differences. The user-operable PALAT system and optimized training protocol can be employed by the military, law enforcement, and various industries, to improve auditory localization performance in conditions where auditory situation awareness is critical to safety.

Using a human-factors engineering approach to evaluate environmental cleaning in Veterans' Affairs acute and long-term care facilities: A qualitative analysis.

Environmental cleaning is important in the interruption of pathogen transmission. Although prevention initiatives have targeted environmental cleaning, practice variations exist and compliance is low. Evaluation of human factors influencing variations in cleaning practices can be valuable in developing interventions to standardized practices. We conducted a work-system analysis using a human-factors engineering (HFE) framework to identify barriers and facilitators to environmental cleaning practices in acute and long-term care settings within the Veterans' Affairs health system. We conducted a qualitative study with key stakeholders at 3 VA facilities. We analyzed transcripts for thematic content and mapped themes to the HFE framework. Staffing consistency was felt to improve cleaning practices and teamwork. We found that many environmental management service (EMS) staff were veterans who were motivated to serve fellow veterans, especially to prevent infections. However, hiring veterans comes with regulatory hurdles that affect staffing. Sites reported some form of monitoring their cleaning process, but there was variation in method and frequency. The EMS workload was affected by whether rooms were occupied by patients or were semiprivate rooms; both were reportedly more difficult to clean. Room design and surface finishes were identified as important to cleaning efficiency. HFE work analysis identified barriers and facilitators to environmental cleaning. These findings highlight intervention entry points that may facilitate standardized work practices. There is a need to develop task-specific procedures such as cleaning occupied beds and semiprivate rooms. Future research should evaluate interventions that address these determinants of environmental cleaning.

Augmented reality and indoor positioning based mobile production monitoring system to support workers with human-in-the-loop

With the increasing demand for product customization, the exponential increase in large-scale and small-batch production orders has yielded new challenges for the capacity of traditional production lines. Due to the information redundancy and complex production process on the production site of the factory, the traditional monitoring system is incapable of meeting the information interaction requirements between the factory management level and the executive level. Meanwhile, the traditional augmented reality (AR) based on image recognition is not suitable in the complex industrial environments. To address the gap, we propose a novel mobile production monitoring system (AIMPMs) with human-in-the-loop control by leveraging the cutting-edge AR and indoor positioning technique. In the proposed system, Ultra-wideband (UWB) and Inertial Measurement Unit (IMU) fusion indoor positioning technology is proposed, which provides accurate indoor positioning information for the production factors in the factory. Subsequently, we build the lightweight indoor map for positioning that can serve as the location reference and path planning, and a nearest-neighbor decision algorithm with double rejection decision (NN-DRD) is proposed to match the positioning features to trigger virtual monitoring information. Finally, the AIMPMs is applied in a hydraulic cylinder factory to verify its enforceability and effectiveness, and the human factors evaluation model and index system are constructed to evaluate two systems, (1) the mobile monitoring system based on positioning information, and (2) the mobile monitoring system based on image recognition, respectively. The experimental results indicate that after the application of AIMPMs, the physiological and mental fatigue of the production personnel is immensely decreased. Therefore, the system realizes a smarter and highly humanized human-machine interaction mode with human-in-the-loop control.

Human Factors Design and Evaluation of China’s Space Manipulator Teleoperation System

Space manipulators are important for the assembly, construction, operation, and maintenance of space stations. To ensure that the manipulator system on the China Space Station (CSS) is user-friendly, the human factors engineering team has carried out extensive studies on the human factors design and evaluation of the space manipulator teleoperation system from three aspects: the technical process, research on ergonomic requirements, and ergonomic evaluation. This article systematically combs the technical process and index system of the human factors design and requirements research on CSS manipulator teleoperation system, which has guided the optimization of space manipulator engineering. This article expounds the research work on ergonomic requirements and suggestions related to manipulator teleoperation through experimental research on cognitive characteristics and human factors in display and control interfaces. We focus on human factors experimental research for camera type and handle polarity, and a recommended scheme for camera display and handle polarity has been screened out accordingly. Finally, the human-in-the-loop ergonomic evaluation method is demonstrated with a cooperative manual control task. The research results have facilitated the human factors design and optimization improvement of the space manipulator manipulator system, and have contributed significantly to the safe and smooth completion of astronaut extravehicular activities on the CSS.

Identification and Evaluation of Human Factors Affecting the Operational Performance of Innovation Hubs

Abstract The research has been carried out to identify and evaluate the human factors affecting the operational performance of innovation hubs. The authors conduct a systematic review of relevant literatures and identify certain factors that found to affect the operating performance of Innovation hubs. Through a quantitative research methodology, such as a structured questionnaire, the authors gathered responses from HR experts in the form of an online survey. The survey responses were analyzed with the help of factor analysis, which helped the authors gather 2 components out of 14 survey variables. With the help of factor analysis, the authors developed a model for enhancing the operational performance of innovation hubs. The model can act as a template for further research in the field. Companies can utilize this model for enhancing the operational performances of their innovation hubs.

CARD1: Human Factors Evaluation of HeartMate 3 LVAD Peripherals: Insights gained from an Eye Tracking based Simulation Study

Background: Although left ventricular assist devices (LVADs) have demonstrated excellent clinical outcomes and design improvements over the past decade, human factors issues including limited usability and unintuitive handling continue to challenge this therapy. The aim of this study was to evaluate user experience of former LVAD patients and laypersons (LP) with the HeartMate 3 (HM3) LVAD peripherals in simulated everyday and emergency scenarios. Methods: This cross sectional, single center cohort study included former non-HM3 LVAD patients post heart transplantation (HTX) and LP without any previous LVAD peripherals handling experience. Seven predefined everyday and emergency scenarios, including battery exchanges (without alarm, in response to alarm, in dim light, within carry bag), power supply change to AC power, driveline dis- and reconnection and controller exchange were simulated. Subjects’ gaze behavior was recorded using eye tracking (ET) technology (Tobii Pro Glasses 2, Tobii Pro Lab), whereas areas of interest (AOIs) were defined for LVAD components used. Completion rate, duration to success (DTS), pump-off time, and percental fixation duration per AOI were defined as outcome measures to identify differences between initially successful and unsuccessful subjects and to correlate subject performances with demographics. Results: Thirty gender and age matched, untrained subjects (15 HTX vs. 15 LP, median age: 64 (IQR=11) vs. 63 (10) yrs., p=0.84), 20 vs. 20% female, p=1.00) completed 210 scenarios, whereas 82.9 vs. 81.9% (p=1.00) could be solved at first attempt. Changing power supply from batteries to AC power revealed highest complexity for both groups (DTS=251±93s, p=0.76): only 26.7% of subjects succeeded at first attempt (33.3% vs. 20.0%, p=0.68) and 56.7% at second attempt (66.7% vs. 46.7%, p=0.04) with significantly more LP failing. The first attempt resulted in 10 unnecessary hazards from disconnecting the driveline (5 HTX vs. 5 LP, pump-off time 2-118 s, p=0.25) and significant differences in percental fixation durations for five AOIs in participants with vs. without initial success (p<0.029, see Figure). Significantly decreased DTS during battery exchange (no alarm 32.5 (18.8)s vs. alarm 26.5 (20.8)s and dim light 21.0 (19.0)s, p<0.001, without group differences, p>0.34) indicate a high level of learnability and routine establishment. Exchanging batteries in the bag was more time consuming (75.0 (45.0) s, p=0.09), especially in elderly patients (r=0.61, p<0.001). Conclusion: This ET based human factors study provides insights into user experiences of untrained former non-HM3 LVAD patients and LP in handling HM3 peripherals in simulated everyday and emergency scenarios. It highlights unintuitive and potentially hazardous handling characteristics and provides guidance for future user centered design of LVAD wearables.

Analysing seafarer competencies in a dynamic human-machine system

Human factors have been deemed to affect a variety of unsafe acts and hazardous conditions, with no exceptions in the maritime sector. With increasing applications of automation techniques in shipping, seafarers’ roles are changing, and their competencies require to be assessed and assured for safety at sea accordingly. The studies on seafarer competencies have therefore been tightly bound with a human-machine system which consists of the interaction of seafarers and ship operational systems and sub-systems. To evaluate the seafarer competencies that fit automation systems in shipping, this paper aims to develop a new dynamic human-machine model in shipping that can be used to analyse human factors in a closed-loop system. Based on Crew Resource Management and the International Convention on Standards of Training, Certification and Watchkeeping for Seafarers, it reflects the input, process, and output phases of the human system and its interactions with machine sub-systems. A new tool to analyse seafarer competencies is proposed to rationalise human factor evaluation in the maritime closed-loop system and reflect the dynamic human-machine cooperation process. Two case studies have been conducted to illustrate the feasibility of the new model and in the meantime to investigate seafarer competencies in the dynamic human-machine system. It produces a new human factor analysis tool to investigate maritime accidents. The results and policy implications help explore the adjustment of maritime training to support ship automation and provide guidance on risk management for traditional and autonomous ships.

Human Factors Evaluation of HeartMate 3 Left Ventricular Assist Device Peripherals: An Eye Tracking Supported Simulation Study

BackgroundDespite recent design improvements, human factors issues continue to challenge left ventricular assist device (LVAD) therapy. The aim of this study was to evaluate user experience of former non-HeartMate 3 (HM3) LVAD patients post heart transplantation (HTX) and laypersons (LP) with HM3 LVAD peripherals in simulated everyday and emergency scenarios.MethodsThis single center cohort study included untrained HTX and LP. Seven scenarios, including battery exchanges (without alarm, advisory alarm, dim light, consolidated bag), change of power supply, driveline dis-/reconnection and controller exchange were simulated. Subjects’ gaze behavior was recorded using eye tracking technology. Success rate, pump-off-time, duration to success (DTS), percental fixation duration per areas of interest and post-scenario-survey results were defined as outcome measures.ResultsThirty subjects completed 210 scenarios, initially solving 82.4% (HTX vs. LP, p = 1.00). Changing power supply revealed highest complexity (DTS = 251 ± 93s, p = 0.76): 26.7% succeeded at first attempt (p = 0.68), 56.7% at second attempt, with significantly more LP failing (p = 0.04), resulting in 10 hazards from driveline disconnections (pump-off-time 2-118s, p = 0.25). Comparison on initial success showed differences in fixation durations for seven areas of interest (p < 0.037). Decreasing DTS during battery exchanges (p < 0.001) indicate high learnability. Exchanging batteries within the bag took longer (median DTS = 75.0 (IQR = 45.0)s, p = 0.09), especially in elderly subjects (r = 0.61, p < 0.001). Subjects with less initial success were more afraid of making mistakes (p = 0.048).ConclusionThis eye tracking based human factors study provided insights into user experiences in handling HM3 peripherals. It highlights unintuitive and hazardous characteristics, providing guidance for future user-centered design of LVAD wearables.

Analysis of Human Factors in Typical Accident Tests of Certain Type Flight Simulator

With the improvement of modern aviation equipment manufacturing technology, there are relatively few failures due to the unreliability of the aircraft. However, human factors which resulted in air crashes and unsafe events are raised. In this paper, for many typical accident scenarios of a particular plane, the flight simulation verifications of the pilot’s workload and behavior are carried out on the certain transport category airplane, namely the six-degrees-of-freedom full-motion flight simulator. The subjective and physiological evaluation methods combine to analyze the human factors of pilots in the sudden typical accident scene during a flight mission. The study uses eye trackers, professional heart rate monitors, cameras, and other equipment to collect the pilot’s physiological information during the flight mission, and allows the pilots to fill in the subjective evaluation scale, establishing a subjective and objective evaluation index system. Thus, the human factors of pilots in typical fault situations are analyzed. The analysis shows the combined personal and accurate evaluation method, with the test equipment and environment proposed by this paper being feasible for the human factor evaluation in the accident or incident of transport category airplanes. It will benefit aviation stakeholders in determining the proper action to decrease the workload to an acceptable level.

무대 조명과 증강현실 자막 밝기에 따른 사이버 멀미 영향 분석

Recently, as the demand for non-face-to-face communication has soared due to COVID-19, the interest in augmented reality is increasing. In order to conveniently use augmented reality technology in our daily lives, cybersickness should be considered. The purpose of this study is to analyze the effect of stage lighting brightness and AR subtitle brightness on comfort and visibility. A total of 30 subjects conducted human factor evaluation by dividing the stage lighting brightness into 3 levels and AR subtitle brightness into 4 levels. Through two-way ANOVA, it was confirmed that there was a significant difference in both factors, and a significant difference was analyzed through a post-hoc test.

Application of Systems Usability Case in an Integrated System Validation of Control Room

The Systems Usability Case (SUC) approach enables a requirement-based human factors (HF) evaluation of complex technical systems that may cover the entire verification and validation process. SUC is based on the Safety Case approach and on the Systems Usability (SU) construct. One of the main aims of establishing a Safety Case is to bring the arguments and evidence for safety to the front in such a way that the reasoning supports the work of a regulator or licensing organization. In the end, the approach enables evaluating the SU of a system and making a reasonable solid argument about the acceptance of the system for use. The question is how the conclusions are reached through a reasoning process in which the arguments are made about the evidence [i.e., identified human engineering discrepancies (HEDs)] to approve or reject the claim concerning the quality of the system. The paper presents an application of SUC to real data from an integrated system validation of the modernized control room (CR) of the Loviisa nuclear power plant. The results of the validation are discussed from the point of view of how the SUC approach enables forming a statement about the acceptance of the CR. Moreover, practical examples are given to demonstrate the identified HF issues and how they were handled in the validation process. The paper provides a general framework for handling of HEDs and for their resolution that can be used in the consolidation of validation test results in a real-world validation project.

Participative human-factor evaluation in the context of digital work (re-)design.

Challenged by digital transformation, organizations increasingly integrate information and communication technologies into work designs. Often focal points of such digital reengineering initiatives are technical and economic aspects. Yet, as integration of new technologies affects how employee work and interact, there is a need to evaluate human-centered criteria (human-factor evaluation), optimally by involving employees as situational experts. The present study develops an integrative and persona-based evaluation approach of human-centered criteria for application in participative digital (re-)design of work to support the joint optimization of the technical and social system. Drawing on methods from usability evaluation, a persona-based approach is developed to facilitate comprehension and application of human-centered evaluation by employees. To that end, human-centered criteria from existing evaluation models are systemized with specific reference to digital transformation of work processes. The developed approach is tested in pilot runs of three German small and medium-sized enterprises (SMEs). The initial overview shows a divergence of specific human-centered criteria at the detailed level. Simultaneously, a high convergence is found for overarching dimensions and categories. The Integrative Socio-Digital Evaluation Model (ISDEM) is developed to balance complexity and abstraction of criteria. The derived persona-based approach (persISDEM) shows a good applicability in the pilot runs. The present study provides an amendment to existing work design approaches with an emphasis on employee participation, enabling organizations to foster employees' comprehension and motivation to engage in evaluations of digital (re-)design of work and to create motivating and healthy jobs for successful digital transformation.

A field study on human factor and safety performances in a downstream oil industry

Safety culture and awareness by workers are pivotal tools for the implementation of systematic procedures aiming to risk mitigation in the process industry. The evaluation of human factors on safety performance can reveal unsafe attitudes and failures in training, supervision and management, whose correction greatly contribute to the enhancement of safety program. In this work, the role of human factors in an oil industry was studied by the collection of field data through a structured questionnaire filled by shift, daily and outsourced workers. A deep investigation on the variables involved in the process was carried out, firstly quantifying three conceptual key dimensions (individual, human resource management, equipment and technology) and then analyzing data by means of Response Surface Methodology (RSM), to identify the statistical significant factors and the overall level of safety awareness, behaviour and risk perception of the respondents.

Evaluation of Human Factors of Mining and Construction Transportation Machines Using a Checklist of Ergonomic Indicators

Evaluation of Human Factors of Mining and Construction Transportation Machines Using a Checklist of Ergonomic Indicators

Application and Evaluation of a Non-Accident-Based Approach to Road Safety Analysis Based on Infrastructure-Related Human Factors

Too often the identification of critical road sites is made by “accident-based” methods that consider the occurred accidents’ number. Nevertheless, such a procedure may encounter some difficulties when an agency does not have reliable and complete crash data at the site level (e.g., accidents contributing factors not clear or approximate accident location) or when crashes are underreported. Furthermore, relying on accident data means waiting for them to occur with the related consequences (possible deaths and injuries). A non-accident-based approach has been proposed by PIARC. This approach involves the application of the Human Factors Evaluation Tool (HFET), which is based on the principles of Human Factors (HF). The HFET can be applied to road segments by on-site inspections and provides a numerical performance measure named Human Factors Scores (HFS). This paper analyses which relationship exists between the results of the standard accident-based methods and those obtainable with HFET, based on the analysis of self-explaining and ergonomic features of the infrastructure. The study carried out for this purpose considered 23 km of two-way two-lane roads in Italy. A good correspondence was obtained, meaning that high risky road segments identified by the HFS correspond to road segments already burdened by a high number of accidents. The results demonstrated that the HFET allows for identifying of road segments requiring safety improvements even if accident data are unavailable. It allows for improving a proactive NSS, avoiding waiting for accidents to occur.