Aircraft Cockpit Research Articles

Multi-agent modelling and situational awareness analysis of human-computer interaction in the aircraft cockpit: A case study

The loss of situational awareness by pilots is one of the harshest risk factors leading to catastrophic accidents. In this paper a situational awareness analysis model based on multiple agents is presented to simulate the human-computer interaction process in the aircraft cockpit. From the perspective of human-in-loop, the integrated model consists of modularized pilot agent model, technical system agent model and environment agent model. Following the structured levels of situational awareness, the pilot's cognitive behaviors are modelled based on Adaptive Control of Thought-Rational (ACT-R) theory and Bayesian network, with the triggering inputs from the visual and auditory sensory channels. Considering the effects of overlapping information from different channels, the formation and evolution mechanism of the pilot's situational awareness is analyzed in a probabilistic inference manner. The tests of input-output characteristics prove that the model can well reflect the distribution and resist the uncertain fluctuation of different cognitive elements. The safety issues based on two simplified real risk scenarios, under the background of the incidents/accidents related with Boeing 737-8 (MAX), were analyzed. The mechanism of accident evolution along with the possible preventive measures were discussed. It is concluded that an early control priority transmission from the technical system to the pilots and the display of direct prompt messages could make a difference in avoiding the serious risk.

Improving Thermal Comfort in Aircraft Cockpit Based on Optimization of Supply Air Grille

Pilot’s thermal comfort and performance are directly affected by air flow field and temperature field in cockpit. A three-dimensional cockpit model of a certain civil aircraft is established, and the distribution of air velocity and temperature is obtained with the method of computational fluid dynamics (CFD). Aiming at the problems of high local air speed and uneven temperature distribution in the cockpit, two new supply air grilles are proposed. The results show that one of the grilles can obviously optimize air flow field and temperature in the cockpit and improve the thermal comfort of the pilots.

Integrated Design and Verification of Civil Aircraft Cockpit Crew Alerting System Based on System Engineering

The cockpit crew alerting system is an important part of the modern cockpit and the only channel for the flight crew to obtain the status of the aircraft system. With the development of avionics, aircraft systems are becoming more and more complex, and more and more information needs to be obtained by the flight crew through the cockpit crew alerting system. So, how to make the flight crew correctly and efficiently obtain the required information becomes the design difficulty of the cockpit crew alerting system. This paper applies system engineering theory and methods to propose a forward design and verification method for the cockpit crew alerting system. This method reduces design changes due to incomplete demand capture, reduces product development costs, and provides a reference for the integrated design and airworthiness verification of the cockpit crew alerting system in the future.

Display dimming model characterized by three-dimensional ergonomic study

Self-luminous display devices are essential in various working environments, such as aircraft cockpits and the driver cab of vehicles and trains, where the external light environment varies drastically. Owing to the significant illumination changes, auto-adjusted display luminance based on ambient lighting is necessary for drivers to work efficiently and comfortably. This study proposes a display dimming model based on three dimensions of ergonomic testing, consisting of visual performance (VP), visual comfort (VC), and visual fatigue (VF). Five ambient illuminances, each combined with five display luminance levels, form a total of 25 conditions demonstrated in this experiment. Using a within-subject design, ten observers experienced all the combination conditions. The experiment employs the Anfimov table to test the VP, VC scale to evaluate VC, and VF scale to assess VF. Based on the experimental results, sub-models are constructed to clarify the characteristics of each dimension (VP, VC, and VF). Subsequently, the analytic hierarchy process is employed to construct an evaluation system by calculating the weight of each dimension in the total score. Finally, exponential fitting is utilized to build a wide-range display dimming model, which explicitly describes the inherent connection of complex light environment matching.

In Memoriam: Lawrence E. Tannas, Jr.

In Memoriam: Lawrence E. Tannas, Jr.

Integrating human factors early in the design process using digital human modelling and surrogate modelling

Embedding ergonomics in the design process is often delayed as it requires building physical prototypes and human subject data collection. This causes retrofitting or expensive late design changes which increase overall cost and time-to-market. This paper presents a computational design methodology that employs Digital Human Modelling (DHM) research and the surrogate modelling technique to integrate ergonomics early in design. The goal of this methodology is to provide a proactive ergonomics assessment toolset that allows designers to identify the effects of design variables on human performance, computationally. In this research, a design space exploration study was conducted to evaluate the ergonomics of a concept aircraft cockpit model built based on a set of flight deck layout variables. Variability in the pilot's anthropometry was added through accommodating the extremities in population-based on computational human manikins. A genetic algorithm with the surrogate model was used to search the concept variants that meet ergonomics objectives. The results show that the proposed proactive ergonomics approach allows designers to explore the design space and evaluate trade-offs between the competing design objectives early in design. Our computational ergonomics approach, based on the cockpit packaging study, demonstrates the advantages of the DHM based surrogate modelling during product conceptualisation.

Engineering Task-based Augmented Reality Guidance: Application to the Training of Aircraft Flight Procedures

Abstract Training operators to efficiently operate critical systems is a cumbersome and costly activity. A training program aims at modifying operators’ knowledge and skills about the system they will operate. The design, implementation and evaluation of a ‘good’ training program is a complex activity that requires involving multi-disciplinary work from multiple stakeholders. This paper proposes the combined use of task descriptions and augmented reality (AR) technologies to support training activities both for trainees and instructors. AR interactions offer the unique benefit of bringing together the cyber and the physical aspects of an aircraft cockpit, thus providing support to training in this context that cannot be achieved by software tutoring systems. On the instructor side, the LeaFT-MixeR system supports the systematic coverage of planed tasks as well as the constant monitoring of trainee performance. On the trainee side, LeaFT-MixeR provides real-time AR information supporting the identification of objects with which to interact, in order to perform the planned task. The paper presents the engineering principles and their implementation to bring together AR technologies and tool-supported task models. We show how these principles are embedded in LeaFT-MixeR system as well as its application to the training of flight procedures in aircraft cockpits.

Testing cockpit display systems of aircraft using a model-based approach

Avionics are highly critical systems that require extensive testing to comply with international safety standards. Cockpit display systems (CDS) are a mandatory part of modern cockpits of both manned and unmanned aircraft. The information from various avionics components is displayed on CDS using a variety of flight instruments. An important part of testing avionics systems is to evaluate whether the displayed information on the CDS is correct or not. A common industrial practice is to manually test CDS, which is time-consuming, labor-intensive, and error-prone. In this paper, we propose a model-based approach to automate the CDS testing of aircraft. The proposed approach tests the CDS at two levels: (i) at the system level to verify that the CDS are working correctly and (ii) at system integration level of CDS when these are integrated with various avionics components. As a part of our approach, we develop a UML profile to model various elements of the CDS. The models are then used to support the automated testing process. We evaluate our approach on two industrial case studies, the first case study represents a primary flight display (PFD) of an aircraft and the second one is the CDS of the ground control station (GCS-CDS) of an unmanned aerial vehicle. The evaluation results show that three potential faults are identified in the PFD and four major faults are found in the GCS-CDS.

Stand for Remote Development of a Display Visualization System for Civil Aircraft Cockpit

The paper presents the original development of the stand for remote creation and debugging of the visualization system for the display of a civil aircraft cockpit. Any visualization system implies the presence of a person for whom it is ultimately intended. Naturally, such presence is necessary for the process of creating and testing the system. However, in the context of the COVID-19 pandemic, access to the premises of scientific institutions is limited. The situation is further complicated by the fact that the development of on-board software must take into account the specifics and be carried out on the target on-board equipment. Therefore, we designed and built a stand which provides remote secure access to the target platform, its remote control and makes possible to see the results of its work. We managed to avoid costly solutions and use a regular desktop PC as an auxiliary control computer. As a result the process of developing a visualization system for the cockpit display is not interrupted even when access to the target platform equipment is restricted. © 2021 National Research Nuclear University. All rights reserved.

Application of Intuitionistic Fuzzy Evaluation Method in Aircraft Cockpit Display Ergonomics

The ergonomic level of cockpit display design can be improved by establishing an objective and effective method for evaluating the ergonomics of the cockpit display. Given the fuzz problem in ergonomic evaluation, a new intuitionistic fuzzy evaluation method is proposed based on the Intuitionistic Fuzzy Ordered Weighted Geometric Average (IFOWGA) operator and the possible degree function in this work. Firstly, the intuitionistic fuzzy evaluation matrix considering the hesitation degree of experts' determination is first constructed as the basis of intuitionistic fuzzy evaluation. Secondly, using the IFOWGA operator the intuitionistic fuzzy evaluation values are obtained through aggregating the evaluation matrix. And these values are ranked to get the level of ergonomic evaluation by possible degree ranking function. Finally, an evaluation example based on the cockpit display of a certain aircraft is given to verify the effectiveness of the proposed approach. Six alternatives of the evaluation result are obtained by the aggregation of the IFOWGA operator. Applied the possible degree function, the ergonomic evaluation grade of the aircraft cockpit display is the second level by ranking the alternative sand the variation of intuitionistic fuzzy value is already small when the number of experts is more than 16. It can be shown from the results that the ergonomic level of cockpit display can be objectively and scientifically evaluated by the proposed quantitative method, and it can provide a theoretical basis and practical methods for improving the ergonomic level of cockpit display design.

Examining Enhanced Learning Diagnostics in Virtual Reality Flight Trainers

As the complexity of aircraft cockpit operations increases, training effectiveness must be improved, and learning accelerated. Virtual reality (VR) training is increasingly offered as a method for improving training efficacy given its ability to provide a rich sensory experience during learning. This paper describes a study examining how training efficacy can be improved by improving learning diagnostics. We study how varying forms of knowledge assessment are related to different types of task knowledge and task performance in a VR flight simulator. The data suggest that participants who demonstrated higher training comprehension, measured via diagnostic test questions, on conceptual (and to a lesser effect) declarative knowledge, also demonstrated superior knowledge transfer in the VR flight simulator. Findings are discussed in the context of improving cognitively diagnostic assessments that are better able to predict task performance and inform individually tailored training remediation.

Cognitive Load Identification of Pilots Based on Physiological-Psychological Characteristics in Complex Environments

Cognitive load is generated by pilots in the process of information cognition about aircraft control, and it is closely related to flight safety. Cognitive load is the physiological and psychological need that a pilot produces when completing a mission. Therefore, it is meaningful to study the dynamic identification of the cognitive load of the pilot under the complex human-aircraft-environment interaction. In this paper, the airfield traffic pattern flight simulation experiment was designed and used to obtain the ECG physiological and NASA-TLX psychological data. The wavelet transform preprocessing and mathematical statistics analysis were applied on them, respectively. Furthermore, the Pearson correlation analysis method is used to select the characteristic indicators of psycho-physiological data after preprocessing. Based on the psycho-physiological characteristic indicators, the pilot’s cognitive load identification model is constructed by combining RNN and LSTM. The results of this study are more accurate compared with the cognitive load identification models established by other methods such as RNN neural network and support vector machine. This research is able to provide a useful reference for preventing and reduction of human error caused by the cognitive load during flight missions. It will be potential to realize intelligent control of aircraft cockpit, improving the flight control behavior and maintaining flight safety.

Evaluating aircraft cockpit emotion through a neural network approach

AbstractStudies show that there are shortcomings in applying conventional methods for the emotional evaluation of the aircraft cockpit. In order to resolve this problem, a more efficient cockpit emotion evaluation system is established in the present study to simply and quickly obtain the cockpit emotion evaluation value. To this end, the neural network is applied to construct an emotional model to evaluate the emotional prediction of the interior design of the aircraft cockpit. Moreover, several technologies and the Kansei engineering method are applied to acquire the cockpit interior emotional evaluation data for typical aircraft models. In this regard, the radical basis function neural network (RBFNN), Elman neural network (ENN), and the general regression neural network (GRNN) are applied to construct the sentimental prediction evaluation model. Then, the three models are comprehensively compared through factors such as the model evaluation criteria, network structure, and network parameters. Obtained experimental results indicate that the GRNN not only has the highest classification accuracy but also has the highest stability in comparison to the other two neural networks, so that it is a more appropriate method for the emotional evaluation of the aircraft cockpit. Results of the present study provide decision supports for the emotional evaluation of the cockpit interior space.

Resilience Strategy Optimization for Large Aircraft Supply Chain Based on Probabilistic Language QFD

This paper proposes an optimization model of supply chain resilience strategy for large passenger aircraft. A quality function deployment (QFD) framework is conducted to analyze the resilience of the large passenger aircraft supply chain, and the key parameters are characterized based on the probabilistic linguistic term. Then based on the output of the QFD framework an optimization model of the resilience strategy considering the stochastic disturbance faced by the supply chain is constructed. Taking the supply chain for large aircraft cockpit control display module as an example to illustrate the application steps and feasibility of the model, the results demonstrate that change of supply chain management responsibilities, implementing hierarchical management of suppliers, seeking coordinated implementation of inventory management mode, and improving the pre-risk identification system, play prominent roles in enhancing supply chain resilience, and the combination of different strategies can indeed enhance the supply chain resilience under the budget constraint.

You Have Control: aviation communication application for safety-critical times in surgery.

High-risk organisations (HRO), including aviation, undergo formal communication training, with emphasis on safety-critical moments. Such training is not widespread or mandatory in healthcare, and while there are many differences both share the ‘human element’ with circumstances leading to an increased risk of harm. A typical operating theatre consists of an operating surgeon, and an assisting surgeon, roles that may change throughout the course of a procedure. Similarly, a training aircraft or multi-crew cockpit (flight deck) has a pilot in control, or ‘pilot flying’, and a ‘pilot not flying’. Both interact with wider teams, for example the scrub team and air traffic controllers, respectively. Surgical error is the second most prevalent cause of preventable harm to patients after drug errors. Every year in the UK National Health Service (NHS), there are typically 500 never events, 21,000 serious incidents, and many more episodes of physical or psychological harm. Ineffective communication (46%) is the most common behavioural factor leading to a never event. In this review, we examine the concept of ‘sterile cockpit’, use of unambiguous terminology, callsigns, important information readback, sharing of mental models, and the mini-brief, and how these may be used to reduce patient harm during safety-critical moments.

Automation of Ergonomic Expertise of the Information Management and Cockpit Management of a Promising Aircraft

The article deals with the automation of the ergonomic examination procedure (EE) of the Data-Control Field (DCF) of the cockpit of promising combat aircraft using artificial intelligence technologies. A balanced combination of aircraft control algorithms, its complex of on-board equipment and weapons, as well as artificial intelligence technologies provides information support for the aircraft crew. The relevance of the ergonomic assessment of DCF at all stages of the aircraft designing and operation is noted. The features of the EE of the DCF of cockpit, goals and objectives, as well as methods of examination are described. EE are monitoring and evaluating the completeness and correctness of the implementation of ergonomic requirements for the designed aircraft and substantiating possible ways to improve the ergonomic characteristics of the aircraft. EE includes systemic and design issues, among which the important issues are the choice of DCF structure. EE technology elements are considered. The tasks of the automated EE system are listed: the assessment of human-machine interaction, quality of information support, the registration and assessment of cockpit geometric characteristics (visibility and reach) and operator’s functional state, formalization of parameters and the formation of an integral assessment. The system combines information, hardware and software into a single complex. A distinctive feature of the DCF EE is the a priori uncertainty of the source data. Models of the algebra of fuzzy sets allow to formalize the decision-making process during the EE. The integral assessment by the Analytic Hierarchy Process (AHP) method is described. AHP as a method for evaluating multicriteria alternatives is well known. The applicability of the method is noted in cases where the issuance of absolute estimates of alternatives by given criteria is difficult.

Pilots’ Performance and Workload Assessment: Transition from Analogue to Glass-Cockpit

During their professional career, pilots often experience a change in workplace conditions in the form of an aircraft cockpit ergonomics change. Change of working conditions may impact their perception of flight data or the pilot’s psychophysiological condition, especially in cases of inexperienced pilots. The presented study deals with the influence of cockpit ergonomics change on the performance and pilot workload during a training course. We divided 20 subjects with no previous practical flying experience into two training groups (Gr. A and Gr. B). The flight training was focused on acquisition of basic piloting skills where both groups experienced cockpit ergonomics change in different training phases. The performance (piloting precision) was assessed based on deviations from predetermined parameters of the monitored flight manoeuvres. Heart rate variability qualified the extent of workload. The study showed the influence of the cockpit arrangement on piloting precision, where the transition to other type of cockpit ergonomics did not influence pilots’ subjective workload with statistical significance.

Optical Wireless Channel Simulation for Communications Inside Aircraft Cockpits

Communications inside an aircraft cockpit are currently based on wired connections especially for the audio headsets used by the pilots. A wireless headset would be an advantage in terms of comfort and flexibility but the use of classical radio frequencies is limited by interference and security issues. Optical wireless communication technology is an option for headset connectivity. Indeed, as optical beams are confined, this technology provides robustness against the risk of hacking, thus increasing security. In addition, the use of optical waves ensures the absence of radio-frequency disturbances. Using simulation, this article presents a thorough study of the optical wireless channel behavior inside the cockpit of an aircraft by considering a headset worn by a pilot possibly in motion and an access point at the ceiling. The impact of the characteristics of the environment model, such as the level of geometric description, the reflectivity of materials and for the first time, the ambient noise induced by the sun, is highlighted. System performance is evaluated in terms of optimal half-power angles and the necessary optical power of the light sources.

Pilots' mental workload prediction based on timeline analysis.

BACKGROUND: The aircraft cockpit is a highly intensive human-computer interaction system, and its design directly affects flight safety.OBJECTIVE: To optimize the display interface design in complex flight tasks, the present study aimed to propose a dynamic conceptual framework and a timeline task analysis method for the quantization of the dynamic time effect of mental workload and the influencing factors of task types in the mental workload prediction model.METHODS: The multi-factor mental workload prediction model based on attention resource allocation was integrated to establish the dynamic prediction model of mental workload. The ergonomics simulation experiment was carried out by recording the data on the performance of embedded subtasks, National Aeronautics and Space Administration-Task Load Index (NASA-TLX) subjective evaluation, and eye tracking.RESULTS: The results indicated that the prediction model had a good prediction accuracy and effectiveness under different simulated interfaces and complex tasks, and the real-time monitoring of pilots’ mental workload state was realized.CONCLUSION: In conclusion, the prediction model and the experimental method could be applied to avoid the overload of the pilot throughout the flight phase by optimizing the display interface and adjusting the flight task.

Interface Design of Aircraft Cockpit Display and Control System

Interface Design of Aircraft Cockpit Display and Control System