Human-machine Interface Design Research Articles

Comparing Tangible and Fully Virtual Haptic Systems for HMI Studies in Simulated Driving Situations

The contribution of tangible and intangible feedback is compared for virtual tactile car Human-Machine Interfaces (HMI) design, to measure their performance both in static conditions and while driving. A subjectively calibrated transparent glass provides tangible passive haptics, and visual cues are used to study sensory substitution-based intangible interactions. The results show that the performance of the subjects was significantly improved in driving conditions as they interacted faster, more accurately and with a higher satisfaction. In addition, our findings highlight that the contribution of tangible systems is significantly lower in driving conditions, raising new questions about the nature of haptic modalities in the function of the context of use. This study provides additional knowledge about the influence of dynamic environments and external tasks on haptic perception.

Extenics matter-element analysis on dilemma problem in HMI design of nuclear power plant

The Human machine interface (HMI) plays a critical role for operator monitoring and controlling the system. The background colors of HMI, as one of human factors, directly influence on the performance of operator, including sensitive and fatigue degree, and furthermore affects the safety and economy of nuclear power plant (NPP). The selection between color differences (affects sensitive and number of matched colors) and performance overtime (affects fatigue degree) are dilemma problem. This paper proposes an extenics matter-element analysis to settle the dilemma problem in HMI design of NPP. By combining both matter-element analysis and extension in HMI, this method changes opposability problem into consistent problem, and discrete problem into continuum problem. A basic background color selection model and weighting method are established too. Taking HMI design as an example, this paper expounds a basic method of solving dilemmas by extension matter element theory. The model, which reflects the distance between selected element and the optimal interval that can be used and further developed for analyzing or solving similar dilemma problem, it is effectively find the best answer for human performance in industry design, and the design of NPP can be further optimized based on this method.

Human Machine Interface Design Analysis of Defect Detection Prototype by Wonderware InTouch Software

Human Machine Interface (HMI) serves as a bridge for operators to understand the processes that occur on the machine. Without HMI, operators will have difficulty in monitoring and controlling the machine. HMI used in this study using Wonderware InTouch software. The HMI design that is used, displays the home button, as the start screen. There are two options in the home menu, which is the option to login as an identification and classification operator. To start operation and enter the monitoring window, any operator that uses this HMI must login using a username and password. The function of HMI in this research is as a connector between operators with machine. In this paper we have presented the human machine interface design of defect detection prototype by wonderware intouch software. Based on the tested results can be concluded that the designed is successfully.

Automation of temperature sensor in biogas production from palm oil mill effluent (POME)

The purpose of this research is to obtain the monitoring system and temperature data recording a system based on National Instruments USB-6001 and to obtain a Human Machine Interface (HMI) which is suitable for monitoring the temperature process of the conversion POME into biogas on a laboratory scale using LabVIEW software. This study was conducted by two stages, hardware design and software design. In hardware design, a stirred tank and a PC were connected to the microcontroller hardware National Instruments USB-6001. The software design was consisted of the LabVIEW programming. The results indicated that the components were suitable for the monitoring process of the conversion POME were the National Instrument USB - 6001, series TC module to DC and 5 volt power source, as well as a temperature sensor used is a thermocouple type K. For HMI design using LabVIEW 2014 was in accordance with the needs with the graphic display of temperature conditions in real time from a stirred tank and the data logger was automatically stored in the Microsoft Excel. After completion of the design of HMI, thermocouple that is used is calibrated to obtained a linear equations of analog data versus temperature data from a digital thermometer so that the equation to be inputted into the program LabVIEW block diagram which was y = 0.0064x + 0.2217 with R2 value was 0.993. Afterward, the research was continued using a set point 55 ° C with a variation of hysteresis 1, 3, and 5°C. Data was obtained from this study then to be calculated the standard error values to compare the data generated from every variation of hysteresis. The results indicated that the best data on research was the data obtained using hysteresis 1°C from the set point temperature compared with the data on the hysteresis 3 and 5°C.

A simulator evaluation of in-vehicle human machine interfaces for eco-safe driving

In-vehicle human machine interfaces (HMI) represent a promising approach for informing drivers what they should do to adopt an eco-safe driving style, which is associated with reduced fuel consumption and improved safety. However, there is limited understanding of the driver acceptance of various types of in-vehicle HMIs and the impact of such systems on driving behaviour. Forty drivers participated in a simulated driving experiment to evaluate three variations of an eco-safe in-vehicle HMI: visual advice only; visual feedback only; or visual advice and feedback. To evaluate the impact of the different HMIs, subjective and objective measures were analysed, including fuel consumption, eco-safe driving behaviour, driver acceptance, and workload. Results indicate that all system types were associated with the relatively high levels of driver acceptance, with the advice only system accepted the most. While all system types produced relatively low levels of workload for drivers, systems involving feedback significantly increased the workload associated with using the interface. The findings suggest that the combined advice and feedback system has the potential to simultaneously reduce fuel consumption and improve eco-safe driving behaviour. Specifically, both advice and feedback appeared to be critical in encouraging positive changes in eco-safe driving behaviour. Our contribution can inform the design and development of future in-vehicle HMIs to improve eco-safe driving style that are accepted by drivers and have minimal adverse impacts on driver workload.

Effects of pitch level, pitch ratio and finger used for tactile identification on embossed and indented dot arrays

ABSTRACTThe tactile sense is of increasing importance in contemporary human–machine interface design as a means of improving operator information processing performance under sensory resource competitive circumstances. However, there is not enough knowledge of some aspects of human tactile identification ability for different surface textures with varying stimulus characteristics. Thus, the aim of this study was to investigate the effects of dot engraving forms (embossed and indented), dot pitch (4.50, 4.95, and 5.45 mm), pitch ratio (1.00, 1.10, and1.21), and finger used (index and middle) as well as gender on human tactile identification ability. The results here showed significantly higher accuracy of identification for the embossed stimulus and for the pitch ratio of 1.21. The significant interaction effect of dot engraving form and dot pitch indicated that embossed dots with 4.50 mm pitch level produced the best accuracy of identification. No significant differences for finger used and gender were shown.

The Konect value – a quantitative method for estimating perception time and accuracy for HMI designs

ABSTRACTA human operator monitoring a safety-critical system has to perceive information quickly and accurately to detect critical system states and execute countermeasures in time. So far, testing such human machine interfaces (HMIs) is a complex task as HMI design prototypes have to be implemented for simulation environments to perform tests with professional operators. We propose Konect Value, a quantitative method to estimate the relative perception accuracy and operator reaction time at an early design stage. The model-based method solely requires a task model and HMI design sketches as input. To validate the Konect Value, we applied the quantitative measure to seven different HMIs in a truck platooning use case. A comparison of the calculated value to the measured accuracy and reaction times in a lab study (n=33) revealed high correlations for the relative reaction time (r=0.83, p<0.05) and relative perception accuracy (r=−0.90, p<0.01). This indicates that Konect Value is a promising method for early HMI design evaluation in the safety-critical system domain.

Ergonomic analysis of washing machines for elderly people: A focus group-based study

Household appliances are especially important for elderly people living in homes. However, current manufacturers and designers of home appliances do not consider elderly people much more when pursuing new technology and new products. This study investigated the ergonomic problems for elderly people in the use of washing machines. Four focus groups with 31 Chinese elderly participants were conducted to explore four main topics: 1) Inconveniences and difficulties in the use of washing machines, 2) suggestions for the improvement of current washing machines, 3) demands and intentions for the functions of washing machines, and 4) human-machine interface design and user preferences for washing machines. The semi-structured script and open-ended questions could make the participants fully discuss the topics and express their opinions, and also allowed researchers to get a deep understanding of user's ideas. The results showed that using focus group method could get detailed insights of many ergonomic problems for elderly people, which could provide needed information for planning the development and design of more ergonomic washing machines considering elderly people. Relevance to industryMore and more household appliances with new technology and new functions have entered our daily life. However, the characteristics and needs of elderly people are often neglected. This paper can provide guidelines and references for the inclusive design of washing machines and other household appliances.

Application of Gestalt psychology in product human-machine Interface design

Objective Studying the application of Gestalt psychology in product human-machine interface design. Methods The 5 principles of proximity, similarity, closure, continuity and symmetry in Gestalt psychology are analyzed by different human-machine interface design cases. Conclusion The proximity principle and the similarity principle are related to the tendency of trying to group the objects. The closed principle and the continuity principle are related to the tendency to try to give the object a complete form. And the symmetry principle is related to the attempt to simplify the figure to make it conform to the human visual habits. The Gestalt principle allows the information on the interface to be presented in groups and in a complete way. It helps designers to understand the visual rules of human beings, to grasp the perception structure of things on the whole, and to organize, simplify and unify the display and operation devices in the design of the human-machine interface, so that the interface is more coordinated and easy to understand, so as to facilitate user operation and improve the efficiency of human-machine system.

Human Machine Interface Design for a 3 DoF Robot Manipulator

This paper represents a Human Machine Interface (HMI) design to control a 3 DoF robot manipulator. This manipulator has two parallelograms to make the moving platform always parallel to the ground. We used inverse kinematic analysis of the robot manipulator to control the end point location. Inverse kinematic results are verified using design parameters and end effector location. According to our algorithm, user defines the end point location from HMI, and then program solves inverse kinematics of the robot manipulator. The angles are sent to Arduino microcontroller to set the position of the servo motors. Using this HMI, the user picks and places the object in real time. The user can also give command to draw linear, circular and rectangular paths on the HMI.

How can humans understand their automated cars? HMI principles, problems and solutions

As long as vehicles do not provide full automation, the design and function of the Human Machine Interface (HMI) is crucial for ensuring that the human “driver” and the vehicle-based automated systems collaborate in a safe manner. When the driver is decoupled from active control, the design of the HMI becomes even more critical. Without mutual understanding, the two agents (human and vehicle) will fail to accurately comprehend each other’s intentions and actions. This paper proposes a set of design principles for in-vehicle HMI and reviews some current HMI designs in the light of those principles. We argue that in many respects, the current designs fall short of best practice and have the potential to confuse the driver. This can lead to a mismatch between the operation of the automation in the light of the current external situation and the driver’s awareness of how well the automation is currently handling that situation. A model to illustrate how the various principles are interrelated is proposed. Finally, recommendations are made on how, building on each principle, HMI design solutions can be adopted to address these challenges.

Application of Eye Tracking for Measurement and Evaluation in Human Factors Studies in Control Room Modernization

An important element of human factors engineering (HFE) pertains to measurement and evaluation (M&E). The role of HFE-M&E should be integrated throughout the entire control room modernization (CRM) process and be used for human–system performance evaluation and diagnostic purposes to resolve potential human engineering deficiencies and other human–machine interface design issues. NUREG-0711 describes how HFE in CRM should employ a hierarchical set of measures, particularly during integrated system validation, including plant performance, personnel task performance, situation awareness, cognitive workload, and anthropometric/physiological factors. Historically, subjective measures have been primarily used since they are easier to collect and do not require specialized equipment. However, there are pitfalls with relying solely on subjective measures in M&E such as negatively impacting reliability, sensitivity, and objectivity. As part of comprehensively capturing a diverse set of measures that strengthen findings and inferences made about the benefits from emerging technologies like advanced displays, this paper discusses the value of using eye tracking as an objective method that can be used in M&E. A brief description of eye tracking technology and relevant eye tracking measures is provided. Additionally, technical considerations and the unique challenges with using eye tracking in full-scale simulations are addressed. Finally, this paper shares preliminary findings regarding the use of a wearable eye tracking system in a full–scale simulator study. These findings should help guide future full–scale simulator studies using eye tracking as a methodology to evaluate human-system performance.

The Best Rated Human–Machine Interface Design for Autonomous Vehicles in the 2016 Grand Cooperative Driving Challenge

This paper provides an in-depth description of the best rated human-machine interface that was presented during the 2016 Grand Cooperative Driving Challenge. It was demonstrated by the Chalmers Truck Team as the envisioned interface to their open source software framework OpenDLV, which is used to power Chalmers’ fleet of self-driving vehicles. The design originates from the postulate that the vehicle is fully autonomous to handle even complex traffic scenarios. Thus, by including external and internal interfaces, and introducing a show, don’t tell principle, it aims at fulfilling the needs of the vehicle occupants as well as other participants in the traffic environment. The design also attempts to comply with, and slightly extend, the current traffic rules and legislation for the purpose of being realistic for full-scale implementation.

Design Control Systems of Human Machine Interface in the NTVS-2894 Seat Grinder Machine to Increase the Productivity

In the Manufacturing of automotive spare parts, increased sales of vehicles is resulted in increased demand for production of engine valve of the customer. To meet customer demand, we carry out improvement and overhaul of the NTVS-2894 seat grinder machine on a machining line. NTVS-2894 seat grinder machine has been decreased machine productivity, the amount of trouble, and the amount of downtime. To overcome these problems on overhaul the NTVS-2984 seat grinder machine include mechanical and programs, is to do the design and manufacture of HMI (Human Machine Interface) GP-4501T program. Because of the time prior to the overhaul, NTVS-2894 seat grinder machine does not have a backup HMI (Human Machine Interface) program. The goal of the design and manufacture in this program is to improve the achievement of production, and allows an operator to operate beside it easier to troubleshoot the NTVS-2894 seat grinder machine thereby reducing downtime on the NTVS-2894 seat grinder machine. The results after the design are HMI program successfully made it back, machine productivity increased by 34.8%, the amount of trouble, and downtime decreased 40% decrease from 3,160 minutes to 1,700 minutes. The implication of our design, it could facilitate the operator in operating machine and the technician easer to maintain and do the troubleshooting the machine problems.

Big Data Usage Can Be a Solution for User Behavior Evaluation: An Automotive Industry Example.

The current level of User Interface complexity leaves almost no space for subjective assessment of user interaction design. Successful Human-Machine Interface (HMI) assessment can be conveyed through big data analysis of user behavior in the real environment. A series of interviews with UI/UX engineers from the leading Swedish automotive manufacturer revealed the limitations of existing methods and deficiency of objective information sources. Design of the case regarding real user data analysis that is presented can bring a better understanding of different users’ behavior patterns, which can lead to the improvement of future HMI systems. The data-driven approach can establish a foundation of robust methodologies regarding the objective evaluation of HMI design.

Next Generation Universal Ground Control System HMI Design

The existing Human Machine Interface (HMI) for the Army’s Universal Ground Control Station (UGCS) represents a 1980s, windows-based technology which is neither intuitive nor scalable for operators. It creates high levels of cognitive load on the operators, and its closed architecture limits its adaptability for UAS missions as technologies evolve. This research presents a methodology for creating and evaluating next generation HMI designs while leveraging GNU Image Manipulation Program (GIMP) and TELLUS flight simulation software in the creation of five HMI prototype designs. A proof of concept approach in the evaluation of prototypes was performed with five UAS Aircraft Operators (15W MOS) and five USMA cadets; examination of the impact of age and experience on the perceived value of new HMI designs will influence recommendations on full experimental design. The value-focused approach to design presented in this paper and prototype designs provide a basis for full prototype development and experimental testing through PM UAS with the Intelligence and Maneuver Centers of Excellence. Results include a trade space and sensitivity analysis towards development of improved HMI designs. The methodology and high performing prototypes for HMI design will be integrated by the PM UAS CSI Project Office for further development and full experimental analysis.

Design and control methods of a condenser cleaning robot

As the condenser has complicated indoor environment and it’s difficult for the cleaning robot to complete cleaning, this paper deeply researches tele-operation system of intelligent cleaning robot, designs hardware architecture and software system at tele-operation control platform, including design of human-machine interface on the tele-operation control platform and software and hardware design of joystick force feedback controller. It designs the ontology mechanical structure, electromechanical control system, communication control program and picture processing program of intelligent cleaning robot. Industrial personal computer is used for data processing and motion control in the electromechanical control system. Test results show that the operation system herein can be used to effectively solve the problems in design and control of tele- operation system of intelligent cleaning robot and implement online high-pressure water-jetting cleaning of a condenser tube, so as to ensure efficient and safe operation of condensers in the large power plant.

Using theta and alpha band power to assess cognitive workload in multitasking environments

Cognitive workload is of central importance in the fields of human factors and ergonomics. A reliable measurement of cognitive workload could allow for improvements in human machine interface designs and increase safety in several domains. At present, numerous studies have used electroencephalography (EEG) to assess cognitive workload, reporting the rise in cognitive workload to be associated with increases in theta band power and decreases in alpha band power. However, results have been inconsistent with some failing to reach the required level of significance. We hypothesized that the lack of consistency could be related to individual differences in task performance and/or to the small sample sizes in most EEG studies. In the present study we used EEG to assess the increase in cognitive workload occurring in a multitasking environment while taking into account differences in performance. Twenty participants completed a task commonly used in airline pilot recruitment, which included an increasing number of concurrent sub-tasks to be processed from one to four. Subjective ratings, performances scores, pupil size and EEG signals were recorded. Results showed that increases in EEG alpha and theta band power reflected increases in the involvement of cognitive resources for the completion of one to three subtasks in a multitasking environment. These values reached a ceiling when performances dropped. Consistent differences in levels of alpha and theta band power were associated to levels of task performance: highest performance was related to lowest band power.

Performance Evaluation of Passive Haptic Feedback for Tactile HMI Design in CAVEs.

This article presents a comparison of different haptic systems, which are designed to simulate flat Human Machine Interfaces (HMIs) like touchscreens in virtual environments (VEs) such as CAVEs, and their respective performance. We compare a tangible passive transparent slate to a classic tablet and a sensory substitution system. These systems were tested during a controlled experiment. The performance and impressions from 20 subjects were collected to understand more about the modalities in the given context. The results show that the preferences of the subjects are strongly related to the use-cases and needs. In terms of performance, passive haptics proved to be significantly useful, acting as a space reference and a real-time continuous calibration system, allowing subjects to have lower execution durations and relative errors. Sensory substitution induced perception drifts during the experiment, causing significant performance disparities, demonstrating the low robustness of perception when spatial cues are insufficiently available. Our findings offer a better understanding on the nature of perception drifts and the need of strong multisensory spatial markers for such use-cases in CAVEs. The importance of a relevant haptic modality specifically designed to match a precise use-case is also emphasized.

SIMULATION OF THE «COSMONAUT-ROBOT» SYSTEM INTERACTION ON THE LUNAR SURFACE BASED ON METHODS OF MACHINE VISION AND COMPUTER GRAPHICS

Abstract. Extravehicular activity (EVA) on the lunar surface, necessary for the future exploration of the Moon, involves extensive use of robots. One of the factors of safe EVA is a proper interaction between cosmonauts and robots in extreme environments. This requires a simple and natural man-machine interface, e.g. multimodal contactless interface based on recognition of gestures and cosmonaut’s poses. When travelling in the "Follow Me" mode (master/slave), a robot uses onboard tools for tracking cosmonaut’s position and movements, and on the basis of these data builds its itinerary. The interaction in the system "cosmonaut-robot" on the lunar surface is significantly different from that on the Earth surface. For example, a man, dressed in a space suit, has limited fine motor skills. In addition, EVA is quite tiring for the cosmonauts, and a tired human being less accurately performs movements and often makes mistakes. All this leads to new requirements for the convenient use of the man-machine interface designed for EVA. To improve the reliability and stability of human-robot communication it is necessary to provide options for duplicating commands at the task stages and gesture recognition. New tools and techniques for space missions must be examined at the first stage of works in laboratory conditions, and then in field tests (proof tests at the site of application). The article analyzes the methods of detection and tracking of movements and gesture recognition of the cosmonaut during EVA, which can be used for the design of human-machine interface. A scenario for testing these methods by constructing a virtual environment simulating EVA on the lunar surface is proposed. Simulation involves environment visualization and modeling of the use of the "vision" of the robot to track a moving cosmonaut dressed in a spacesuit.