Human Interface Research Articles

Bridging minds and machines in Industry 5.0: neurobiological approach.

In transitioning from Industry 4.0 to the forthcoming Industry 5.0, this research explores the fusion of the humanistic view and technological developments to redefine Continuing Engineering Education (CEE). Industry 5.0 introduces concepts like biomanufacturing and human-centricity, embodying the integration of sustainability and resiliency principles in CEE, thereby shaping the upskilling and reskilling initiatives for the future workforce. The interaction of sophisticated concepts such as Human-Machine Interface and Brain-Computer Interface (BCI) forms a conceptual bridge toward the approaching Fifth Industrial Revolution, allowing one to understand human beings and the impact of their biological development across diverse and changing workplace settings. Our research is based on recent studies into Knowledge, Skills, and Abilities taxonomies, linking these elements with dynamic labor market profiles. This work intends to integrate a biometric perspective to conceptualize and describe how cognitive abilities could be represented by linking a Neuropsychological test and a biometric assessment. We administered the brief Neuropsychological Battery in Spanish (Neuropsi Breve). At the same time, 15 engineering students used the Emotiv insight device that allowed the EEG recollection to measure performance metrics such as attention, stress, engagement, and excitement. The findings of this research illustrate a methodology that allowed the first approach to the cognitive abilities of engineering students to be from neurobiological and behavioral perspectives. Additionally, two profiles were extracted from the results. The first illustrates the Neuropsi test areas, its most common mistakes, and its performance ratings regarding the students' sample. The second profile shows the interaction between the EEG and Neuropsi test, showing engineering students' cognitive and emotional states based on biometric levels. The study demonstrates the potential of integrating neurobiological assessment into engineering education, highlighting a significant advancement in addressing the skills requirements of Industry 5.0. The results suggest that obtaining a comprehensive understanding of students' cognitive abilities is possible, and educational interventions can be adapted by combining neuropsychological approaches with EEG data collection. In the future, it is essential to refine these evaluation methods further and explore their applicability in different engineering disciplines. Additionally, it is necessary to investigate the long-term impact of these methods on workforce preparation and performance.

Adoption of new banking models from a consumer perspective: the case of Iran

PurposeTraditionally, the banking and financial sectors have pioneered adoption of new technologies and business models. One important digital banking model that has proven its efficacy in recent times, is Digital-Only Banking (DOB) where consumers interact with their banks through digital channels only. Having detailed knowledge of what actually happens at the consumer level during the adoption of new digital models and technologies is paramount to the success of these technological initiatives. The present study aims to investigate DOB adoption behavior and possible barriers using a quantitative approach at the consumer level. A conceptual model is developed by extending the Unified Theory of Acceptance and Use of Technology (UTAUT) model, incorporating Trust (TR), Perceived Risk (PR) constructs and cultural moderators of Individualism (IDV) and Uncertainty Avoidance (UA).Design/methodology/approachFor this study, an online survey instrument was created and administered in Iran. The research sample was selected through the application of purposive sampling. Data from 788 respondents were analyzed. The proposed model was tested using Partial Least Square.?.s Structural Equation Modeling (PLS-SEM).FindingsThe results show that DOB adoption is positively influenced by Effort Expectancy (EE), Social Influence (SI), and Facilitating Conditions (FC), while PR negatively influences DOB adoption intention. Unexpectedly, the results indicate that TR has no significant impact on DOB usage intention. Additionally, this study demonstrates that with individuals having a low level of IDV, the relationship between PE and BI is stronger, and with individuals having a low level of UA, the impact of SI on BI is stronger. It also reveals that the impact of TR on BI is stronger in low individualistic cultures.Practical implicationsDOB providers should enhance support features of their services or provide facilities that make it simpler for users to accomplish online transactions. Here, in order to improve the UI/UX design of their apps, DOB product managers should carefully observe the technical guidelines of the operating systems of digital devices, such as the Human Interface Guidelines (HIG) for iOS and Material You for Android. Additionally, DOB providers should build partnerships with mega online retailers to provide hassle-free and easy to use payment solutions for consumers.Originality/valueDOB, as a novel and business model, has been investigated in very few studies, especially regarding any which focus on its adoption. To fill this gap, this research investigates DOB adoption through a modified version of the UTAUT model. The findings of this study suggest that future research regarding DOB should consider sources of TR, types of non-adopters, and context. This study, as the first of its kind in DOB literature, also highlights the significant role played by cultural values in customer behavior regarding DOB adoption.

PGRMC2 and HLA-G regulate immune homeostasis in a microphysiological model of human maternal-fetal membrane interface

Chorion trophoblasts (CTCs) and immune cell-enriched decidua (DECs) comprise the maternal-fetal membrane interface called the chorio-decidual interface (CDi) which constantly gets exposed to maternal stressors without leading to labor activation. This study explored how CTCs act as a barrier at CDi. The roles of human leukocyte antigen (HLA)-G and progesterone receptor membrane component 2 (PGRMC2) in mediating immune homeostasis were also investigated. The CDi was recreated in a two-chamber microfluidic device (CDi-on-chip) with an outer chamber of primary DECs and immune cell line-derived innate immune cells and an inner chamber of wild-type or PGRMC2 or HLA-G knockout immortalized CTCs. To mimic maternal insults, DECs were treated with lipopolysaccharide, poly(I:C), or oxidative stress inducer cigarette smoke extract. Expression levels of inflammation and immunity genes via targeted RNA sequencing, production of soluble mediators, and immune cell migration into CTCs were determined. In CDi-on-chip, decidua and immune cells became inflammatory in response to insults while CTCs were refractory, highlighting their barrier function. HLA-G and PGRMC2 are found to be vital to immune homeostasis at the CDi, with PGRMC2 serving as an upstream regulator of inflammation, HLA-G expression, and mesenchymal-epithelial transition, and HLA-G serving as a frontline immunomodulatory molecule, thus preventing fetal membrane compromise.

Hello, is it me you're Stopping for? The Effect of external Human Machine Interface Familiarity on Pedestrians' Crossing Behaviour in an Ambiguous Situation.

We investigated how different deceleration intentions (i.e. an automated vehicle either decelerated for leading traffic or yielded for pedestrians) and a novel (Slow Pulsing Light Band - SPLB) or familiar (Flashing Headlights - FH) external Human Machine Interface (eHMI) informed pedestrians' crossing behaviour. The introduction of SAE Level 4 Automated Vehicles (AVs) has recently fuelled interest in new forms of explicit communication via eHMIs, to improve the interaction between AVs and surrounding road users. Before implementing these eHMIs, it is necessary to understand how pedestrians use them to inform their crossing decisions. Thirty participants took part in the study using a Head-Mounted Display. The independent variables were deceleration intentions and eHMI design. The percentage of crossings, collision frequency and crossing initiation time across trials were measured. Pedestrians were able to identify the intentions of a decelerating vehicle, using implicit cues, with more crossings made when the approaching vehicles were yielding to them. They were also more likely to cross when a familiar eHMI was presented, compared to a novel one or no eHMI, regardless of the vehicle's intention. Finally, participants learned to take a more cautious approach as trials progressed, and not to base their decisions solely on the eHMI. A familiar eHMI led to early crossings regardless of the vehicle's intention but also led to a higher collision frequency than a novel eHMI. To achieve safe and acceptable interactions with AVs, it is important to provide eHMIs that are congruent with road users' expectations.

Effects of various in-vehicle human–machine interfaces on drivers’ takeover performance and gaze pattern in conditionally automated vehicles

With the era of automated driving approaching, designing an effective and suitable human–machine interface (HMI) to present takeover requests (TORs) is critical to ensure driving safety. The present study conducted a simulated driving experiment to explore the effects of three HMIs (instrument panel, head-up display [HUD], and peripheral HMI) on takeover performance, simultaneously considering the TOR type (informative and generic TORs). Drivers’ eye movement data were also collected to investigate how drivers distribute their attention between the HMI and surrounding environment during the takeover process. The results showed that using the peripheral HMI to present TORs can shorten takeover time, and drivers rated this HMI as more useful and satisfactory than conventional HMIs (instrument panel and HUD). Eye movement analysis revealed that the peripheral HMI encourages drivers to spend more time gazing at the road ahead and less time gazing at the TOR information than the instrument panel and HUD, indicating a better gaze pattern for traffic safety. The HUD seemed to have a risk of capturing drivers’ attention, which resulted in an ‘attention tunnel,’ compared to the instrument panel. In addition, informative TORs were associated with better takeover performance and prompted drivers to spend less time gazing at rear-view mirrors than generic TORs. The findings of the present study can provide insights into the design and implementation of in-vehicle HMIs to improve the driving safety of automated vehicles.

Full-color, highly bright and stretchable electroluminescent device with Janus colors based on photoluminescent electrode for wireless dynamical display

Stretchable displays are essential for the upcoming era of flexible electronics as they are the foundation of interactive human–machine interface. To date, alternating current electroluminescent (ACEL) devices are regarded as one of the most practicable routes for stretchable displays but their colors are very limited for the demand of full-color displays. Herein, we developed an ACEL device with Janus and full color through photoluminescent electrodes. In the front of the devices, multiple colors are achieved, Red, Blue, Green, and Yellow, covering a 66 % National Television System Committee color gamut. In the back, mixed lights of White, Purple, and Cyan color are obtained, enabling devices with Janus colors. The brightness enhancement of highly desirable white light achieves 4.4-fold, which is also one of the best performances. Our strategy exploits the indispensable electrode for ACEL and avoids structural changes, endowing the devices with a much better stretchability and brightness as compared to traditional methods. Moreover, our strategy is a general method that is applicable to different stretchable ACEL devices. A wearable device of 8*8 pixels is assembled and can dynamically display information from smart phones through Bluetooth in real time, laying a considerable advancement towards stretchable displays with full color.

Self‐Powered, Soft and Breathable Human–Machine Interface Based on Piezoelectric Sensors

Self‐Powered, Soft and Breathable Human–Machine Interface Based on Piezoelectric Sensors

Evaluating Autonomous Vehicle External Communication Using a Multi-Pedestrian VR Simulator

With the rise of autonomous vehicles (AVs) in transportation, a pressing concern is their seamless integration into daily life. In multi-pedestrian settings, two challenges emerge: ensuring unambiguous communication to individual pedestrians via external Human-Machine Interfaces (eHMIs), and the influence of one pedestrian over another. We conducted an experiment (N=25) using a multi-pedestrian virtual reality simulator. Participants were paired and exposed to three distinct eHMI concepts: on the vehicle, within the surrounding infrastructure, and on the pedestrian themselves, against a baseline without any eHMI. Results indicate that all eHMI concepts improved clarity of communication over the baseline, but differences in their effectiveness were observed. While pedestrian and infrastructure communications often provided more direct clarity, vehicle-based cues at times introduced uncertainty elements. Furthermore, the study identified the role of co-located pedestrians: in the absence of clear AV communication, individuals frequently sought cues from their peers.

Flexible Pressure Sensors Based on P(VDF-TrFE) Films Incorporated with Ag@PDA@PZT Particles.

Films of piezoelectric poly(vinylidene fluoride) (PVDF) and its copolymer P(VDF-TrFE) have been studied intensively for their potential application in piezoelectric sensing devices. The present work focuses on tuning the piezoelectric properties of P(VDF-TrFE) films via incorporating Ag and polydopamine co-decorated PZT (Ag@PDA@PZT) particles. Ag@PDA@PZT particles can effectively improve the β-phase content and piezoelectric properties of P(VDF-TrFE) films. The highest open-circuit voltage and short-circuit current of P(VDF-TrFE)-based flexible pressure sensors incorporating Ag@PDA@PZT particles are ~30 V and ~2.4 μA, respectively. The flexible sensors exhibit a response to different body movements, providing a practical and potentially useful basis for human-machine interface applications.

A Self-Powered, Skin Adhesive, and Flexible Human-Machine Interface Based on Triboelectric Nanogenerator.

Human-machine interactions (HMIs) have penetrated into various academic and industrial fields, such as robotics, virtual reality, and wearable electronics. However, the practical application of most human-machine interfaces faces notable obstacles due to their complex structure and materials, high power consumption, limited effective skin adhesion, and high cost. Herein, we report a self-powered, skin adhesive, and flexible human-machine interface based on a triboelectric nanogenerator (SSFHMI). Characterized by its simple structure and low cost, the SSFHMI can easily convert touch stimuli into a stable electrical signal at the trigger pressure from a finger touch, without requiring an external power supply. A skeleton spacer has been specially designed in order to increase the stability and homogeneity of the output signals of each TENG unit and prevent crosstalk between them. Moreover, we constructed a hydrogel adhesive interface with skin-adhesive properties to adapt to easy wear on complex human body surfaces. By integrating the SSFHMI with a microcontroller, a programmable touch operation platform has been constructed that is capable of multiple interactions. These include medical calling, music media playback, security unlocking, and electronic piano playing. This self-powered, cost-effective SSFHMI holds potential relevance for the next generation of highly integrated and sustainable portable smart electronic products and applications.

Smart ping-pong paddle with triboelectric self-powered wireless sensors

This work demonstrates a ping-pong paddle equipped with self-powered wireless triboelectric nanogenerator-based (TENG) sensors, a significant advancement in sports science and technology. The study effectively created fluoroalkylsilane-modified polydimethylsiloxane (PDMS-FOTS) TENG to alter the electronegativity of PDMS. Consequently, the PDMS-FOTS TENG demonstrated a dramatic increase in performance, achieving voltages and currents of up to 181 V and 98 nA, respectively, which is a 2.83-fold and 3.03-fold enhancement compared to PDMS TENG. Theoretical calculations using finite element method (FEM) confirmed these results, indicating an optimal triboelectric potential of 1172 V for PDMS-FOTS. Incorporating this TENG into the ping-pong paddle, combined with a data acquisition (DAQ) card, Wi-Fi module, and human-machine interface (HMI), led to the creation of a wireless system capable of capturing real-time data on the impact positions and strengths of ping-pong balls. The system's remarkable stability and sensitivity are evident in its 100 % accuracy in position differentiation over 340 ball impacts and its ability to handle high-speed movements up to 10 kHz. This functionality offers athletes precise and detailed training records, enhancing their performance analysis. The study's findings reveal the significant potential of integrating TENG sensor technology in intelligent sports equipment. The ping-pong paddle demonstrates the practical application of TENGs in real-world scenarios, enhancing athletic training and performance analysis through innovative, self-powered wireless sensors.

Vision-based human–machine interface for a robotic exoskeleton glove designed for patients with brachial plexus injuries

Vision-based human–machine interface for a robotic exoskeleton glove designed for patients with brachial plexus injuries

Divergent effects of visual interfaces on teleoperation for challenging jobsite environments

In challenging work environments, teleoperation has been adopted for executing tasks over long distances, ensuring worker safety off-site. The physical distance from jobsites typically poses challenges to teleoperators, limiting their cognition and perception of sites. Particularly, these human-machine interface challenges vary depending on the work environment conditions. This paper analyzes the impact of different visual interfaces on teleoperators and their work performance in challenging jobsite environments, using interactive workplace modeling and simulation to execute teleoperation tasks. Based on experiments with 33 subjects in construction-related fields with industrial experience, the study observed data overload problems and distraction with effects varying by work environment. Additionally, the analysis includes how their eye gaze patterns could demonstrate these effects. The findings contribute valuable insights into human factors crucial for designing user-centered teleoperation interfaces in construction, forming the basis for an intuitive and informative interface design in task-specific settings.

Bioinspired Monopolar Controlled Ionic Hydrogels for Flexible Non‐Contact Human–Machine Interfaces

Bioinspired Monopolar Controlled Ionic Hydrogels for Flexible Non‐Contact Human–Machine Interfaces

Exacerbation of influenza virus induced lung injury by alveolar macrophages and its suppression by pyroptosis blockade in a human lung alveolus chip.

Alveolar macrophages (AMs) are the major sentinel immune cells in human alveoli and play a central role in eliciting host inflammatory responses upon distal lung viral infection. Here, we incorporated peripheral human monocyte-derived macrophages within a microfluidic human Lung Alveolus Chip that recreates the human alveolar-capillary interface under an air-liquid interface along with vascular flow to study how residential AMs contribute to the human pulmonary response to viral infection. When Lung Alveolus Chips that were cultured with macrophages were infected with influenza H3N2, there was a major reduction in viral titers compared to chips without macrophages; however, there was significantly greater inflammation and tissue injury. Pro-inflammatory cytokine levels, recruitment of immune cells circulating through the vascular channel, and expression of genes involved in myelocyte activation were all increased, and this was accompanied by reduced epithelial and endothelial cell viability and compromise of the alveolar tissue barrier. These effects were partially mediated through activation of pyroptosis in macrophages and release of pro-inflammatory mediators, such as interleukin (IL)-1β, and blocking pyroptosis via caspase-1 inhibition suppressed lung inflammation and injury on-chip. These findings demonstrate how integrating tissue resident immune cells within human Lung Alveolus Chip can identify potential new therapeutic targets and uncover cell and molecular mechanisms that contribute to the development of viral pneumonia and acute respiratory distress syndrome (ARDS).

Fabrication of rare earth-doped ZnO-PVDF flexible nanocomposite films for ferroelectric response and their application in piezo-responsive bending sensors.

The present study covers the fabrication of flexible piezoelectric nanogenerators and their application towards sustainable power generation. The rod-like structure of erbium-doped ZnO (EZ) nanoparticles prepared by the hydrothermal synthesis route was successfully incorporated inside the polyvinylidene fluoride (PVDF) matrix using the solution casting method. Solution casting is an easy and cost-effective method for fabricating laminated, thin, flexible and lightweight EZ-PVDF nanocomposite films. The formation of the desired crystallographic phase of EZ-PVDF nanocomposite films and the presence of rod-like EZ nanoparticles inside the PVDF matrix were confirmed using X-ray diffraction and FESEM. The enhancement of the β-phase fraction of the EZ-PVDF nanocomposite films as compared to bare PVDF was estimated using FTIR spectroscopy. The presence of a ferroelectric phase in the EZ-PVDF nanocomposite films was found due to the formation of a large area of interfaces between the EZ nanoparticles and the PVDF matrix. The maximum polarizations of 0.00696 μC cm-2 and 0.00683 μC cm-2 for two samples (EZP1 and EZP2, respectively) were observed at an electric field of 1.25 kV cm-1. The piezoelectric voltages were observed at relatively low frequencies for both nanocomposite films. The maximum piezoelectric voltages of 18.9 V and 15.5 V were observed at a 1 Hz frequency for EZP1 and EZP2, respectively. The output piezoelectric current of 16.88 mA and the maximum power density of 7773.68 W m-3 for EZP1 ensure its potential as an efficient piezoelectric nanogenerator with greater efficiency than those reported previously in published articles. The change in the piezoelectric voltage response of the nanocomposite films as a function of mechanical movement of human external body parts renders them the most suitable candidate for human-machine interfacing (HMI) applications, such as bending sensors and human motion sensors.

Ultra-stretchable triboelectric touch pad with sandpaper micro-surfaces for Transformer-assisted gesture recognition

Touch pad based on triboelectric nanogenerator are attracting attention in the field of wearable electronics and human-machine interaction. However, it is still a challenge to realize touch pads combining large-area metamorphic stretchability, high power triboelectric sensing, intelligent free-sliding recognition and availability in extreme environments. Here, we fabricate an ultra-stretchable triboelectric touch pad by integrating liquid metal and high performance hydrogel-based triboelectric sensor arrays, which achieves Transformer-assisted gesture recognition for drone flight direction control. The internal hydrogel electrode has great stretchability, electrical conductivity and anti-freeze properties. Encapsulated in Ecoflex with sandpaper micro-surfaces, it endows high triboelectric power density and pressure sensitivity. With screen-printed liquid metal, the integrated touch pad is fully ultra-stretchable and large-area strain stability. Combining Internet of Things, we build a Transformer-assisted human machine interface. Notably, slide gesture signal peak deviation is reduced by integral processing. The random free-sliding gesture signals are parsed by the Transformer algorithm with 96.83 % accuracy. Multi-threaded signal processing improves the response speed and throughput of the system. The accurate real-time gesture recognition for drone flight direction control in extreme environment is realized. This human machine interface can facilitate development of next generation intelligent remote interactive platforms.

Highly Adhesive and Stretchable Epidermal Electrode for Bimodal Recording Patch.

For numerous biological and human-machine applications, it is critical to have a stable electrophysiological interface to obtain reliable signals. To achieve this, epidermal electrodes should possess conductivity, stretchability, and adhesiveness. However, limited types of materials can simultaneously satisfy these requirements to provide satisfying recording performance. Here, we present a dry electromyography (EMG) electrode based on conductive polymers and tea polyphenol (CPT), which offers adhesiveness (0.51 N/cm), stretchability (157%), and low impedance (14 kΩ cm2 at 100 Hz). The adhesiveness of the electrode is attributed to the interaction between catechol groups and hydroxyls in the polymer blend. This adhesive electrode ensures stable EMG recording even in the presence of vibrations and provides signals with a high signal-to-noise ratio (>25 dB) for over 72 h. By integrating the CPT electrode with a liquid metal strain sensor, we have developed a bimodal rehabilitation monitoring patch (BRMP) for sports injuries. The patch utilizes Kinesio Tape as a substrate, which serves to accelerate rehabilitation. It also tackles the challenge of recording with knee braces by fitting snugly between the brace and the skin, due to its thin and stretchable design. CPT electrodes not only enable BRMP to assist clinicians in formulating effective rehabilitation plans and offer patients a more comfortable rehabilitation experience, but also hold promise for future applications in biological and human-machine interface domains.

Development of a human machine interface for robotically assisted surgery optimized for laparoscopic workflows.

In robotic-assisted surgery (RAS), the input device is the primary site for the flow of information between the user and the robot. Most RAS systems remove the surgeon's console from the sterile surgical site. Beneficial for performing lengthy procedures with complex systems, this ultimately lacks the flexibility that comes with the surgeon being able to remain at the sterile site. A prototype of an input device for RAS is constructed. The focus lies on intuitive control for surgeons and a seamless integration into the surgical workflow within the sterile environment. The kinematic design is translated from the kinematics of laparoscopic surgery. The input device uses three degrees of freedom from a flexible instrument as input. The prototype's performance is compared to that of a commercially available device in an evaluation. Metrics are used to evaluate the surgeons' performance with the respective input device in a virtual environment implemented for the evaluation. The evaluation of the two input devices shows statistically significant differences in the performance metrics. With the proposed prototype, the surgeons perform the tasks faster, more precisely, and with fewer errors. The prototype is an efficient and intuitive input device for surgeons with laparoscopic experience. The placement in the sterile working area allows for seamless integration into the surgical workflow and can potentially enable new robotic approaches.

(Invited) Triboelectric Nanogenerators for Self-Powered Sensing and Human-Machine-Interfaces

Wearable and portable electronics are garnering substantial interest for applications ranging from personalized healthcare monitoring to implantable devices and prosthetics. The demand for long-term operation poses significant challenges to their power supply. To address this, the development of novel self-powered systems holds considerable promise. In this talk, I will discuss our recent advancements in crafting triboelectric nanogenerators (TENGs) for self-powered sensing and human-machine interfaces (HMIs). I will first introduce our multifunctional tactile sensors inspired by human skin. These sensors combine a triboelectric nanogenerator layer with a piezoresistive sensing layer, emulating the ability of human skin to detect a variety of static and dynamic stimuli. This sensor can successfully recognize voice patterns, monitor physiological signals, and track human motion in real-time. Then, I will unveil our self-powered smart packaging system, which is driven by a novel desiccant-based triboelectric nanogenerator (D-TENG). This system offers a viable method for continuous monitoring of product conditions and quality control throughout the supply chain, thus minimizing food waste and maintaining a comprehensive log of logistics, especially critical in vaccine transport. Lastly, I will present our novel breath-driven triboelectric sensor in respiratory monitoring. This sensor can precisely detect breath variations and convert different breathing patterns into electrical signals, all without impeding normal breathing. It enables severely disabled individuals to control household appliances through a breath-driven HMI and provides an intelligent monitoring system for emergency situations. This innovative work paves the way for future development in self-powered sensors and advanced HMIs, enhancing assistive technology for individuals with disabilities.