Future Human-computer Interaction Research Articles

Recent Trends of Authentication Methods in Extended Reality: A Survey

Extended Reality (XR) is increasingly gaining momentum in industries such as retail, health, and education. To protect users’ personal data, establishing a secure authentication system for XR devices becomes essential. Recently, the focus on authentication methods for XR devices has been limited. To further our understanding of this topic, we surveyed authentication schemes, particularly systems and methods deployed in XR settings. In this survey, we focused on reviewing and evaluating papers published during the last decade (between 2014 and 2023). We compared knowledge-based authentication, physical biometrics, behavioral biometrics, and multi-model methods in terms of accuracy, security, and usability. We also highlighted the benefits and drawbacks of those methods. These highlights will direct future Human–computer Interaction (HCI) and security research to develop secure, reliable, and practical authentication systems.

Ecofriendly and high-performance flexible pressure sensor derived from natural plant materials for intelligent audible and silent speech recognition

Flexible pressure sensors (FPSs) are widely used in human–computer interaction (HCI) and medical diagnoses, but their further development faces several challenges. Integrating artificial intelligence (AI) with FPSs is indispensable for advancing the cognitive capabilities of HCI systems, but the FPS must also be ecofriendly, cost-effective, and high-performance to meet the demands of environmental protection and sustainable development. Here, a biodegradable capacitive FPS is presented that is fabricated from natural plant materials (i.e., cornstarch and lignocellulose) while exhibiting remarkable attributes such as high sensitivity (2.427 kPa−1 at 0–2 kPa), rapid response/recovery time (20/24 ms), extremely low detection limit (∼10 Pa), outstanding stability (> 6000 fatigue tests), excellent biocompatibility (survival rate exceeding 99 % in cell viability assays), and prominent biodegradability (complete degradation within 24 h). Prepared sensors were integrated with optimized AI algorithms, embedded systems, and wireless transmission technologies to develop a dual-functional (i.e., audible and silent) speech recognition system that achieved recognition rates exceeding 95 %. The developed sensor is expected to play a crucial role in future HCI and medical assistance applications.

Examining the Integration of a GPS-based Staff Performance Monitoring and Assessment System within Academic Settings

Research evidence of manipulations of appraisal systems of various institutions in Nigeria abound, and little is known about the application of a Geographical positioning system (GPS) enabled system in this context. To cover this gap, this study investigates the integration of a real-time staff performance monitoring and assessment system with GPS technology, within academic settings. With the increasing emphasis on quality education and efficient resource utilization, academic institutions are exploring innovative approaches to monitor staff performance and student outcomes. The integration of real-time performance systems offers a promising avenue to achieve these goals by providing timely feedback, fostering accountability, and facilitating data-driven decision-making processes. This study outlines the key components of such a system, including its technological infrastructure, data collection methods, and performance evaluation metrics. Additionally, it explores the potential benefits and challenges associated with its adoption, considering factors such as staff engagement, privacy concerns, and institutional culture. Through a comprehensive examination of existing literature and case studies, this research aims to provide valuable insights and recommendations for academic institutions seeking to leverage real-time staff performance monitoring for institutional enhancement and educational excellence. While this study highlights the significance of stakeholder collaboration and continuous improvement mechanisms in ensuring the successful integration and sustained effectiveness of the monitoring system, it introduces a nuanced novel GPS technology and highlights some design implications which will guide future human-computer interaction researchers.

High Toughness, Multi-dynamic Self-Healing Polyurethane for Outstanding Energy Harvesting and Sensing.

Triboelectric nanogenerators (TENGs) are an emerging class of energy harvesting devices with considerable potential across diverse applications, including wearable electronic devices and self-powered sensors. However, sustained contact, friction, and incidental scratches during operation can lead to a deterioration in the electrical output performance of the TENG, thereby reducing its overall service life. To address this issue, we developed a self-healing elastomer by incorporating disulfide bonds and metal coordination bonds into the polyurethane (PU) chain. The resulting elastomer demonstrated exceptional toughness, with a high value of 85 kJ m-3 and an impressive self-healing efficiency of 85.5%. Specifically, the TENG based on that self-healing PU elastomer generated a short circuit current of 12 μA, an open circuit voltage of 120 V, and a transfer charge of 38.5 nC within a 2 cm × 2 cm area, operating in contact-separation mode. With an external resistance of 20 MΩ, the TENG achieved a power density of 2.1 W m-2. Notably, even after self-healing, the electrical output performance of the TENG was maintained at 95% of the undamaged device. Finally, the self-healing TENG was employed to construct a self-powered noncontact sensing system that can be applied to monitor human motion accurately. This research may expand the application prospects of PU materials in future human-computer interaction and self-powered sensing fields.

CLERA: A Unified Model for Joint Cognitive Load and Eye Region Analysis in the Wild

Non-intrusive, real-time analysis of the dynamics of the eye region allows us to monitor humans’ visual attention allocation and estimate their mental state during the performance of real-world tasks, which can potentially benefit a wide range of human-computer interaction (HCI) applications. While commercial eye-tracking devices have been frequently employed, the difficulty of customizing these devices places unnecessary constraints on the exploration of more efficient, end-to-end models of eye dynamics. In this work, we propose CLERA, a unified model for Cognitive Load and Eye Region Analysis, which achieves precise keypoint detection and spatiotemporal tracking in a joint-learning framework. Our method demonstrates significant efficiency and outperforms prior work on tasks including cognitive load estimation, eye landmark detection, and blink estimation. We also introduce a large-scale dataset of 30 k human faces with joint pupil, eye-openness, and landmark annotation, which aims at supporting future HCI research on human factors and eye-related analysis.

A high-performance S-TENG based on the synergistic effect of keratin and calcium chloride for finger activity tracking

Triboelectric nanogenerator (TENG) is one of the key research directions for future human-computer interaction (HCI), biomedicine, and environmental protection. Bio-based materials are an essential branch of many degradable materials. Keratin has attracted much attention due to its advantages of easy access, biodegradability, and good biocompatibility. A highly sensitive single-electrode TENG (S-TENG) based on CaCl2/PVA/keratin and Ecoflex with micro-domes is designed. The excellent stability (18,000 cycles) and stretchability (200%) of the sensor are confirmed by research. Moreover, the presence of CaCl2 and keratin can significantly increase the S-TENG's output voltage, and the reason is also explored by the density functional theory (DFT) method. Through simulation, it is found that the decrease of the HOMO (highest occupied molecular orbital)-LUMO (lowest unoccupied molecular orbital) gap and the increase of the electrostatic potential are the root causes of the voltage increase. Relying on the excellent characteristics of the S-TENG, finger curvatures, gestures, and object shapes are recognized. Among them, the accuracy of object shape recognition by machine learning algorithm reached 98.1%. This study provides a new method for improving the output efficiency and prolonging the service life of S-TENG and confirms the feasibility of the electron cloud trap model to explain biomass triboelectric materials by keratin and CaCl2.

“It Was Really All About Books:” Speech-like Techno-Masculinity in the Rhetoric of Dot-Com Era Web Design Books

The future of Human-computer interaction (HCI) communication requires researchers to develop a strong understanding of the factors that influence design practitioners. As a step towards building that understanding, based on interviews conducted with veteran web designers, we analyze a corpus of popular web design books published during and shortly after the dot-com boom. Using a combination of ethnographic methods and discourse analysis, we identify the rhetorical strategies in these books and why they were successful in shaping our participants’ ideas about web design. We find that the books exhibit a particular style of technical writing defined by a speech-like techno-masculinity . Despite their short shelf-lives, the books and their writing style contributed to the disciplinary identity of web design which exists today. Studying the history of best practice books is an important opportunity to reflect on the genre of best practices in design, and how we should frame them in the future.

A Cross-Software Presentation Practice for Graphics-Related Digital Media

Over the years, computer graphics and digital media technologies have developed tremendously, and more and more application requirements show that excellent audiovisual effects brought by integrating multi-domain digital media technologies are the key to future human-computer interaction. This paper hopes to demonstrate the feasibility of scene integration applications using modeling software and linkage with other software such as Unity engine and music design software AbletonLive. This paper achieves the desired scene integration application by modeling simplified geometry with a self-designed cartoon-style character renderer fused with a dynamic presentation method with homemade music. All designs were combined in the Unity engine and dynamically displayed to a randomly selected audience and their evaluation data were collected. According to the statistical data, the audience had a very good impression of the multimedia design in general.

Magnetic Skin for Touchless Human–Computer Interaction to Prevent Healthcare‐Associated Infections

AbstractHealthcare‐associated infections are a major problem in hospitals, and regular disinfection methods cannot guarantee that all pathogens are eliminated. Non‐contact human–computer interactions can effectively reduce the risk of contamination by preventing direct contact between medical staff and electronic products. In this study, a new type of flexible and highly malleable magnetic skin composed of a mixture of an elastic matrix and permanent magnetic powder is demonstrated. In addition, the relationship between the magnetic skin properties and the elastic matrix, magnetic powder material, and their ratio is studied. In addition, the application of magnetic skin in gesture recognition (representing discrete gesture input) and magnetic positioning (representing continuous input) is explored to easily achieve touchless human–computer interactions. Both perform well and provide a new way for future human–computer interaction.

New Application: A Hand Air Writing System Based on Radar Dual View Sequential Feature Fusion Idea

In recent years, non-contact human–computer interactions have aroused much attention. In this paper, we mainly propose a dual view observation system based on the frontal and side millimeter-wave radars (MWR) to collect echo data of the Air writing digits “0~9”, simultaneously. Additionally, we also propose a novel distance approximation method to make the trajectory reconstruction more efficient. To exploit these characteristics of spatial-temporal adjacency in handwriting digits, we propose a novel clustering algorithm, named the constrained density-based spatial clustering of application with noise (CDBSCAN), to remove background noise or clutter. Moreover, we also design a robust gesture segmentation method by using twice-difference and high–low thresholds. In our trials and comparisons, based on the trajectories formulated by echo data series of time–distance and time–velocity of dual views, we present a lightweight-based convolution neural network (CNN) to realize these digits recognition. Experiment results show that our system has a relatively high recognition accuracy, which would provide a feasible application for future human–computer interaction scenarios.

Wearable five-finger keyboardless input system based on silk fibroin electronic skin

To get rid of the limitations of traditional keyboards, we report a new generation wearable keyboardless input system (WKIS). Based on the coupling of triboelectrification and electrostatic induction, the single-electrode mode triboelectric nanogenerator (TENG) worn on the five fingers can convert finger tapping into electrical signals. Meanwhile, by developing a number pair coding table in vowel mode, we integrated the 26 English letters and necessary instructions into WKIS with five-finger tapping. The main body of the device is an ultra-thin silk fibroin film (SF), which is biocompatible, water-permeable, breathable and skin conformal, enabling it suitable for long-term wear as a ring on the finger. Data coding and transmission process are completed through a printed circuit board (PCB) and Wi-Fi module to realize keyboard communication. Feature engineering and machine learning are employed to identify WKIS registered users with an accuracy of 92%. In addition, the WKIS provides an effective solution in smart home control, which has potential applications in future human-computer interaction, Internet of Things and VR scenarios.

Towards a Contemplative Research Framework for Training Self-Observation in HCI: A Study of Compassion Cultivation

With the emergence in human–computer interaction (HCI) of researching contemplative practices, authentic descriptions of first-person lived experience informing design are few. Most researchers in HCI are not trained in observing the mind. We draw on learnings from neurophenomenology, inspired by well-established Buddhist techniques for mind-training. We present a self-observation ofTonglen, a Buddhist meditation technique for compassion, conducted over 12 weeks. We found that to keenly observe and document the practice, it is important to go through preparatory stages of stabilising attention and observing the mind. For the practitioner-cum-researcher, the technique should be embedded into a framework training self-observation and developing meta-awareness, supported by documentation of somatic snapshots and reflective journal writing. The first-person method of self-enquiry and account of self-evidence offer insight and directions for refining first-person approaches for future HCI research in body and mind cultivation, and design implications for interactive technologies supporting any practice with a contemplative component.

A comparative assessment of Wi-Fi and acoustic signal-based HCI methods on the practicality

Wi-Fi and acoustic signal-based human–computer interaction (HCI) methods have received growing attention in academia. However, there still are issues to be addressed despite their flourishing. In this work, we evaluate the practicality of the state-of-the-art signal-based HCI research in terms of the following six aspects—granularity, robustness, usability, efficiency, stability, and deployability. The paper presents our analysis results, observations and prospective research directions. We believe that this work will serve as a standard for future signal-based HCI research for assessing the practicality of newly developed methods.

What do volunteers want from citizen science technologies? A systematic literature review and best practice guidelines

Although hundreds of citizen science applications exist, there is lack of detailed analysis of volunteers' needs and requirements, common usability mistakes and the kinds of user experiences that citizen science applications generate. Due to the limited number of studies that reflect on these issues, it is not always possible to develop interactions that are beneficial and enjoyable. In this paper we perform a systematic literature review to identify relevant articles which discuss user issues in environmental digital citizen science and we develop a set of design guidelines, which we evaluate using cooperative evaluation. The proposed research can assist scientists and practitioners with the design and development of easy to use citizen science applications and sets the basis to inform future Human-Computer Interaction research in the context of citizen science.

Large-Screen Interactive Imaging System with Switching Federated Filter Method Based on 3D Sensor

Large-screen human-computer interaction technology is reflected in all aspects of daily life. The dynamic gesture tracking algorithm commonly used in recent large-screen interactive technologies demonstrates compelling results but suffers from accuracy and real-time problems. This paper systematically addresses these issues by a switching federated filter method that combines particle filtering and Mean Shifting algorithms based on a 3D sensor. Compared with several algorithms, the results show that the one-hand and two-hand large-screen gesture tracking based on the switched federated filtering algorithm work well, and there is no tracking failure and loss of target. Therefore, the switching federated tracking positioning algorithm can be well applied to the design of human-computer interaction system and provide new ideas for future human-computer interaction.

Flexible pressure sensor based on PVDF nanofiber

The development of wearable electronic devices has created a better blueprint for future human-computer interaction and intelligent living. Flexible pressure sensor is an important link to the development of wearable electronic devices. Despite significant progress made to date, there are still issues to be solved, including complex material synthesis, cumbersome preparation process and poor sensitivity response to human body signal. In this paper, we report flexible sensors that could be applied in different conditions. The sensors are fabricated by combination electrospinning-prepared PVDF nanofiber film with PDMS/Ag NWs and PET/ITO electrodes, respectively. The sensors based on PVDF nanofiber film feature good piezoelectric property with quantitative pressure measurement. Furthermore, they can act as a real-time monitor of human movement due to their conformal form factors. In addition, the sensors realize non-direct contact sensing, providing a broad design idea for future non-contact human-computer interaction. Our approach provides a new, simple, and cost-effective strategy for the development of wearable pressure sensors.

Towards a Pluralistic Epistemology: Understanding Human-Technology Interactions in Shipping from Psychological, Sociological and Ecological Perspectives

In the shipping domain, many innovative technical systems have been designed and developed in the past decades, aiming to enable the maritime users to achieve the goal of safety, efficiency and effectiveness. The introduction of advanced technologies into workplaces have also created unprecedented challenges. Human users frequently find themselves in a supporting role to serve technology, being responsible for automation issues and blamed for errors that sometimes result in tragic results. These challenges are closely associated with the design and use of technologies. Human-technology interactions has become an important multidisciplinary research topic for shipping. This article reviews theoretical concepts relative to the dimensions of psychology, sociology and ecology in Human Computer Interaction (HCI) in order to form a deeper understanding of human-technology interactions. This paper also discusses the theoretical constructs' practical relevance by showing how a few cases exemplifying ongoing development sectors in shipping, such as energy efficiency optimisation, supervisory control of autonomous unmanned ships, and eco-systems in engine control rooms, are understood with these theoretical perspectives. By presenting multidisciplinary understandings of human-technology interaction, this paper aims to derive knowledge pertinent to methodological approaches and philosophical stances of future maritime human factors and HCI research.

Visualizing genome and systems biology: technologies, tools, implementation techniques and trends, past, present and future.

“Α picture is worth a thousand words.” This widely used adage sums up in a few words the notion that a successful visual representation of a concept should enable easy and rapid absorption of large amounts of information. Although, in general, the notion of capturing complex ideas using images is very appealing, would 1000 words be enough to describe the unknown in a research field such as the life sciences? Life sciences is one of the biggest generators of enormous datasets, mainly as a result of recent and rapid technological advances; their complexity can make these datasets incomprehensible without effective visualization methods. Here we discuss the past, present and future of genomic and systems biology visualization. We briefly comment on many visualization and analysis tools and the purposes that they serve. We focus on the latest libraries and programming languages that enable more effective, efficient and faster approaches for visualizing biological concepts, and also comment on the future human-computer interaction trends that would enable for enhancing visualization further.

Regressive Augmentation: Investigating Ubicomp’s Romantic Promises

Regressive Augmentation: Investigating Ubicomp’s Romantic Promises

A Glance into the Future of Human Computer Interactions

Computers have a direct impact on our lives nowadays. Human's interaction with the computer has modified with the passage of time as improvement in technology occurred the better the human computer interaction became. Today we are facilitated by the operating system that has reduced all the complexity of hardware and we undergo our computation in a very convenient way irrespective of the process occurring at the hardware level. Though the human computer interaction has improved but it's not done yet. If we come to the future the computer's role in our lives would be a lot more rather our life would be of the artificial intelligence. In our future the biggest resource would be component of time and wasting time for a key board entry or a mouse input would be unbearable so the need would be of the computer interaction environment that along with the complexity reduction also minimizes the time wastage in the human computer interaction. Accordingly in our future the computation would also be increased it would not be a simple operating system limited to a computer it would be computers managing our entire life activities hence fall out of domain of present computers electronic based architecture .In this research paper we propose a model that shall be meeting the future human computer interaction needs possessing linguistic human computer interference environment based on surface technology, automation and photonic computing, which would be reliable, efficient and quicker satisfying all the future artificial intelligence pre requisites.