Human-computer Interface Design Research Articles

GestureFusion: A Gesture-based Interaction System

Abstract: In an era of increasingly sophisticated human-computer interaction, the ability to comprehend and interpret hand gestures has become a pivotal element for bridging the gap between humans and machines. This project, titled ”GestureFusion: A Gesture-based Interaction System,” seeks to contribute to this rapidly evolving field by developing a comprehensive system for recognizing and categorizing hand gestures through the application of computer vision techniques. The primary objective of this project is to create a versatile and extensible hand gesture recognition system that can be employed in various domains such as virtual reality, robotics, sign language interpretation, and human-computer interface design. To achieve this, the project employs state-of-the-art computer vision algorithms and deep learning techniques. Key components of this project include data collection and annotation, model training and optimization, the development of a user-friendly application programming interface (API) for integration into diverse applications.

Adaptive Human–Computer Interface Design for Supervision Task Based on User Attention and System State

The rapid development of computer information technology has increased the complexity of the human–computer interface, especially in supervision tasks. It is difficult for users to pay attention to multiple information and make decisions in real-time, which needs higher requirements for the design of a human–computer interface. The research designs a novel adaptive human–computer interface using the Adaptive Interface Design (AID) framework: Combining the real-time user attention and system state as the input layer of AID; Building a hybrid entropy attention allocation model as the decision layer of AID; Adjusting the real-time saliency of the information in the interface as the output layer of AID. The comparative experiments in supervision tasks are conducted to test the performance of the users in the designed adaptive interface and traditional interface. The results show that the designed adaptive human–computer interface can effectively improve the supervisors’ performance and reduce the risk of system failure.

Usable AI: Critical Review of Its Current Issues and Trends

Usable Artificial Intelligence (AI) application refers to an AI solution that is characterized by the easiness of use and learning through an optimum interface established by a proficient Human-Computer Interface (HCI) design. This article reviews the related literature to find out the importance of HCI to make AI valuable and usable. The article also investigates the possible solutions and guidelines that ensure the usability of AI-powered applications as well as the corresponding challenges of designing usable AI. It also essentially explores several usability evaluation methods employed by recent studies. The findings demonstrate the substantial role of HCI in designing Human-centred AI (HAI) applications. HAI lets AI applications support humans instead of replacing them and grants user’s better control over security and privacy. No standard usability measures exist and more research is required especially on the issues of interpretability, integrability, and collaboration.

Study on the Availability of Digital Interactive Mode of Scenic Spots Guidance System

Some characteristics and advantages of human-computer interaction interface design based on scenic spot guidance, in order to better apply human-computer interaction interface in product usability, the user model, user interface model, multi-channel interaction information integration, pen-based interaction technology, human-computer interaction software architecture and other contents in human-computer interaction are analyzed. It solves the problem of product homogeneity caused by traditional cognitive interaction and makes the design of interactive products return to focusing on users and interaction itself. The feasibility and rationality of the interactive product design method based on usability theory are verified through design practice, and this method has certain guiding significance.

Radar-Based Air-Writing Gesture Recognition Using a Novel Multistream CNN Approach

Hand gestures, being a convenient and natural way of communication, is getting huge attention for human–computer interface designs. Among these gestures, detecting mid-air writing is one of the most promising applications. Existing radar-based solutions often perform the mid-air writing recognition by tracking the hand trajectory using multiple monostatic or bistatic radars. This article presents a multistream convolutional neural network (MS-CNN)-based in-air digits recognition method using a frequency-modulated continuous-wave (FMCW) radar. With one FMCW radar comprising of two receiving channels, a novel three-stream CNN network with range-time, Doppler-time, and angle-time spectrograms as inputs is constructed and the features are fused together in the later stage before making a final recognition. Unlike the traditional CNN, MS-CNN with multiple independent input layers enables the creation of a multidimensional deep-learning model for FMCW radars. Twelve human volunteers were invited to writing the digits from zero to nine in the air in both home and lab environments. The three-stream CNN architecture-based air writing for digits has shown a promising accuracy of 95%. A comparison of the proposed MS-CNN system was made with 45 different variants of CNN and preliminary results shows that MS-CNN outperforms the other traditional CNN architectures for air-writing application. The gestures radar data have also been made available to the research community.

A Review of Multimodel User Interface in Human Computer Interface Design

The evolution of computers has inspired the conception of Human-Computer Interaction (HCI). Experiments in HCI are increasingly including members of the next generation (those in their twenties and thirties) who are well educated and proficient in modern technologies. In this paper, behavioral and technological issues are both addressed in the field of HCI. The primary goal of this research in HCI is to shed light on previously unseen perspectives of human behavior and its connection to technology. The concept of resilience has been used in several contexts, including the corporate world, psychology, education, and the economics. Self-efficacy, optimism, self-awareness, and the ability to derive meaning from one's experiences are just a few of the foundational factors that contribute to resilience. An improved organization's resilience may be achieved via the use of this method. All of this will be done by resilience in order to increase people's awareness of the tools at their disposal for dealing with the difficulties that already exist.

HCI – Human Computer Interaction Yesterday… Today… Tomorrow…

The theory of human-computer interaction is a new scientific direction today. Human-Computer Interaction (HCI) is a field of research and practice that developed in the early 1980s. Human-computer interaction (HCI) is an accompanying multidisciplinary field (e.g., engineering, psychology, ergonomics, design) that studies the theory, design, implementation, ways and methods of evolution of how people use computer devices and how they interact with them. Many researchers work to develop human-computer interaction. They represent a wide range of sciences: design, psychology, journalism ... Human computer interaction (HCI) specialists are in great demand in technology companies, which in turn influences the development of human computer interaction (HCI) training courses at universities. The paper discusses the basic theoretical and technological principles of HCI (Human Computer Interaction) human-computer interaction, based on the research papers of well-known scientists (Mandel Theo; Alan Dix; Janet Finlay; Russel Beale; John M. Carroll; Gregory Abowd; John Brooke; Jonathan Grudin; Emily LR Harriosn; Deborah Gail Tatar; Phoebe Sengers; Brad A. Myers; Christofer D. Wickens; John Lee; Yili D. Liu; Sallie Gordon-becker; Donald Norman; Elizabeth Churchill; Anne Bowser; Jennifer Preece; Gerard Jounghyum Kim; Hinze-Hoare Vita; Jakob Nielsen; Wilfred J. Hansen etc.) working in this field. The paper reviews the historical aspects of the development of human-computer interaction is; Its essence as a science is defined in the manuscript. The focus is on important aspects of human-computer interaction. Namely, the goals of human-computer interaction; Structure; Principles; Models; Systems; The principles of human-computer interface design are outlined, the importance of interface functionality and usability in the human-computer interaction process is shown; The concepts of interaction and interface are compared. Human-computer interaction approaches with current and future technologies are presented.

Development of Multi-Function Vehicle Intelligent System Based on ARM

At present, with the progress of science and technology in the world and the improvement of people’s living standards, the number of cars is increasing rapidly. People’s demand for tourism has become a new bright spot, and the demand for transportation system services is getting higher and higher. Taxi has become an indispensable means of travel for people. Based on the original functions of taxi management system, this paper presents a multi-functional taxi intelligent system, which integrates security alarm, traffic record, wireless communication and remote monitoring, based on Cortex-A8 embedded development platform and Linux kernel programming. With the advantage of embedded system, the algorithm is optimized by using the idea of communication between threads. The communication between modules is realized, and the reliability and stability of the system are effectively improved. For remote video surveillance system, through the CGI process writing and the design of human-computer interaction interface, the system realizes the web surveillance of alarm settings, driving records and real-time monitoring of vehicle data, which further enhances the functions of the system. The test results show that the system has good traffic safety functions, and the data exchange between the web monitoring system and the on-board system is smooth, which meets the expected design requirements.

Design of Human-Machine Interaction Interface for Autonomous Vehicles Based on Multidimensional Perceptual Context

The objective of the study is to provide guidance for automobile human-computer interface design through the research, practice, and evaluation of intelligent driving automobile human-computer interfaces. In this study, the methods of intelligent vehicle automatic cruise control function, theoretical models of the situation analysis, and a three-level information architecture are proposed and designed. During the study, interface space layout is combined with the interactive interface design. The results obtained on the basis of the proposed three levels of perception and prediction of situation awareness are combined with typical application scenarios. The information on AR-HUD and W-HUD in anterior cingulate cortex (or ACC) function is analyzed. The feasibility of the theory is verified through the design practice of information architecture design, key prototype, and typical effect diagram. The human-computer interaction interface based on situational awareness can effectively clarify the display content and process of information and improve the usability of the interface.

An Affective Interaction System using Virtual Reality and Brain-Computer Interface.

Affective Computing is a multidisciplinary area of research that allows computers to perform human emotion recognition, with potential applications in areas such as healthcare, gaming and intuitive human computer interface design. Hence, this paper proposes an affective interaction system using dry EEG-based Brain-Computer Interface and Virtual Reality (BCI-VR). The proposed BCI-VR system integrates existing low-cost consumer devices such as an EEG headband with frontal and temporal dry electrodes for brain signal acquisition, and a low-cost VR headset that houses an Android handphone. The handphone executes an in-house developed software that connects wirelessly to the headband, processes the acquired EEG signals, and displays VR content to elicit emotional responses. The proposed BCI-VR system was used to collect EEG data from 13 subjects while they watched VR content that elicits positive or negative emotional responses. EEG bandpower features were extracted to train Linear Discriminant and Support Vector Machine classifiers. The classification performances of these classifiers on this dataset and the results of a public dataset (SEED-IV) are then evaluated. The results in classifying positive vs negative emotions in both datasets (~66% for 2-class) show promise that positive and negative emotions can be detected by the proposed low cost BCIVR system, yielding nearly the same performance on the public dataset that used wet EEG electrodes. Hence the results show promise of the proposed BCI-VR system for real-time affective interaction applications in future.

Design and Implementation of Human-Computer Interface for Participatory Art Video Development Platform Based on Interactive Non-linear Algorithm.

Artificial intelligence (AI) technology is innovatively combined with participatory video for artistic creation and communication to improve the enthusiasm of art lovers for artistic creation and communication and expand the application range of AI technology. First, the interactive framework of interactive participation video is proposed based on the analysis of the related literature of interactive non-linear video. Then, a questionnaire is designed accordingly to analyze the social needs of people on art social platforms. According to the survey results, the participatory art video online communication platform is designed and preliminarily realized. Finally, a participant video eye movement control experiment is conducted to test the performance of the participatory art video development platform. Meanwhile, the platform is evaluated through field research from two aspects of test efficiency and user experience. The results show that the operation time of the participatory art video development platform is much shorter than that of the control group. It takes only approximately 15 s to complete the annotation operation with low SD, indicating that the system performance is stable. The accuracy of the platform also reaches 100%.

Building personas from phenomenography: a method for user-centered design in education

PurposePersonas are lifelike characters that are driven by potential or real users’ personal goals and experiences when interacting with a product. Personas support user-centered design by focusing on real users’ needs. However, the use of personas in educational research and design requires certain adjustments from its original use in human-computer interface design. This paper aims to propose a process of creating personas from phenomenographic studies, which helps us create data-grounded personas effectively.Design/methodology/approachPersonas have features that can help address design problems in educational contexts. The authors compare the use of personas with other common methodologies in education research, including phenomenology and phenomenography. Then, this study presents a six-step process of building personas using phenomenographic study as follows: articulate a design problem, collect user data, assemble phenomenographic categories, build personas, check personas and solve the design problem using personas. The authors illustrate this process with two examples, including the redesign of a professional development website and an undergraduate research program design.FindingsThe authors find that personas are valuable tools for educational design websites and programs. Phenomenography can productively help educational designers and researchers build sets of personas following the process the authors propose.Originality/valueThe use and method of personas in educational contexts are scarce and vague. Using the example contexts, the authors provide educational designers and researchers a clear method of creating personas that are relatable and applicable for their design problems.

Human Reliability Evaluation Based on Objective and Subjective Comprehensive Method Used for Ergonomic Interface Design

In the process of machining, the operator’s incorrect operation using the control human-computer interaction interface may lead to a disastrous effect on the whole production chain such as task failure and system failure. The eight types of using errors about human-computer interaction interface system (misperception, memory lapse, carelessness, improper decision-making, improper operation, improper interface layout design, improper icon and text display design, and improper prompt feedback) are proposed based on the cognition from users. According to the eight types of using error, the human reliability and safety evaluation method is proposed. Considering the variability objective and uncertainty subjective factors in the human-machine interaction process, the human reliability evaluation method is proposed based on objective and subjective comprehensive weighting under ergonomic principles. Firstly, based on the investigation of relevant machine tool interface design, the comprehensive evaluation index system for man-machine reliability of complex interface design is established. Secondly, an objective and subjective comprehensive weight assignment method as the composition of Theilʼs entropy weight method combined with TOPSIS (Technique for Order Preference by Similarity to an Ideal Solution) and improved AHP (analytic hierarchy process) method combined with fuzzy mathematics is proposed. It can not only effectively avoid the impact of excessive subjective factors on empowerment but also fully excavate the real information in the survey data and improve the objectivity and accuracy of the weight data of evaluation indicators at all levels. Thirdly, taking the interface design of CNC machine tool equipment for example, the best human-computer interaction interface design schemes are chosen according to the human reliability evaluation method based on objective and subjective comprehensive method calculated by Entropy-TOPSIS-AHP. Finally, based on eye movement experiments, the use efficiency and accuracy of the human-computer interaction interface design scheme chosen by the assessment method are better than the other design schemes or original one to verify the assessment method validity.

Contactless differentiation of pleasant and unpleasant valence: Assessment of the acoustic startle eyeblink response with infrared reflectance oculography.

The ability to distinguish between discrete emotions by monitoring autonomic or facial features has been an elusive "holy grail" for fields such as psychophysiology, affective computing, and human-computer interface design. However, cross-validated models are lacking, and contemporary theory suggests that emotions may lack distinct physiological or facial "signatures." Therefore, in this study, we propose a reorientation toward distinguishing between pleasant and unpleasant affective valence. We focus on the acoustic eyeblink response, which exhibits affective modulation but remains underutilized. The movement of the eyelid was monitored in a contactless manner via infrared reflectance oculography at 1 kHz while 36 participants viewed normatively pleasant, neutral, and unpleasant images, and 50-ms bursts of white noise were presented binaurally via headphones. Startle responses while viewing pleasant images exhibited significantly smaller amplitudes than those while viewing unpleasant images, with a large effect size (d = 1.56). The affective modulation of the eyeblink startle response is a robust phenomenon that can be assessed in a contactless manner. As research continues on whether systems based on psychophysiological or facial features can distinguish between discrete emotions, the eyeblink startle response offers a relatively simple way to distinguish between pleasant and unpleasant affective valence.

Communicative Functions in Human-Computer Interface Design: A Taxonomy of Functional Animation

Whenever a user performs a task or communicates via their computer or device, they are guided by visual cues to interact successfully with the interface. This human-computer interaction is, therefore, mediated by the communication established between designer and user through the texts, graphic elements, and animations that make up the visual design of the interface. Animation is an element of visual language of the graphical elements of an interface. This study aims to establish the functions of animation. We reviewed the literature and discussed the shortcomings identified in the existing taxonomies of functional animation. We then proposed an updated classification, partly inspired by the functions presented in Jakobson’s communication model. Based on a content analysis of the design guidelines from the leading mobile phone developers and comparing these sources, we propose the following list of categories: Identifying, Structural, Guide, Feedback, Didactic, Esthetic, and Emotive. This new taxonomy aims to contribute to the theoretical frameworks used in visual communication when studying interface design. It will be useful, for example, to help detect, classify, and assess the appropriateness of animations based on the functions they provide to an interface.

Visualization and ecohydrologic models: Opening the box

AbstractEarth system models synthesize the science of interactions amongst multiple biophysical and, increasingly, human processes across a wide range of scales. Ecohydrologic models are a subset of earth system models that focus particularly on the complex interactions between ecosystem processes and the storage and flux of water. Ecohydrologic models often focus at scales where direct observations occur: plots, hillslopes, streams, and watersheds, as well as where land and resource management decisions are implemented. These models complement field‐based and data‐driven science by combining theory, empirical relationships derived from observation and new data to create virtual laboratories. Ecohydrologic models are tools that managers can use to ask “what if” questions and domain scientists can use to explore the implications of new theory or measurements. Recent decades have seen substantial advances in ecohydrologic models, building on both new domain science and advances in software engineering and data availability. The increasing sophistication of ecohydrologic models however, presents a barrier to their widespread use and credibility. Their complexity, often encoding 100s of relationships, means that they are effectively “black boxes,” at least for most users, sometimes even to the teams of researchers that contribute to their design. This opacity complicates the interpretation of model results. For models to effectively advance our understanding of how plants and water interact, we must improve how we visualize not only model outputs, but also the underlying theories that are encoded within the models. In this paper, we outline a framework for increasing the usefulness of ecohydrologic models through better visualization. We outline four complementary approaches, ranging from simple best practices that leverage existing technologies, to ideas that would engage novel software engineering and cutting edge human–computer interface design. Our goal is to open the ecohydrologic model black box in ways that will engage multiple audiences, from novices to model developers, and support learning, new discovery, and environmental problem solving.

Development of Human-Computer Interactive Interface for Intelligent Automotive

The wide application of information technology and network technology in automobiles has made great changes in the Human-computer interaction. This paper studies the influence of Human-computer interaction modes on driving safety, comfort and efficiency based on physical interaction, touch screen control interaction, augmented reality, speech interaction and somatosensory interaction. The future Human-com-puter interaction modes such as multi-channel Human-computer interaction mode and Human-computer interaction mode based on biometrics and perception techno-logy are also discussed. At last, the method of automobile Human-computer interaction design based on the existing technology is proposed, which has certain guiding significance for the current automobile Human-computer interaction interface design.

Application of colour combinations on visual search tasks under vibration environments

AbstractColour is widely utilised as a visual coding system in visual search, but its application under vibration conditions (e.g., in various vehicles) has not been fully explored. This study was designed to examine the effect of colour combinations on performance of visual search tasks conducted in vibration conditions. Forty-eight university students participated in an experiment where they were required to identify target type and location under 24 colour combinations (half in negative polarity and half in positive polarity) and three vibration conditions (static, low, and high). The findings showed that vibration did not significantly affect performance, perceptions, or physiological aspects. Colour combination significantly affected response time, and the participants preferred colour combinations that had the potential to produce better performance. Colour combinations with negative polarity (e.g., yellow on black and white on black) are recommended for presenting search interfaces. These findings are of importance in human–computer interface designs for information display under vibration conditions.

Research on Man-Machine Optimization Design Method of Marine Manufacturing Equipment Based on Visual Communication Elements

Ma, K. and Lee, S.-W., 2020. Research on man-machine optimization design method of marine manufacturing equipment based on visual communication elements. In: Yang, D.F. and Wang, H. (eds.), Recent Advances in Marine Geology and Environmental Oceanography. Journal of Coastal Research, Special Issue No. 108, pp. 294–297. Coconut Creek (Florida), ISSN 0749-0208.Many countries have developed marine equipment systems, where the overall level of marine manufacturing equipment can be regarded as a symbol of the comprehensive strength of a country, and the design ability directly determines the economic development of a country. The design of manufacturing equipment is a key issue in the field of marine manufacturing. This article examines, from the point of view of man-machine optimization, how to realize the harmonious design of man, machine, and environment for marine manufacturing equipment. Based on visual communication elements and manufacturing equipment with the man-machine optimization design method, an evaluation system and research of the human-computer interaction interface design formed a system of marine man-machine optimization design, evaluation, and improvement of manufacture equipment. Manufacturing equipment for marine man-machine optimization design provides a new train of thought. For marine equipment design, level of ascension offers a feasible theoretical basis and evaluation method. This study has important theoretical value and practical significance.

Research on Human-Machine Interface Optimization Design of Numerical Control Machine Tools in Ocean Engineering Based on Visual Communication Perception Field

Wang, X.Y., 2020. Research on human-machine interface optimization design of numerical control machine tools in ocean engineering based on visual communication perception field. In: Bai, X. and Zhou, H. (eds.), Advances in Water Resources, Environmental Protection, and Sustainable Development. Journal of Coastal Research, Special Issue No. 115, pp. 322-326. Coconut Creek (Florida), ISSN 0749-0208.Due to the ocean engineering equipment gradually to the largescale, deepwater, constantly improve the performance requirements, Marine engineering equipment need to improve the processing ability in machining measurement, meanwhile also need complete set of processing equipment and software, to provide support for Marine engineering equipment development, so that the Marine engineering equipment to the development of intelligent, fine. In order to can effectively improve efficiency and comfort of the human-computer interaction interface of CNC machine tools, this paper focuses on visual communication awareness field optimize the human-computer interface design, and strength grade from the human-computer interaction interface visual sensation and perception elements for analysis research, through optimizing design model which is used to test the design.