Development Of Human-computer Interaction Research Articles

Implementation of Gesture-Based Virtual Keyboard and Mouse

The development of human-computer interaction has seen a major change in the last few years, moving in the direction of more user-friendly and effective interfaces. This tendency has prompted researchers to investigate new input techniques, especially in the field of gesture-based control systems. By utilizing both hand and eye gestures to create a gesture-based virtual mouse and keyboard, this paper introduces a novel method of human-computer interaction. The suggested system offers users a smooth and simple way to interact with computers by combining hand gesture recognition and eye-tracking technology. Users can control cursor movement and keyboard inputs without the use of physical peripherals by using the system to track their hand and eye movements and interpret them as commands. The incorporation of eye-tracking technology improves the system's accuracy and responsiveness, enabling more precise cursor control and interaction with elements displayed on the screen. Hand gesture recognition, on the other hand, gives users an ergonomic and natural way to input data, allowing them to carry out commands with straightforward motions. The architecture of the system combines real-time processing capabilities to guarantee low latency and high responsiveness with sophisticated machine-learning algorithms for gesture recognition. Additionally, users can define their gesture commands according to their needs and preferences because the system is flexible and customizable. The suggested gesture-based virtual mouse and keyboard system has undergone rigorous testing and evaluation, and the results show promising performance and usability in a range of scenarios and applications. This novel method of interacting with computers has the potential to improve user experience, accessibility, and productivity in a variety of computing contexts. Keywords: Human-Computer Interaction, Gesture Recognition, Eye-Tracking

Human-Computer Interaction Applied in Rental Market

The development of Human-Computer Interaction (HCI) provides opportunities and chal-lenges for humans. The growing uses of HCI are applied in broad industries, such as the technology industry, medical industry, and commerce industry, etc. This article indicates the importance of HCI in the commerce industry by comparing two rental apps and how these HCI principles can be applied to serve users better.

Application of an Improved LSTM Model to Emotion Recognition

The rise of artificial intelligence technology has promoted the development of human-computer interaction and other fields. In human-computer interaction, in order to enable the machine to accurately perceive and understand the user’s emotion in real time, thereby improving the service quality of the machine, user emotion recognition has been widely studied. In real life, because voice output not only is convenient, but also contains rich emotional information, human-computer interaction is mainly carried out in the form of voice. Speech carries a wealth of linguistic, paralinguistic, and nonlinguistic information that is essential for human-computer interaction. Understanding language information alone will not allow a computer to fully comprehend the speaker’s purpose. For computers to behave like humans, speech recognition systems must be able to process nonverbal information, such as the emotional state of the speaker. As a result, developing machine understanding of human emotions requires speech-based emotion recognition. This paper proposes an improved long short-term memory network (ILSTM) for emotion recognition. Because the initial LSTM only analyzes the preceding moment’s input, it will miss out on a lot of information for the full context scene. In this way, all the features in the speech segment can be extracted. In order to be able to select the feature that can express emotion the most among the many features, this paper also introduces the attention mechanism. Experiments are carried out on public datasets, and the experimental results show that the ILSTM used in this paper is very effective in classifying speech emotion data and the classification accuracy can reach more than 0.6. This fully shows that this research can be applied to actual products and has certain feasibility and reference value.

Towards Sustainable ICTD in Bangladesh: Understanding the Program and Policy Landscape and Its Implications for CSCW and HCI

Historically, Computer-Supported Cooperative Work (CSCW) and Human-Computer Interaction for Development (HCI4D) researchers in the Global South have advocated for a community-based approach to technology design and development. However, even with this "bottom-up" emphasis, the sustainability and scalability of the resulting innovations remain major challenges, and are poorly understood. To address this gap, we take the case of Bangladesh as a typical Global South context in which development work is carried out by a complex intertwined network of stakeholders across governments, NGOs, donors, and industries. To better understand the current development landscape and its priorities for digital technologies, we conducted interviews with 14 influential decision-makers in Bangladesh who play significant roles in the development of nutrition strategies. Our findings highlight a disconnect between the Bangladesh government's "digital mandate" and the reality of digital innovation practice within the nutrition development sector. Our paper contributes to the debate on factors that affect decision-making processes. We explore the dynamics of diverse actors and institutions who are intended to participate in, but can act as obstacles to sustained bottom-up innovations. Our findings expand understanding of institutional priorities, the dynamics of intermediaries, techno-solutionism, postcolonialism, bureaucracy, competition, and other important topics in CSCW scholarship. We suggest understanding the factors that guide the decision-making process of digital innovation practices in terms of four dimensions: internal, external, vertical, and horizontal. Consequently, we recommend CSCW and HCI researchers become mediators to connect decision-makers and communities and bring their voices in ICT innovations for global development. Finally, we offer recommendations for proactive engagement with decision-making stakeholders, enabling researchers to design community-centered sustainable digital innovations for development.

Literature Review on Western Audiovisual Synesthesia and Art Experiment Research

Synesthesia, as a perceptual phenomenon and concept, has jumped out of the concept of “senses” with the development of human-computer interaction. The Western exploration of audiovisual art has also ushered a qualitative leap. According to the social process, the present study systematically sorted out the historical context of the development of Western audiovisual synesthesia and its art experiments, and paved the way for the follow-up study of audiovisual synesthesia.

Human-Computer User Interface Design for Semiliterate and Illiterate Users

Information and Communication Technology (ICT) has revolutionized the lives of the people. The technology is embedded in daily life of literate or semiliterate/illiterate users. However, the user interface (UI) requirements for semiliterate/illiterate users are different from that of an educated person. The researchers of Human Computer Interaction for Development (HCI4D) face challenges to improve the usability of a UI for the semiliterate users. Therefore, a Systematic Literature Review (SLR) is conducted to provide a set of design factors and guidelines for UI development of semiliterate users. The study is based on extensive research gathered from literature to understand the user-centered design (UCD) approach, enhancing user experience (UX) for semiliterate users. This study analyses fifty two research articles that are published during 2010-2020. The findings shed light on the systematization of UI design guidelines for semiliterate/illiterate users. These guidelines can help in taking advantage of ICT during the COVID-19 pandemic. The analysis shows that seventeen main design factors are indispensable for designing UI of semiliterate users. The most suggested design factors include localization and graphics, which should be incorporated in UI for the target population. Moreover, the lag in the design factors as personalization and consistency open a road for future research.

Research on multi-feature human pose model recognition based on one-shot learning

With the development of human-computer interaction, virtual reality, and other related fields, human posture recognition has become a hot research topic. Since the human body belongs to a non-rigid model and has time-varying characteristics, the accuracy and robustness of recognition are not ideal. Based on the KinectV2 so-matosensory camera to collect skeletal information, this paper proposes a one-shot learning model matching method based on human body angle and distance characteristics. First, feature extraction is performed on the collected bone information, and the joint point vector angle and joint point displacement are calculated and a threshold is set. Secondly, the pose to be measured is matched with the template pose, and the recognition is successful if the threshold limit is met. Experimental results show that the method can detect and recognize human poses within the defined threshold in real-time, which improves the accuracy and robustness of recognition.

基于具身认知的人机交互发展研究

基于具身认知的人机交互发展研究

Virtual Reality Interactive Method and Device Based on Wireless Communication Tracking

Virtual reality is a computer system that creates a virtual world and then experiences through multiple senses. It is generated by a computer and stimulated by perception systems such as hearing, vision, touch, taste, and smell, providing users with a personal experience. Human‐computer interaction is one of the core technologies of virtual reality. Wireless communication is the transmission of communications over long distances between multiple nodes without propagation through conductors or cables and can be carried out using radios, radios, etc. Wireless communication includes a variety of fixed, mobile, and portable applications such as two‐way radios, mobile phones, personal digital assistants, and wireless networks. Other examples of radio wireless communication are GPS, garage door remotes, wireless mice, etc. Most wireless communication technologies use radio, including Wi‐Fi with distances of just a few meters, but also deep space networks that communicate with Voyager 1 and distances of over millions of kilometers. With the continuous development of sensors and other supporting hardware facilities, the current development of human‐computer interaction in virtual reality has made rapid progress. In the research to be conducted in this article, the virtual reality system used in this article cleverly integrates the three characteristics of immersion, interactivity, and conception, so that the experimenter can obtain more realistic data in comparison. To this end, this article first gives a general introduction to virtual reality technology and wireless communication tracking technology and then explains how to use wireless communication tracking technology to make the virtual reality interactive system smoother and smoother, as well as the introduction of its devices. This article explores and analyzes the possible or existing problems of wireless communication tracking technology in virtual reality interaction, hoping to contribute to the wider application of wireless communication tracking technology in virtual reality interaction. The positioning experiment on the wireless mobile signal identification points can be obtained. Among the 40 sensor nodes that are randomly deployed, when the interval of adjusting the mobile signal identification point to broadcast the current position information is 5 s, the average positioning error of the node is about 1.5 m; when the interval is 3 s, the average positioning error of the node is about 1.76 m. It can be seen that the positioning error of the node increases as the interval between the mobile signal identification points increases, which is consistent with the simulation detection result. When the node position of the target signal identification point is chosen to calculate does not just stay on the node communication circle, it introduces a certain localization distance difference, and the further the target signal identification point is from the position of the signal circle, the greater the error. Irregularity of RSS due to environmental changes analyzes the maximum error and provides the factors influencing the error and analyzing the maximum error and provide the factors that influence it.

Restoration Work

There has been a growing commitment across the fields of Computer-Supported Cooperative Work (CSCW) and Human-Computer Interaction for Development (HCI4D) towards investigating the design and deployment of technologies in the context of complex healthcare ecologies. We present a qualitative inquiry of one such context, as we examine the outreach practices and everyday challenges of workers at a community-based organization in Gujarat (India) that works with People Living with the Human Immuno-deficiency Virus(PLHIV). Drawing on Yosso's framework of community cultural wealth-apt for such intersectional settings-and the lens of articulation work, we describe how the workers at Vikas build and strengthen varied forms of capital to restore "old normals," or what life was like for their PLHIV clients prior to diagnoses. Finally, we propose that attention to this nature of restoration work, and the workers' engagement with diverse forms of community cultural wealth, allows us to reflect on how technologies might (or might not) be designed to impact social and affective aspects of health.

Design and Development of Human-Computer Interaction through Judicial Expert System for Violence against Female

This paper focuses on Human-Computer interaction by designing and implementing for Crimes against Women Judicial Expert System (CAWJES). This CAWJES imitates the role of a lawyer or guidance counselor of NGO to offer a virtual mentor. Lawyer or legal advisers will at all times use this system to determine the crime happened on the women. However, CAWJES designed to change this manual system into computerized system. The CAWJES is rule-based expert system. Development of CAWJES carried out by using expert system development life cycle. This paper focuses on Human-Computer Interaction (HCI) applied in CAWJES.

A real-time vision-based hand gesture interaction system for virtual EAST

The virtual Experimental Advanced Superconducting Tokamak device (VEAST) is a very complicated 3D model, to interact with which, the traditional interaction devices are limited and inefficient. However, with the development of human-computer interaction (HCI), the hand gesture interaction has become a much popular choice in recent years. In this paper, we propose a real-time vision-based hand gesture interaction system for VEAST. By using one web camera, we can use our bare hand to interact with VEAST at a certain distance, which proves to be more efficient and direct than mouse. The system is composed of four modules: initialization, hand gesture recognition, interaction control and system settings. The hand gesture recognition method is based on codebook (CB) background modeling and open finger counting. Firstly, we build a background model with CB algorithm. Then, we segment the hand region by detecting skin color regions with “elliptical boundary model” in CbCr flat of YCbCr color space. Open finger which is used as a key feature of gesture can be tracked by an improved curvature-based method. Based on the method, we define nine gestures for interaction control of VEAST. Finally, we design a test to demonstrate effectiveness of our system.

A Model of Mental State Transition Network

Emotion is one of the most essential and basic attributes of human intelligence. Current AI (Artificial Intelligence) research is concentrating on physical components of emotion, rarely is it carried out from the view of psychology directly(1). Study on the model of artificial psychology is the first step in the development of human-computer interaction. As affective computing remains unpredictable, creating a reasonable mental model becomes the primary task for building a hybrid system. A pragmatic mental model is also the fundament of some key topics such as recognition and synthesis of emotions. In this paper a Mental State Transition Network Model(2) is proposed to detect human emotions. By a series of psychological experiments, we present a new way to predict coming human's emotions depending on the various current emotional states under various stimuli. Besides, people in different genders and characters are taken into consideration in our investigation. According to the psychological experiments data derived from 200 questionnaires, a Mental State Transition Network Model for describing the transitions in distribution among the emotions and relationships between internal mental situations and external are concluded. Further more the coefficients of the mental transition network model were achieved. Comparing seven relative evaluating experiments, an average precision rate of 0.843 is achieved using a set of samples for the proposed model.

Review of

Review of

Foundations of dialog engineering: the development of human-computer interaction. Part II

The human-computer interface is increasingly the major determinant of the success or failure of computer systems. It is time that we provided foundations of engineering human-computer interaction (HCI) as explicit and well-founded as those for hardware and software engineering. Through the influences of other disciplines and their contribution to software engineering, a rich environment for HCI studies, theory and applications now exists. Many principles underlying HCI have systemic foundations independent of the nature of the systems taking part and these may be analysed control-theoretically and information-theoretically. The fundamental principles at different levels may be used in the practical design of dialog shells for engineering effective HCI. This paper surveys the development of styles of dialog through generations of computers, the principles involved, and the move towards integrated systems. It then systematically explores the foundations of HCI by analysing the various analogies to HCI possible when the parties are taken to be general systems, equipment, computers or people.

From timesharing to the sixth generation: the development of human-computer interaction. Part I

The human-computer interface is increasingly the major determinant of the success or failure of computer systems. It is time that we provided foundations of engineering human-computer interaction (HCI) as explicit and well-founded as those for hardware and software engineering. Computing technology has progressed through a repeated pattern of breakthroughs in one technology, leading to its playing a key role in initiating a new generation. The basic technologies of electronics, virtual machines, and software have gone through cycles of breakthrough, replication, empiricism, theory, automation and maturity. HCI entered its period of theoretical consolidation at the beginning of the fifth generation in 1980. The lists of pragmatic dialog rules for HCI in the fourth generation have served their purpose, and effort should now be directed to the underlying foundations. The recently announced sixth-generation computer system (SGCS) development program is targeted on these foundations and the formulation of knowledge science. This paper surveys the development of HCI and related topics in artificial intelligence; their history, foundations, and relations to other computing disciplines. The companion paper surveys topics relating to future developments in HCI.