Human-computer Interaction Design Research Articles

Who Made That Decision and Why? Users’ Perceptions of Human Versus AI Decision-Making and the Power of Explainable-AI

With the advent of artificial intelligence (AI) based systems, a new era has begun. Decisions that were once made by humans are now increasingly being made by these advanced systems, with the inevitable consequence of our growing reliance on AI in many aspects of our lives. At the same time, the opaque nature of AI-based systems and the possibility of unintentional or hidden discriminatory practices and biases raises profound questions not only about the mechanics of AI, but also about how users perceive the fairness of these systems. We hypothesize that providing various explanations for AI decision-making processes and output may enhance users’ fairness perceptions and make them trust the system and adopt its decisions. Hence, we devised an online between-subject experiment that explores users’ fairness and comprehension perceptions of AI systems with respect to the explanations provided by the system, employing a case study of a managerial decision in the human resources (HR) domain. We manipulated (i) the decision-maker (AI or human); (ii) the input (candidate characteristics); (iii) the output (recommendation valence), and (iv) the explanation style. We examined the effect of the various manipulations (and individuals’ demographic and personality characteristics) using multivariate ordinal regression. We also performed a multi-level analysis of experiment components to examine the effects of the decision-maker type, explanation style, and their combination. The results suggest three main conclusions. The first conclusion is that there is a gap in users’ fairness and comprehension perception of AI-based decision making systems compared to human decision making. The second conclusion is that knowing that an AI-based system provided the decisions negatively affects users’ fairness and comprehension perceptions, compared to knowing that humans made the decision. Finally, the third conclusion is that providing case-based, certification-based, or sensitivity-based explanations can narrow this gap and may even eliminate it. Additionally, we found that users’ fairness and comprehension perceptions are influenced by a variety of factors such as the input, output, and explanation provided by the system, as well as by individuals’ age, education, computer skills, and personality. Our findings may help to understand when and how to use explanations to improve users’ perceptions regarding AI-based decision-making. CCS CONCEPTS • Human computer interaction (HCI) → HCI design and evaluation methods → User studies • Human-centered computing → Human computer interaction (HCI) → Empirical studies in HCI • Applied computing → Law, social and behavioral sciences → Sociology

Virtual reality painting: A structured review of a decade of innovation

<p>Various studies have widely utilized virtual reality (VR) in painting creation. However, there has been few conclusive studies on VR painting. The present systematic literature review describes the current state of knowledge and practices using VR in painting and provides guidance for painters and scholars focusing on human computer interaction design by critically appraising and summarizing the existing research. It also outlines a wide range of results yielded by quantitative, qualitative and mixed-method studies to investigate potential benefits, difficulties, and effectiveness of VR painting. Overall, 44 studies published from 2013 until 2023 were analysed, with 16 articles introduced the hardware technology and interaction mode of VR painting, 17 articles introduced the beautification method of VR painting, and 11 articles focused on the application of VR painting in different fields. Implications for practice and research are discussed in detail, as the hardware selection, interaction, and physical simulation in VR painting scenes.<strong></strong></p>

Evaluation of a Smart Audio System Based on the ViP Principle and the Analytic Hierarchy Process Human–Computer Interaction Design

The current limitations of user–product interaction with smart speakers have spurred the proposal of a model to circumvent these challenges. We used the ViP design principle to redefine the user’s approach to interacting with the product. Throughout the deconstruction and design stages, we explored the structure and function of the conventional product across three layers: the product layer, interaction layer, and context layer using three models. We used the hierarchical analysis method to effectively quantify the design factors affecting user experience and identify the key design factors. This approach enabled us to contextualize the smart audio system, explore the interaction dynamics between the product and the user, and provide valuable insights on designing new products. A questionnaire method was used to survey 67 users, and a reliability test was conducted to ensure the validity of the questionnaire v (Cronbach’s coefficient α = 0.868). A pairwise comparison of factors was conducted on a 1–9 scale, with weights determined through the analytic hierarchy process (AHP). The combination of the ViP design principle and hierarchical analysis presents a novel and objective paradigm to guide designers to customize product characteristics (design attributes) to enhance user human–computer interaction experience. We validated the feasibility of the innovative design approach using the smart speaker model, offering insights for research on designing similar products.

Human-Computer Interaction in Smart Living Environments: Challenges and Opportunities

The proliferation of smart technologies in living environments has ushered in an era where humans and computers interact more intimately than ever before. This research paper delves into the complex landscape of Human-Computer Interaction (HCI) within the context of smart living environments, shedding light on the multifaceted challenges and exciting opportunities that lie ahead.
 In this exploration, we first review the fundamental concepts and technologies that underpin smart living environments, emphasizing the centrality of HCI in bridging the gap between humans and the myriad of interconnected devices and systems that constitute these environments. We then identify and analyze key challenges such as user privacy, security, usability, and adaptability, which continue to shape the HCI landscape in smart living.
 The paper also highlights the emerging opportunities for HCI research, including the integration of augmented reality (AR), virtual reality (VR), and natural language processing (NLP) into smart living systems, fostering more intuitive and seamless interactions. Additionally, it discusses the potential for personalized and context-aware HCI solutions that enhance user experiences and promote inclusivity.
 By addressing these challenges and harnessing these opportunities, this research seeks to provide valuable insights for HCI researchers, designers, and policymakers, ultimately contributing to the development of smarter and more user-friendly living environments that enhance our quality of life while respecting our fundamental rights and values.

Human-Computer Interaction in Agricultural User Interfaces

This study explores the intersection of Human-Computer Interaction (HCI) and agricultural user interfaces, aiming to enhance the efficiency and user experience within the agricultural domain. A thorough literature review identifies current trends, challenges, and gaps in HCI research specific to agricultural interfaces. The research objectives encompass the proposal of HCI design principles tailored to the unique characteristics of the agricultural environment. Methodologically, the study employs user surveys, interviews, and usability testing to gather insights into user preferences and challenges. The paper presents case studies highlighting successful implementations of HCI principles in agricultural settings, providing tangible examples of improved user engagement and task performance. Challenges and limitations in HCI adoption in agriculture are discussed, along with user feedback and evaluations shaping interface design. The implications of the research extend to HCI practitioners, agricultural technology developers, and policymakers, offering practical insights for future developments. This paper contributes valuable knowledge to the evolving field of HCI in agricultural contexts, emphasizing the importance of user-centered design.

Enhancing business education through video: A conceptual model and research directions based on a systematic review

Video has become an important part of teaching and learning in business education. While literature has suggested various strategies and activities that have been implemented in video-based learning (VBL) environments and revealed their impact on student learning outcomes, there is a lack of a conceptual model for researchers and practitioners. To address this gap, we conducted a systematic review of 62 articles published in the past 20 years to propose the conceptual model. This model goes beyond cognitive domains and comprises three major components. The components are: learning outcomes include self-system, metacognitive system, and cognitive system; instructional design includes student career development, student skill development, and knowledge and concept learning; and effective video design includes content design, theory-driven design for human-computer interaction, and the use of generative AI. This model guides researchers and practitioners to research and teach business courses using VBL. We also suggested six future research directions, including investigating the relationships between instructional design and learning outcome and the applications of AI in VBL.

EcoSketch: promoting sustainable design through iterative environmental assessment during early-stage product development

Sustainability has long been a topic of substantial interest the design and human-centered computing communities. With industries increasingly prioritizing climate targets, there is a growing demand for sustainable product design. This paper addresses this need through EcoSketch, a digital tool designed to democratize environmental impact assessments for product designers. Shifting typically retrospective evaluations to the early stages of product development, EcoSketch enables proactive consideration and adoption of sustainable alternatives. Unlike software tailored to environmental scientists, it minimizes the need for specialized training or extensive data inputs. We delve into the development and evaluation of EcoSketch, highlighting its unique features and usability strengths. The paper concludes by discussing design implications and proposing future research avenues to strengthen the intersection of human-computer interaction and sustainable product design, advancing progress on environmental challenges at the systems level.

The FIFTH WALL. On DIGITAL PERFORMANCE between USER EXPERIENCE DESIGN and the METAVERSE

Before and since the pandemic, online virtual environments have emerged as critical sites for social and cultural experiences, facilitating conversations, creative projects, collective endeavours, and commercial exchanges. The rise of the Metaverse (Ball, 2021) represents a fundamental shift in today's digital presence. After Eva and Franco Mattes' historical happenings in Second Life, some recent hypermedia performances force a re-evaluation of the nature of performance, with a recontextualisation of the notions of reality, presence, community, and simulation. UX design reshapes and situates the emergence of 'metaverse-native' art in adjacent fields such as online 3D collaboration platforms: actual and perfect virtual stages.  Since the mid-1990s, the user has increasingly been invited to live an unusual experience in which the physical and the digital merge. The noun 'user experience' refers to how people experience the encounter with a system. It extends traditional human-computer interaction design by addressing all aspects of the product or service as perceived by the user, increasing satisfaction and loyalty by improving usability. The UX classification system is based on the user's emotions, preferences, attitudes, and emotional responses (Hussain et al., 2021). Its dramaturgical importance in an online digital performance has yet to be recognised.  This article proposes the analysis of three examples of digital performances (Dixon, 2007), in virtual 3D online environments, following the philosophy of User Experience Design, focusing on the perspectives and productions of Italian artists.Before and since the pandemic, online virtual environments have emerged as critical sites for social and cultural experiences, facilitating conversations, creative projects, collective endeavours, and commercial exchanges. The rise of the Metaverse (Ball, 2021) represents a fundamental shift in today's digital presence. After Eva and Franco Mattes' historical happenings in Second Life, some recent hypermedia performances force a re-evaluation of the nature of performance, with a recontextualisation of the notions of reality, presence, community, and simulation. UX design reshapes and situates the emergence of 'metaverse-native' art in adjacent fields such as online 3D collaboration platforms: actual and perfect virtual stages.  Since the mid-1990s, the user has increasingly been invited to live an unusual experience in which the physical and the digital merge. The noun 'user experience' refers to how people experience the encounter with a system. It extends traditional human-computer interaction design by addressing all aspects of the product or service as perceived by the user, increasing satisfaction and loyalty by improving usability. The UX classification system is based on the user's emotions, preferences, attitudes, and emotional responses (Hussain et al., 2021). Its dramaturgical importance in an online digital performance has yet to be recognised.  This article proposes the analysis of three examples of digital performances (Dixon, 2007), in virtual 3D online environments, following the philosophy of User Experience Design, focusing on the perspectives and productions of Italian artists.

Identifying the Importance of UX Dimensions for Different Software Product Categories

Abstract Billions of users around the world use mobile applications and computer software to achieve their professional and personal goals. This situation drives User Experience (UX) researchers and practitioners to assess the importance of UX dimensions across different products, to facilitate the design, development and evaluation of new products. To that end, this study surveyed a group of 200 end users and 8 UX experts from Canada to document the importance of 21 UX dimensions for 15 software product categories. The results confirmed that the importance of UX dimensions varies between product categories. Comparing the findings to those of similar studies conducted in Germany and Indonesia revealed that, while culture influences the rating of UX dimensions, the importance of UX dimensions is still determined by the product category. Comparisons between the importance ratings of UX dimensions between end users and experts and within end users were not significant in 77% and 97% of cases, respectively. Results showed that task-based product categories rely more on pragmatic dimensions (i.e. functionality and usability) while leisure-based products value hedonic dimensions (i.e. pleasure) as well. This study benefits researchers and practitioners by enabling them to select the most important UX dimensions for evaluating their products. CCS CONCEPTS: • Human-centered computing • Human-Computer Interaction (HCI) • HCI design and evaluation methods. Additional Keywords and Phrases: User experience, UX dimension, UX evaluation, culture.

Research on the Strategy of LED Light Interaction Mode-Based on the Five Senses Experience

LED is a newly emerging light-emitting diode lamp, because of its low energy consumption and long life and other advantages to become the ideal choice of lamp type. In recent years, LED has developed at an amazing speed and has been widely used in various fields of human life. This paper adheres to the concept of human-oriented, based on the theory of five senses experience, analyzes the current development status of LED lamps, as well as its specific applications in a variety of life scenarios, and summarizes and refines the strategy of human-computer interaction mode of LED lamps based on the five senses experience on the basis of the five senses experience; through the study of the five senses experience to enhance the application of LED lamps in the design of human-computer interaction and to improve the emotional communication between people and works, and to design the human-computer interaction mode of LED lamps for the purpose of the human-computer interaction. The research on five senses experience will enhance the application of LED lamps in human-computer interaction design, improve the emotional communication between people and works, and provide more ideas for the design of LED lamp human-computer interaction.

The aesthetics of more-than-human design: speculative energy briefs for the Chthulucene

ABSTRACT This paper is a theoretical contribution to HCI that considers the more-than-human (MTH) as an intrinsic part of human–computer interaction design. In particular, it focuses on MTH as central to responses to the climate crisis as manifested in energy-demand reduction and smart meters. This is explored by expanding on the notion of the ‘design event’, defined aesthetically as the patterns or conformation of unfolding and becoming of heterogenous human and non-human elements. It is with this version of the design event that the MTH can be more directly and effectively engaged. We do this with reference to environmental problems as signaled by Haraway’s speculative future ‘the Chthulucene’ – a worlding for liveable futures. The paper views design briefs in HCI, and design more broadly, as problematics for exploring and determining aesthetic-possible pathways for invention, which necessarily involves MTH elements. Three interrelated design briefs are presented that propose how practitioners might go about addressing energy-demand reduction and metering and provide a set of guidelines on how to devise and write speculative more-than-human briefs. This, the paper argues, involves becoming sensitive to speculative MTH compositions where novel forms of ‘sense making’ orient alternative possibilistic – idiotic – relations to energy.

Human Computer Interaction Applications in Healthcare: An Integrative Review

INTRODUCTION: Human computer interaction (HCI) interprets the design model and the uses of computer technology which focuses on the interface between the user and the computer. HCI is a very important factor in the design of software-oriented decision-making ideas in health-care organizations and also it assists in accurate detection of image, disease including safety of the patients.
 OBJECTIVES: There are some pitfalls arises over some previous works on cloud based HCI applications. For that reason, to masafety, patient’s safety we wanted to work on explainable artificial intelligence (x-AI) and human intelligence in conjunction with HCI in various fields and algorithms to pro-vide transparency to the user. This may also use some web-based technologies and digital platforms with HCI for development of quality, safety and usability of the patients.
 METHODS: The purpose of this study about the communication between the HCI design and healthcare system through client and apply that method to the information system of Healthcare department to analyse the functions, effects and outcomes.
 RESULTS: The integration of explainable artificial intelligence (x-AI) and human intelligence with Human-Computer Interaction (HCI) demonstrated promising potential in enhancing patient safety and optimizing healthcare processes. 
 CONCLUSION: By leveraging web-based technologies and digital platforms, this study established a framework for improving the quality, safety, and usability of healthcare services through effective communication between HCI design and healthcare systems.

Exploring the Impact of Game Human-computer Interaction Design on Enhancing Users' Immersive Experience

As a new form of artistic expression with infinite possibilities, interactive film games first trace the history of the creation and development of interactive film games at home and abroad; and then show the characteristics of the interactive film form with examples. This paper focuses on the interactive experience and the development process of interactive cinema, and the relationship between film interaction design and the users immersive experience. Interaction design accurately plans and describes the behavior of things, and effectively describes and communicates this behavior, which is an integral part of the users immersive gaming experience, while the behavior fed back to the user by interaction design directly affects the user's gaming experience.

Research on the Impact of Human-Computer Interaction Design on Employees’ Creativity and Innovation Ability in Work Scenarios

The importance of human-computer interaction design in modern work environments is gradually being recognized. More and more companies are realizing that excellent human-computer interaction design can enhance employees’ creativity and innovation ability. This article will discuss this topic and explore the impact of human-computer interaction design in work scenarios on employees’ creativity and innovation ability.

An Overview of Minimally Invasive Surgery Robots from the Perspective of Human–Computer Interaction Design

In order to streamline and summarize the status quo of human–computer interaction (HCI) design research in minimally invasive surgery robots, and to inspire and promote in-depth design research in related fields, this study utilizes literature research methods, inductive summarizing methods, and comparative analysis methods to analyze and organize the usage scenarios, users, interaction content and form, and relevant design methods of minimally invasive surgery robots, with the purpose of arriving at a review. Through a summary method, this study will obtain outcomes such as design requirements, interaction information classification, and the advantages and disadvantages of different interaction forms, and then make predictions of future trends in this field. Research findings show that the HCI design in the relevant field display a highly intelligent, human-centered, and multimodal development trend through the application of cutting-edge technology, taking full account of work efficiency and user needs. However, meanwhile, there are problems such as the absence of guidance by a systematic user knowledge framework and incomplete design evaluation factors, which need to be supplemented and improved by researchers in related fields in the future.

Understanding user experiences and expectations toward patient appointment systems

Patient appointment systems are automated reservation systems which allow people to book healthcare services, such as doctor appointments or outpatient appointments online or in apps. In many cases, patient appointment systems are attached as a function in the websites of hospitals. As a kind of direct-to-user healthcare technology which build interactions with patients, the experiences the systems created can affect patients emotion status and health conditions. Therefore, to investigate how user experience could be improved and how positive experience could be created through Human Computer Interaction (HCI) and user experience design, Clincare, a prototype healthcare website making users feel supportive was designed. To characterize users experience and expectations towards patient appointment systems, user experience study was then conducted using the prototype. The results revealed 4 aspects which could significantly influence participants experience and emotions: Information Display, Aesthetics, Workflow, and Context of Use. Based on the result, 4 design implications were proposed to inform future design works of patient appointment systems.

Reasoning: A capability of AI contributing to human-computer interaction design

Reasoning: A capability of AI contributing to human-computer interaction design

A review of cyber vigilance tasks for network defense.

Human-centered computing~Human computer interaction (HCI)~HCI design and evaluation methods.

A new kinematic dataset of lower limbs action for balance testing

Balance is a common performance but nevertheless an essential part of performance analysis investigations in ski. Many skier pay attention to the training of balance ability in training. Inertial Measurement Unit, as a kind of Multiplex-type human motion capture system, is widely used because of its humanized human-computer interaction design, low energy consumption and more freedom provided by the environment. The purpose of this research is to use sensor to establish a kinematics dataset of balance test tasks extracted from skis to help quantify skier’ balance ability. Perception Neuron Studio motion capture device is used in present. The dataset contains a total of 20 participants’ data (half male) of the motion and sensor data, which is collected at a 100 Hz sampling frequency. To our knowledge, this dataset is the only one that uses a BOSU ball in the balance test. We hope that this dataset will contribute to multiple fields of cross-technology integration in physical training and functional testing, including big-data analysis, sports equipment design and sports biomechanical analysis.

Establishment of Production Standards for Web-based Metaverse Content: Focusing on Accessibility and HCI

Metaverse technology is expanding to industries in various fields, such as medical, national defense, and education, and training simulation programs have been mainstream so far. However, there have been increasing attempts to apply metaverse content to web-based platforms linked to social media services and, as a result, we face the problem of access to web-based metaverse content. Unlike traditional content, metaverse content interacts with many users, so content accessibility is the first important part to consider. In other words, to maximize the quality of metaverse content, it is essential to pull out the optimal UX through a detailed HCI (human computer interaction) design. Metaverse content development methodologies have effective methods proposed by many researchers. However, they are limited to web-based metaverse content that limits the use of high-end hardware. They are ineffective for platforms such as PCs and VR devices, as most studies focus on improving the visual performance of PCs or high-performance VR devices. Therefore, unlike existing research, the key theme of our research is to study optimized development standards that can be applied to web-based metaverse content and find out their effects through experiments. We created a development standard to be applied to a Web-based platform based on the existing metaverse content development methodology. Then, we redeveloped the VR content into the metaverse content and named them the VR build and the metaverse build. We had 25 people play virtual reality builds and metaverse builds simultaneously. Then, we measured the overall experience with an evaluation tool called the Game Experience Questionnaire (GEQ); the GEQ is a proven tool for evaluating content experiences by dividing them into positive/negative scales. When comparing the results measured from the two builds, the metaverse build showed consistent results with a higher positive scale, and a lower negative scale, than the VR build. The results showed that users indeed rated metaverse content positively. The bottom line is that the web-based metaverse content development standards that we have produced are practical. However, since generalization is limited, continuous research will be needed in more experimental groups in the future.