Human-computer Interaction Research Research Articles

Rethinking Technologies for Behavior Change

Human-Computer Interaction researchers are increasingly designing technologies aimed at supporting “behavior change.” The model of change, which most of these works embrace, focuses on the idea that change occurs on the behavioral level and that it is externalistic, monistic, mechanistic, fragmented, and episodic. We think that a different take, focusing on the internal aspects of change, may integrate and extend what has been done using this behavioral model. We conducted 20 interviews exploring how individuals live, account for, and manage life changes. Then, we outlined five tentative patterns we identified across different kinds of changes reported by the interviewees, pointing out that change might be internalistic, multiple, intentional, holistic, and continuous. This led us to propose a set of design considerations for the evolution of the current behavior change technologies. Finally, we suggested some preliminary lines of future research, which aim to open the design space of technologies for change.

Design and Psychometric Evaluation of American Sign Language Translations of Usability Questionnaires

To promote greater inclusion of people who are Deaf and Hard of Hearing (DHH) in studies conducted by Human-Computer Interaction (HCI) researchers or professionals, we have undertaken a project to formally translate several standardized usability questionnaires from English to ASL. Many deaf adults in the U.S. have lower levels of English reading literacy, but there are currently no standardized usability questionnaires available in American Sign Language (ASL) for these users. A critical concern in conducting such a translation is to ensure that the meaning of the original question items has been preserved during translation, as well as other key psychometric properties of the instrument, including internal reliability, criterion validity, and construct validity. After identifying best-practices for such a translation and evaluation project, a bilingual team of domain experts (including native ASL signers who are members of the Deaf community) translated the System Usability Scale (SUS) and Net Promoter Score (NPS) instruments into ASL and then conducted back-translation evaluations to assess the faithfulness of the translation. The new ASL instruments were employed in usability tests with DHH participants, to assemble a dataset of response scores, in support of the psychometric validation. We are disseminating these translated instruments, as well as collected response values from DHH participants, to encourage greater participation in HCI studies among DHH users.

Complementing a Clinical Trial With Human-Computer Interaction: Patients' User Experience With Telehealth.

BackgroundThe use of telehealth to monitor patients from home is on the rise. Telehealth technology is evaluated in a clinical trial with measures of health outcomes and cost-effectiveness. However, what happens between a technology and the patients is not investigated during a clinical trial—the telehealth technology remains as a “black box.” Meanwhile, three decades of research in the discipline of human-computer interaction (HCI) presents design, implementation, and evaluation of technologies with a primary emphasis on users. HCI research has exposed the importance of user experience (UX) as an essential part of technology development and evaluation.ObjectiveThis research investigates the UX of patients with type 2 diabetes mellitus (T2D) with a telehealth in-home monitoring device to manage T2D from home. We investigate how the UX during a clinical trial can be researched and what a clinical trial can learn from HCI research.MethodsWe adopted an ethnographic philosophy and conducted a contextual inquiry due to time limitations followed by semistructured interviews of 9 T2D patients. We defined the method as Clinical User-experience Evaluation (CUE). The patients were enrolled in a telehealth clinical trial of T2D; however, this research was an independent study conducted by information technologists and health researchers for a user-centered evaluation of telehealth.ResultsKey analytical findings were that patients valued the benefits of in-home monitoring, but the current device did not possess all functionalities that patients wanted. The results include patients’ experiences and emotions while using the device, patients’ perceived benefits of the device, and how patients domesticated the device. Further analysis showed the influence of the device on patients’ awareness, family involvement, and design implications for telehealth for T2D.ConclusionsHCI could complement telehealth clinical trials and uncover knowledge about T2D patients’ UX and future design implications. Through HCI we can look into the “black box” phenomenon of clinical trials and create patient-centered telehealth solutions.

More-Than Human Centred Design: Considering Other Things

This paper responds to contemporary design contexts that frequently contain complex interdependencies of human and non-human actants. To adequately represent these perspectives requires a shift towards More-Than Human Centred Design. The Internet of Things (IoT) is one context that demonstrates this need. The ‘things’ within such networks transcend their physical forms and extend to include algorithms, humans, data, business models, etc. and each imports independent-but-interdependent motivations and perspectives. Therefore, we use the IoT to clarify our proposition and to convey our three contributions. First, we review the expanding corpus of contemporary Human–Computer Interaction research that seeks to expand the notion of Human Centred Design by moving beyond the dominant anthropocentric perspective. Second, we introduce a novel design metaphor, ‘constellations’, which allows both the interdependencies and independent perspectives to be considered. Third, we provide an account of a speculative design to demonstrate how it may be put into practice.

The evolution of IJHCS and CHI: A quantitative analysis

In this paper we focus on the International Journal of Human-Computer Studies (IJHCS) as a domain of analysis, to gain insights about its evolution in the past 50 years and what this evolution tells us about the research landscape associated with the journal. To this purpose we use techniques from the field of Science of Science and analyse the relevant scholarly data to identify a variety of phenomena, including significant geopolitical patterns, the key trends that emerge from a topic-centric analysis, and the insights that can be drawn from an analysis of citation data. Because the area of Human-Computer Interaction (HCI) has always been a central focus for IJHCS, we also include in the analysis the CHI conference, which is the premiere scientific venue in HCI. Analysing both venues provides more data points to our study and allows us to consider two alternative viewpoints on the evolution of HCI research.

Open user interface architecture for digital multivendor ship bridge systems

Equipment found on ship bridges rarely offer consistent user interface design across the numerous systems that seafarers interact with. It is well documented in human-computer interaction research that consistency is an important aspect for reducing human error and increasing user ability to efficiently use digital systems. Current workplace regulations and design guidance do not provide a clear path towards interface consistency between different maritime vendors and equipment. Because of this, there is a need to develop new and consistent frameworks for the design of modern ship bridges and their systems. We approach such a problem by asking the following question: How can the organization of ship bridge systems enable consistent user interfaces for multivendor ship bridges? To answer this, we present work from an industry-driven project seeking to regulate the relationships between ship bridge (i) integrators and (ii) system vendors. This paper presents a user interface architecture that systematically distinguishes between system integrators and system vendors. This user interface architecture then applies web development processes and methods that, we argue, establish a framework for increased design consistency. Furthermore, this architecture presents a new path for ship bridge user interface development that adapts current state-of-the-art user interface methodologies to a maritime context. We argue that by implementing the proposed architecture framework the industry can capitalize by saving costs, increasing innovation and improving the quality of ship bridges, thereby optimizing the work environment for seafarers and overall ship safety.

Argus Vision: A Tracking Tool for Exhibition Designers

Abstract Contemporary exhibitions are increasingly staged using extensive and often interactive media. To create such exhibitions, exhibition design companies employ professionals from a wide range of different disciplines. The support of interdisciplinary exhibition designers in the design process is one goal of research in Human-Computer Interaction. This includes the deployment of Do-It-Yourself (DIY) Tools that enable professionals from all disciplines involved to design and create interactive media themselves. In this paper, we will present Argus Vision, a DIY Tool, which allows exhibition designers the use of camera-tracking to rapidly prototype and develop immersive exhibitions and interactive installations. We successfully used Argus Vision in two real-world case studies both in the prototyping and in the deployment of two installations in exhibitions. Additionally, we conducted expert interviews with exhibition designers, investigating the tool’s usefulness for them.

Leap Motion Sensor for Natural User Interface

In Human Computer Interaction (HCI) research area, there is an increasing tendency to make devices as simple and as natural as possible for use. These devices are aiming to make input and output techniques, interaction, etc., easier. In the input domain, sensors monitor and interpret head, eye, face and even whole body movements. Interacting with the computer, hands are the most effective tool of general purpose, due to their functionality in communication and manipulation. Using hands as an input device is an attractive method for ensuring interaction between man and computer. This paper gives an overview of the Leap Motion devices as a technology that enables natural interaction between man and computer in NUI (natural user interface) implementation. The main idea to maximize the naturalness of the user environment and the use of hand movements is in the application of the sensor fusion of two Leap Motion devices. Applying sensor fusion of two Leap Motion devices will increase the range of hand movement and the interaction within the environment, which will again contribute to the natural user interface (NUI). The suggested method can be used offline or in real time, and can benefit from a wide range of applications, where the gesture of the hand and fingers is the focus of significance and estimation effect.

Motion recognition based on Kinect for human-computer intelligent interaction

At present, human-computer interaction technology has become the focus and hot spot of many scholars. With the deepening of research, facial expression recognition, speech recognition, gesture recognition, face recognition and human motion recognition have become the important content of current human-computer interaction research. In this paper, Microsoft Kinect somatosensory camera is used as the input device of motion, a new method of fast human motion recognition is proposed, and a set of real-time motion recognition and robot control system is designed

Runners’ Perspectives on ‘Smart’ Wearable Technology and Its Use for Preventing Injury

ABSTRACTUnderstanding the user experience between runners and wearable technology is crucial for designing personalized and effective wearable technology features for injury prevention. Therefore, the overall objective of this study was to understand the attitudes and beliefs for competitive and recreational runners towards wearable technology as well as its potential use for preventing injury. Survey data were drawn from 663 respondents. Competitive runners preferred GPS running watches and were interested in tracking personalized data to optimize running efficiency, whereas recreational runners used mobile phones/apps and wristband activity trackers to increase motivation. All runners believed that basic metrics found in wearable technology were most important for injury prevention; however, more advanced metrics had little importance. This paper illustrates the importance of understanding different user experiences for recreational and competitive runners in relation to wearable technology, and encourages the human-computer interaction research community to identify methods in personalizing complex running-related wearable technology data.

Teachers' perceptions of interactive Islamic Prayer (iIP)

This paper explores from the teachers’ point of view how new interactive technology for teaching the Islamic Prayer in Primary Schools can enhance engagement and interaction in the classroom. An interesting aspect of the research in Human Computer Interaction (HCI) is that it focuses on both the human and computer perspectives. From the technological side, the focus is on how the computer hardware can improve the quality of HCI. Computer graphics for example, aims to ensure the graphics of a game is of a good standard so users will enjoy their game play, whilst operating systems are also considered in order to ensure good multiprocessing and to tune system response times to human interaction times. From the human side, HCI is primarily focused on the cognitive relationship with computers by ensuring the design is suitable for humans to operate successfully. The interactive Islamic Prayer (iIP) system designed for Xbox 360 Kinect with this specific goal in mind, and as an alternative to traditional learning methods. The participants for the research are Saudi Arabian primary school teachers in Jeddah, who currently teach the prayer using a traditional method. The teachers were experienced in all methods of learning (the controlled traditional method, and the iIP software) before making an informed decision on which method they prefer through a qualitative analysis of the participants teaching experiences. In addition, observations of each teaching session were organized to see how the methods engage the learners. The results show that learning by doing is extremely effective in helping the pupil’ practice, interact and remember the prayer movements.

Experimental investigation on the effects of website aesthetics on user performance in different virtual tasks.

In Human-Computer Interaction research, the positive effect of aesthetics on users’ subjective impressions and reactions is well-accepted. However, results regarding the influence of interface aesthetics on a user’s individual performance as an objective outcome are very mixed, yet of urgent interest due to the proceeding of digitalization. In this web-based experiment (N = 331), the effect of interface aesthetics on individual performance considering three different types of tasks (search, creative, and transfer tasks) is investigated. The tasks were presented on an either aesthetic or unaesthetic website, which differed significantly in subjective aesthetics. Goal orientation (learning versus performance goals) was included as a possible moderator variable, which was manipulated by using different task instructions. Both aesthetics and goal orientation were a between-subject factor, leading to a 2 × 2 between subject design. Manipulation checks were highly significant. Yet the results show neither significant main effects of aesthetics and goal orientation on performance regarding both accuracy and response times in each of the three tasks, nor significant interaction effects. Nevertheless, from a practical perspective aesthetics still should be considered due to its positive effects on subjective perceptions of users, even as no substantial effects on user performance occurred in the present experiment.

FANTASIA: a framework for advanced natural tools and applications in social, interactive approaches

With the recent availability of industry-grade, high-performing engines for video games production, researchers in different fields have been exploiting the advanced technologies offered by these artefacts to improve the quality of the interactive experiences they design. While these engines provide excellent and easy-to-use tools to design interfaces and complex rule-based systems to control the experience, there are some aspects of Human-Computer Interaction (HCI) research they do not support in the same way because of their original mission and related design patterns pointing at a different primary target audience. In particular, the more research in HCI evolves towards natural, socially engaging approaches, the more there is the need to rapidly design and deploy software architectures to support these new paradigms. Topics such as knowledge representation, probabilistic reasoning and voice synthesis demand space as possible instruments within this new ideal design environment. In this work, we propose a framework, named FANTASIA, designed to integrate a set of chosen modules (a graph database, a dialogue manager, a game engine and a voice synthesis engine) and support rapid design and implementation of interactive applications for HCI studies. We will present a number of different case studies to exemplify how the proposed tools can be deployed to develop very different kinds of interactive applications and we will discuss ongoing and future work to further extend the framework we propose.

Beyond Leaders and Followers: Understanding Participation Dynamics in Event-Based Social Networks

ABSTRACTUnderstanding user behaviors and social relations in social media has been an important topic in Human-Computer Interaction research. In this paper, we look at an emerging form of social media, Event-based Social Networks (EBSNs), which support a special type of hybrid community where people are connected online to organize themselves for offline gatherings. EBSN users are labeled as either organizers or members on existing platforms, and their behavioral and relationship patterns in offline events have not been described systematically. To understand participation dynamics in EBSNs, we present an interview study with 12 Meetup users and categorize a variety of social roles beyond organizers and members. We identify that different types of organizers, classical leaders and delegated leaders, have different relationship patterns with various types of members, including active contributors, active followers, newcomers and occasional visitors. By comparing these roles with purely offline or online communities, we discuss how participation dynamics in EBSNs reflect the intertwined impacts of hybrid community and implications of our findings for technology designs.

Young Children and Voice Search: What We Know From Human-Computer Interaction Research.

Young children are prolific question-askers. The growing ubiquity of voice interfaces (e.g., Apple’s Siri, Amazon’s Alexa), as well as the availability of voice input in search fields, now make it possible for children to ask questions via Internet search when they are able to speak clearly, but before they have learned to read and write, typically between 3 and 6 years of age. The prevalence of voice search makes it important to understand children’s changing conceptions of digital devices as a source of information and the role of technology-mediated question-asking in development. While limited research has focused on young children’s use of voice interfaces, reviewing two related bodies of literature sheds light on how this use might unfold. This paper brings together studies of how children look for information, and of how they perceive and understand the informational and social roles of technology, drawing on human-computer interaction research. We conclude by highlighting lines of questioning for future work on younger children’s interaction through voice search.

What do volunteers want from citizen science technologies? A systematic literature review and best practice guidelines

Although hundreds of citizen science applications exist, there is lack of detailed analysis of volunteers' needs and requirements, common usability mistakes and the kinds of user experiences that citizen science applications generate. Due to the limited number of studies that reflect on these issues, it is not always possible to develop interactions that are beneficial and enjoyable. In this paper we perform a systematic literature review to identify relevant articles which discuss user issues in environmental digital citizen science and we develop a set of design guidelines, which we evaluate using cooperative evaluation. The proposed research can assist scientists and practitioners with the design and development of easy to use citizen science applications and sets the basis to inform future Human-Computer Interaction research in the context of citizen science.

Literature Review: Examining Contextual Integrity within Human-Computer Interaction

Nissenbaum’s Framework of Contextual Integrity (CI) provides a mechanism for understanding the negotiation of privacy between two or more parties. In this position paper, we present a preliminary review of recent Human-Computer Interaction (HCI) literature that uses Nissenbaum’s framework. For this initial analysis, we used a keyword search and examined peer-reviewed papers published between the years of 2008 and 2017 in the top 20 HCI venues according to Google Scholar and Microsoft Academic Research. Overall, we found that many of the studies do not implement CI within the design of their study nor do they provide summative evaluations. To close these gaps, we recommend HCI researchers to engage more thoroughly with the framework to inform their research designs and conduct studies that provide a deeper understanding of how the framework applies and can be extended in various contexts. We also recommend researchers pursue more summative evaluations based on CI for new technology solutions.

Imperceptible AR Markers for Near-Screen Mobile Interaction

Owing to the pervasive use of displays and smartphones, mobile interactions with display screens have gained attention within the advertising and gaming industries as well as in human-computer interaction research. Communication through QR code-like markers and localization via AR markers are common examples of such interactions. However, these visible markers interfere with the display content; this problem is critical for localization over a wide range of interactions, and fewer markers result in less reliability and accuracy. Although some studies have addressed this issue, few have focused on near-screen interaction without additional hardware. To address this problem, we propose an easy-to-install localization method that uses an array of AR markers, which are made imperceptible to the human eye through chromaticity vibration at 30 Hz. We mainly focus on applications, such as digital signage, where users point their smartphones at the display content. Through four evaluations, we confirm that the pointing error is within 1 mm, and that the proposed system works, when the distance between the screen and smartphone is 4-24 times the size of the AR marker. In addition, we establish that our system is robust against rotation. Finally, we present two potential application scenarios, advertising and navigation.

Leveraging Customer-integration Experience: A Review of Influencing Factors and Implications

Organizations have increasingly begun to co-create innovations, conduct idea competitions, or conduct crowdsourcing initiatives with customers in online communities. Yet, many customer-integration methods fail to attract sufficient customer participation and engagement. We draw on previous research to identify customers’ experience as an important determinant of whether customer-integration initiatives succeed. However, research has rarely applied the notion of experience in the context of customer integration. We conduct a cross-disciplinary literature review to identify the factors that constitute a positive customer-integration experience and the implications of the customer-integration experience. Based on 141 papers from marketing, technology and innovation management, information systems, human-computer interaction, and psychology research, we derive a framework for customer-integration experience that integrates 22 conceptually different influencing factors, 15 implications, and their interrelatedness based on motivation-hygiene theory. The framework sheds light on the current state of research on customer-integration experience and identifies possibilities for future research

Virtual guitar: using real-time finger tracking for musical instruments

Kinect, a 3D sensing device from Microsoft, invokes the human-computer interaction research evolution. Kinect was implemented in many areas including music. One was implemented in a virtual musical instrument (VMI) system, which uses natural gestures to produce synthetic sounds similar to real musical instruments. From related work, it was found that the use of a large joint such as hand, arm and leg is inconvenient and limits the way of playing VMI. Thus, this study proposes a fast and reliable finger tracking algorithm suitable for virtual musical instrument playing. In addition, a virtual guitar system application is developed as an implementation of the proposed algorithm. Experimental results show that the proposed method can be used to play many varieties of songs with an acceptable quality. Furthermore proposed application could be used by a beginner who does not have any experience in music or on playing a real musical instrument.