Human-computer Interaction Paradigm Research Articles

“I’ve had it!” Group therapy for interdisciplinary researchers

<div class="page" title="Page 1"><div class="layoutArea"><div class="column"><p><span>In this workshop, we reflect on and share the fun and frustrations of working in interdisciplinary research. We ask participants to openly reflect on their experiences of interdisciplinarity. What approaches have worked and what have failed? In addition to identifying phenomena, we aim to sketch out the next decade of interdisciplinary research in computing, especially in HCI. The third paradigm of Human-Computer Interaction focuses on the qualitative aspects of use experience and the situatedness of technologies. This new orientation has drawn in researchers from various other research and arts backgrounds and traditions, including the social sciences, architecture and industrial design among others. Therefore, we consider this third paradigm to be inherently interdisciplinary. Through workshop participants’ reflection of their own experiences, we strive to identify the common problems and pitfalls of interdisciplinary research, and to celebrate successes, as well as share best practices. </span></p></div></div></div>

Interactively mediating experiences of mindfulness meditation

Sonic Cradle is a human–computer interaction paradigm designed to foster meditative attentional patterns. A user׳s body is suspended comfortably in a completely dark sound chamber while the interaction paradigm subtly encourages them to focus on their breathing to summon and progressively shape an abstract immersive sound experience. Basic interpretive qualitative methods with a purposive sample of 39 participants were used to systematically analyze interview data after a 15-min experience of the system. Results suggest that this persuasive medium can pleasantly encourage an experience comparable to mindfulness by consistently inducing a calm mental clarity and loss of intention. Surprisingly, participants also reported perceptual illusions, feelings of floating, and emotional responses. Mounting evidence implies mindfulness meditation as an effective practice for self-regulation; this study represents a first step toward realizing technology׳s potential to increase wellbeing by introducing people to this psychologically beneficial contemplative practice.

Toward an Afro-Centric Indigenous HCI Paradigm

Current human–computer interaction (HCI) paradigms are deeply rooted in a Western epistemology that attests its partiality and bias of its embedded assumptions, values, definitions, techniques, and derived frameworks and models. Thus tensions created between local cultures and HCI principles require researchers to pursue a more critical research agenda within an indigenous epistemology. In this article an Afro-centric paradigm is presented, as promoted by African scholars, as an alternative perspective to guide interaction design in a situated context in Africa and promote the reframing of HCI. A practical realization of this paradigm shift within our own community-driven design in Southern Africa is illustrated.

Gliding and saccadic gaze gesture recognition in real time

Eye movements can be consciously controlled by humans to the extent of performing sequences of predefined movement patterns, or 'gaze gestures'. Gaze gestures can be tracked noninvasively employing a video-based eye tracking system. Gaze gestures hold the potential to become an emerging input paradigm in the context of human-computer interaction (HCI) as low-cost eye trackers become more ubiquitous. The viability of gaze gestures as an innovative way to control a computer rests on how easily they can be assimilated by potential users and also on the ability of machine learning algorithms to discriminate in real time intentional gaze gestures from typical gaze activity performed during standard interaction with electronic devices. In this work, through a set of experiments and user studies, we evaluate the performance of two different gaze gestures modalities, gliding gaze gestures and saccadic gaze gestures, and their corresponding real-time recognition algorithms, Hierarchical Temporal Memory networks and the Needleman-Wunsch algorithm for sequence alignment. Our results show that a specific combination of gaze gesture modality, namely saccadic gaze gestures, and recognition algorithm, Needleman-Wunsch, allows for reliable usage of intentional gaze gestures to interact with a computer with accuracy rates higher than 95% and completion speeds of around 1.5 to 2.5 seconds per gesture. The optimal gaze gesture modality and recognition algorithm do not interfere with otherwise standard human-computer gaze interaction, generating very few false positives during real time recognition and positive feedback from the users. These encouraging results and the low cost eye tracking equipment used, open up a new HCI paradigm for the fields of accessibility and interaction with smartphones, tablets, projected displays and traditional desktop computers.

Smarter Cities and Their Innovation Challenges

The transformation to smarter cities will require innovation in planning, management, and operations. Several ongoing projects around the world illustrate the opportunities and challenges of this transformation. Cities must get smarter to address an array of emerging urbanization challenges, and as the projects highlighted in this article show, several distinct paths are available. The number of cities worldwide pursuing smarter transformation is growing rapidly. However, these efforts face many political, socioeconomic, and technical hurdles. Changing the status quo is always difficult for city administrators, and smarter city initiatives often require extensive coordination, sponsorship, and support across multiple functional silos. The need to visibly demonstrate a continuous return on investment also presents a challenge. The technical obstacles will center on achieving system interoperability, ensuring security and privacy, accommodating a proliferation of sensors and devices, and adopting a new closed-loop human-computer interaction paradigm.

Admux: An Adaptive Multiplexer for Haptic–Audio–Visual Data Communication

Research trends in multimedia strive to incorporate multiple modalities, such as audio, video, graphics, and haptics, into multimedia applications to enhance the user's experience. Researchers have made significant progress in advanced multimedia by incorporating virtual reality environments, haptics, and scent into the human computer interaction paradigm. However, the communication of multimedia data over the Internet (particularly the haptic media) remains a real challenge since each media has varying and sometimes conflicting communication requirements. This paper proposes Admux, an adaptive application layer multiplexing framework (including a communication protocol) for multimedia applications incorporating haptic, visual, auditory, and scent data for nondedicated networks. Being an application layer framework, Admux is highly adaptable to the application requirements, the media type (haptic, audio, video, etc.), and the network conditions. To facilitate the application-Admux communication, we used haptic application metalanguage descriptions. Second, Admux enhances the network throughput by adopting statistical multiplexing. Finally, Admux enables media prioritization based on the application events and QoS requirements. By simulating an interpersonal teleconferencing system (named the HugMe system), our results showed that Admux provides dynamic bandwidth allocation based on the network conditions, media type, and application events.

Distributed, multi-sensor tracking of multiple participants within immersive environments using a 2-cohort camera setup

Vision-based human motion tracking has gained significant interest in recent years, as the need for more intuitive human–computer interaction paradigms are sought after. Immersive environments, such as large-scale displays and virtual reality systems are particularly suitable for such interaction mechanisms, as they provide a controlled basis for experimentation and evaluation. However, despite the growing interest, human-motion tracking within immersive environments is still in its infancy. The lack of visible light and the presence of multiple people within such environments pose several challenges to the problem. In this research a robust framework for real-time, multi-camera human-motion tracking within an immersive environment is presented. The static nature of the environment is exploited to utilise a novel 2-cohort camera layout. This layout proves to be highly useful for tracking, providing several benefits over existing techniques, which treat all cameras as the same.

A Practical Paradigm and Platform for Video-Based Human-Computer Interaction

New technologies that use multimodal input, human experience, and modern hardware's full computational power could mitigate current limitations in human-computer interaction. The 4D Touchpad, a video-based interaction platform, makes robust, natural interaction between humans and computers possible.

A New Haptic Interaction and Visualization Approach for Rigid Molecular Docking in Virtual Environments

Many biological activities take place through the physicochemical interaction of two molecules. This interaction occurs when one of the molecules finds a suitable location on the surface of the other for binding. This process is known as molecular docking, and it has applications to drug design. If we can determine which drug molecule binds to a particular protein, and how the protein interacts with the bonded molecule, we can possibly enhance or inhibit its activities. This information, in turn, can be used to develop new drugs that are more effective against diseases. In this paper, we propose a new approach based on a human-computer interaction paradigm for the solution of the rigid body molecular docking problem. In our approach, a rigid ligand molecule (i.e., drug) manipulated by the user is inserted into the cavities of a rigid protein molecule to search for the binding cavity, while the molecular interaction forces are conveyed to the user via a haptic device for guidance. We developed a new visualization concept, Active Haptic Workspace (AHW), for the efficient exploration of the large protein surface in high resolution using a haptic device having a small workspace. After the discovery of the true binding site and the rough alignment of the ligand molecule inside the cavity by the user, its final configuration is calculated off-line through time stepping molecular dynamics (MD) simulations. At each time step, the optimum rigid body transformations of the ligand molecule are calculated using a new approach, which minimizes the distance error between the previous rigid body coordinates of its atoms and their new coordinates calculated by the MD simulations. The simulations are continued until the ligand molecule arrives at the lowest energy configuration. Our experimental studies conducted with six human subjects testing six different molecular complexes demonstrate that given a ligand molecule and five potential binding sites on a protein surface, the subjects can successfully identify the true binding site using visual and haptic cues. Moreover, they can roughly align the ligand molecule inside the binding cavity such that the final configuration of the ligand molecule can be determined via the proposed MD simulations.

Authentic facial expression analysis

There is a growing trend toward emotional intelligence in human–computer interaction paradigms. In order to react appropriately to a human, the computer would need to have some perception of the emotional state of the human. We assert that the most informative channel for machine perception of emotions is through facial expressions in video. One current difficulty in evaluating automatic emotion detection is that there are currently no international databases which are based on authentic emotions. The current facial expression databases contain facial expressions which are not naturally linked to the emotional state of the test subject. Our contributions in this work are twofold: first, we create the first authentic facial expression database where the test subjects are showing the natural facial expressions based upon their emotional state. Second, we evaluate the several promising machine learning algorithms for emotion detection which include techniques such as Bayesian networks, SVMs, and decision trees.

Perceptive animated interfaces: first steps toward a new paradigm for human-computer interaction

This paper presents a vision of the near future in which computer interaction is characterized by natural face-to-face conversations with lifelike characters that speak, emote, and gesture. These animated agents will converse with people much like people converse effectively with assistants in a variety of focused applications. Despite the research advances required to realize this vision, and the lack of strong experimental evidence that animated agents improve human-computer interaction, we argue that initial prototypes of perceptive animated interfaces can be developed today, and that the resulting systems will provide more effective and engaging communication experiences than existing systems. In support of this hypothesis, we first describe initial experiments using an animated character to teach speech and language skills to children with hearing problems, and classroom subjects and social skills to children with autistic spectrum disorder. We then show how existing dialogue system architectures can be transformed into perceptive animated interfaces by integrating computer vision and animation capabilities. We conclude by describing the Colorado Literacy Tutor, a computer-based literacy program that provides an ideal testbed for research and development of perceptive animated interfaces, and consider next steps required to realize the vision.

Applications of Virtual Environments in Medicine

This paper intends to investigate the role of virtual reality (VR) in medicine. In particular it outlines the current state of research and technology that is relevant to the development of effective virtual environments in medicine. After describing the two different visions of VR we can find in medicine--the presentation of virtual objects to all of the human senses in a way identical to their natural counterpart, and a new human-computer interaction paradigm in which users are active participants within a computer-generated three-dimensional virtual world--the paper presents some of the most interesting applications actually developed in the area. Finally, it discusses the clinical principles, technological devices and safety issues associated with the use of VR in medicine. With more than 1,000 VR papers already indexed in Medline, VR is a reality health care. Even if the number of controlled studies is still limited, its merging with emerging technologies like Ambient Intelligence and wireless communication will further improve its diffusion. The possible impact of VR on health care could be even higher than the one offered by the new communication technologies like Internet. In fact, VR is at the same time technology, a communication interface and an experience: a communication interface based on interactive 3D visualization, able to collect and integrate in single real-like experience different inputs and data sets. However, significant efforts are still required to move VR into commercial success and therefore routine clinical use.

Computer-controlled human operators

Since computers have become more powerful, the essential nature of the relationship between humans and computers has evolved. Today, computers have become essential to our daily economic and social lives to the extent that people are now often dependent on the computer; the computer has become a more demanding partner. This article examines a new paradigm for human-computer interaction: humans guided and controlled by the computer.

Touching the future: applications of virtual reality technology to mental health concerns

Virtual Reality (VR) systems are a computer interface that allows for the user to interact with and be immersed in a computer-generated environment. Virtual Environments (VEs) offer a human-computer interaction paradigm that allows users to be active participants within a computer-generated three dimensional virtual world. Many VR applications have emerged in the areas of education, military training, physical rehabilitation, and medicine. VR can add, delete, or emphasise details to better help clinicians perform basic functions and can provide the patient with specialised safer treatment techniques for problems that previously were expensive or impossible to treat in traditional training and therapy. For these reasons VEs have attracted much attention in clinical psychology and mental health applications. This paper reviews the history of VR systems development, their application to psychotherapy, assessment, rehabilitation and performance/learning and future trends.

User Environments and Individuals: Experience with Adaptive Interface Agents

The traditional style of working with computers generally revolves around the computer being used as a tool, with individual users directly initiating operations and waiting for the results of them. A more recent paradigm of human-computer interaction, based on the indirect management of computing resources, is agent-based interaction. The idea of delegation plays a key part in this approach to computer-based work, which allows individuals to relinquish the routine, mechanistic parts of their everyday tasks, having them performed automatically instead. Adaptive interfaces combine elements of both these approaches, where the goal is to have the interface adapt to its users rather than the reverse. This paper addresses some of the issues arising from a practical software development process which aimed to support individuals using this style of interaction. This paper documents the development of a set of classes which implement an architecture for adaptive interfaces. These classes are intended to be used as part of larger user interface systems which are to exhibit adaptive behaviour. One approach to the implementation of an adaptive interface is to use a set of software “agents”– simple processes which effectively run “in the background”– to decompose the task of implementing the interface. These agents form part of a larger adaptive interface architecture, which in turn forms a component of the adaptive system.

New computing systems and future high-performance computing environment and their impact on structural analysis and design

Recent advances in computer technology that are likely to impact structural analysis and design are reviewed. A brief summary is given of the advances in microelectronics and networking technologies, and in the human-computer interaction paradigms and techniques. The major features of new and projected computing systems, including high-performance computers, parallel processing machines, and small systems are described. Advances in programming environment, numerical algorithms, and computational strategies for new computing systems are reviewed. The impact of the advances in computer technology on structural analysis and design is described. A scenario for future computing paradigm is presented and the near-term needs in the computational structures area are outlined.