Movement-based Interaction Research Articles

Moving and making strange

There is growing interest in designing for movement-based interactions with technology, now that various sensing technologies are available enabling a range of movement possibilities from gestural to whole-body interactions. We present a design methodology of Moving and Making Strange, an approach to movement-based interaction design that recognizes the central role of the body and movement in lived cognition. The methodology was developed through a series of empirical projects, each focusing on different conceptions of movement available within motion-sensing interactive, immersive spaces. The methodology offers designers a set of principles, perspectives, methods, and tools for exploring and testing movement-related design concepts. It is innovative for the inclusion of the perspective of the mover, together with the traditional perspectives of the observer and the machine. Making strange is put forward as an important tactic for rethinking how to approach the design of movement-based interaction.

Decision Prediction Using Visual Patterns

Lack of understanding of users' underlying decision making process results in the bottleneck of EB-HCI eye movement-based human-computer interaction systems. Meanwhile, considerable findings on vis...

AR Teleport: Digital Reconstruction of Historical and Cultural-Heritage Sites for Mobile Phones Via Movement-Based Interactions

Many historical and cultural sites have been demolished due to reckless urban development projects. There have been many attempts to reconstruct damaged historical and cultural sites like Pimatgol, Cheonggyecheon, and the Sewoon shopping district in South Korea using digital technology, to revive their old glory. AR Teleport is a mobile-augmented-reality application for reconstructing such areas for mobile phones. The users can travel to the past from the present sites via AR Teleport, and can attempt rich movement-based interactions like jumping, blowing a breath, wiping with a finger, and touching buttons on a phone. In this study, how these rich interactions affect the interests and awareness level of the users was looked into. AR Teleport will open a new path of digital reconstruction for smartphones via rich movement-based interactions.

Immersive singularity-free full-body interactions with reduced marker set

Despite the large success of games grounded on movement-based interactions the current state of full-body motion capture technologies still prevents the exploitation of precise interactions with complex environments. The first key requirement in the line of work we present here is to ensure a precise spatial correspondence between the user and the Avatar. For that purpose, we build upon our past effort in human postural control with a prioritized inverse kinematics (PIK) framework. One of its key advantages is to ease the dynamic- and priority-based combination of multiple conflicting constraints such as ensuring the balance and reaching a goal. However, its reliance on a linearized approximation of the problem makes it vulnerable to the well-known full extension singularity of the limbs. We address this issue by presenting a new type of 1D analytic constraint that smoothly integrates within the PIK framework under the name of FLEXT constraint (for FLexion-EXTension constraint). We further ease the full-body interaction by combining this new constraint with a recently introduced motion constraint to exploit the data-based synergy of full-body reach motions. The combination of both techniques allows immersive full-body interactions with a small set of active optical marker. Copyright © 2010 John Wiley & Sons, Ltd.

Movement-based sports video games: Investigating motivation and gaming experience

Video game consoles that enable gamers to use active body movements are becoming increasingly popular. Yet, little is known about the influence of movement on how gamers experience such games. This study takes an exploratory approach, using different data collection methods. A theory about the relationship between body movement and gaming experience emerges through the systematic collection and analysis of data obtained from interviews, questionnaires, video observations and a motion capture system. A Grounded Theory analysis of the interviews reveals two distinct motivations ( to achieve and to relax) with which gamers approach such games, together with two corresponding movement control strategies. Four movement-specific items are found to influence immersion in movement-based interaction: natural control, mimicry of movements, proprioceptive feedback, and physical challenge. These results are verified by exploiting the movement patterns of gamers playing the Nintendo Wii Boxing game. This theory offers insights to game designers as to how to design future generations of movement-based games. Whilst a controller that leaves more space for appropriation can be appealing to a larger population, its design may fail to promote and motivate physical activity and emotional well-being.

Tools, perspectives and avatars in blended reality space.

Blended Reality Space is our term for an interactive mixed-reality environment where the physical and the virtual are intimately combined in the service of interaction goals and communication environments aimed at health support and rehabilitation. The present study examines the effect on rated presence and self-presence of three key factors in the way blended realities may be implemented for these purposes. Our findings emphasize the importance of tangibility for presence, but suggest that presence and self-presence are unrelated phenomena. These findings will be incorporated into design principles for our planned work to develop free movement-based interactions for motor rehabilitation as well as blended-reality spaces for collaboration between hospitals, care organizations, and the home.

Sports over a Distance

Sport is a domain full of movement-based interactions. These interactions typically have positive health effects as well as an impact on social bonding. We have investigated ways in which computer ...

Understanding movement for interaction design: frameworks and approaches

The results of a study of two computer games, that use human movement as direct input, were analysed using four existing frameworks and approaches, drawn from different disciplines that relate to interaction and movement. This enabled the exploration of the relationships between bodily actions and the corresponding responses from technology. Interaction analysis, two design frameworks and Laban movement analysis were chosen for their ability to provide different perspectives on human movement in interaction design. Each framework and approach provided a different, yet still useful, perspective to inform the design of movement-based interaction. Each allowed us to examine the interaction between the player and the game technology in quite distinctive ways. Each contributed insights that the others did not.

Introduction to the special issue on movement-based interaction

We are pleased to present this special issue of the Journal of Personal and Ubiquitous Computing on movement-based interaction. In this special issue we aim to bring together work on human-centred approaches to understanding movement-based interaction and the design of technology to support this form of interaction. Many terms have been used to describe this area, to mention just a few—physical interaction, embodied interaction, graspable interfaces, tangible interfaces, embodied interfaces, physical computing and interactive spaces. Each area has a somewhat different orientation, but is covering closely related areas. Related research is also taking place in areas such as product design, fashion design, and interactive art, and under the umbrellas of ubiquitous computing, and mixed, virtual and augmented reality. For this introduction and this special issue, we use the term movement-based interaction, as it focuses more explicitly on the interaction rather than the interface. We also wanted to stretch the field of inquiry by focusing on the moving body in the interaction, an integral part in any interaction, but even more so in the extended design space which these new interactions enable. Research effort in this area of human–computer interaction (HCI) is also seeing a growing number of conferences, workshops and publications dedicated to its topics. We hope this special issue will encourage researchers and practitioners in the field to think further about the role of the body, and how bodily movement can and should be used in real use contexts; the body has yet to receive this type of dedicated attention in HCI. Some of the papers in this special issue were presented during the workshop Approaches to movementbased interaction held at Critical Computing 2005—Between Sense and Sensibility, The Fourth Aarhus Conference, in Denmark, August 2005. This workshop brought together researchers and practitioners from architecture, computer science, dance, design, engineering, fashion design, psychology and work practice, all areas involved in studying, researching and developing concepts, prototypes and applications that use human movement as input in some form. The authors of the workshop papers were invited to resubmit them for inclusion in this special issue, in addition the call for participation was distributed to the larger HCI community. We had a difficult time selecting the papers from the submissions we received. There were a number of high quality submission; even the papers we had to reject contained interesting contributions that we hope to see again in other forums. Each paper received two reviews, with an additional metareview by one of the special issue editors. We have aimed to present a balanced mix of submissions and to provide an overview of the type of work taking place in the area of movement-based interaction. We hope the result of this process will be useful both as a snapshot of the field, and a jumping off point for new research. The seven papers presented here can be categorised in different ways—we have chosen to see them in terms of their contribution to theoretical, methodological and design oriented aspects of movement-based interaction. We start the issue with three papers that present lessons learned and perspectives gained from the deA. T. Larssen (&) T. Robertson L. Loke J. Edwards Faculty of Information Technology, University of Technology, Sydney, P.O.Box 123, Broadway, NSW 2007, Sydney, Australia e-mail: atalarss@it.uts.edu.au

“Come on momma, let’s see the drummer”: movement-based interaction and the performance of personal style

Interaction forms are beginning to make more use of the way we move our bodies in the physical and social world. This paper aims to contribute to a new generation of personal computing by showing how the medium of everyday clothing and dress can bring valuable perspectives to the study of human embodiment and movement. The author refers to ideas from fashion theory and clothing design that can contribute to a richer understanding of the many influences that convene emotions of style and identity. In order to indicate the potential of personal style as a social medium with relevance to human computer interaction (HCI), some existing artefacts that entail interaction through movement are referenced, along with research outcomes from biomechanics, dance and performance. In conclusion design strategies are constructed for new movement-based interaction concepts that can have relevance to the changing meanings of identity in twenty-first century mass society.

Move to get moved: a search for methods, tools and knowledge to design for expressive and rich movement-based interaction

The world is inherently meaningful for us, i.e. we perceive the world in terms of what we can do with it, and by physically interacting with it we access this meaning and express the meaning. We believe that this is the core reason and foundation for turning to movement-based interaction. `Interaction creates meaning' does not only hold for users during interaction but also for designers when generating ideas and developing concepts. Therefore, we postulate that if one truly likes to design for movement-based interaction, one has to be or become an expert in movement, not just theoretically, by imagination or on paper, but by doing and experiencing while designing. In order to do so, we believe that designers need design tools, techniques, knowledge, awareness and skills that support their search for expressive, rich behaviour. Our search for this support resulted in several methods, tools and knowledge that help designers exploring, visualising and reflecting on interactions. Our developed methods and tools such as the Design Movement approach with its choreography of interaction, gestural design tools, interactive installations and interactive tangible sketching, have not only supported and inspired designers to design for movement-based interaction, but also resulted in surprising, fresh designs in comparison with the limited scope of rather uniform and traditional electronic consumer products. This paper discusses the possibilities and limitations of our approach.

Movement-based interaction in camera spaces: a conceptual framework

In this paper we present three concepts that address movement-based interaction using camera tracking. Based on our work with several movement-based projects we present four selected applications, and use these applications to leverage our discussion, and to describe our three main concepts space, relations, and feedback. We see these as central for describing and analysing movement-based systems using camera tracking and we show how these three concepts can be used to analyse other camera tracking applications.

The use of eye movements in human-computer interaction techniques

In seeking hitherto-unused methods by which users and computers can comrnumcate, we investigate the usefulness of eye movements as a fast and convenient auxiliary user-to-computer communication mode. The barrier to exploiting this medium has not been eye-tracking technology but the study of interaction techniques that incorporate eye movements mto the usercomputer dialogue in a natural and unobtrusive way This paper discusses some of the human factors and technical considerations that arise in trying to use eye movements as an input medium, describes our approach and the first eye movement-based interaction techniques that we have devised and implemented in our laboratory, and reports our experiences and observa tions on them.