Abstract
The interpretation and understanding of physical gestures play a significant role in various forms of art. Interactive technology and digital devices offer a plethora of opportunities for personal gesture-based experience and they assist in the creation of collaborative artwork. In this study, three prototypes for use with different digital devices (digital camera, PC camera, and Kinect) were designed. Subsequently, a series of workshops were conducted and in-depth interviews with participants from different cultural and occupational backgrounds. The latter were designed to explore how to specifically design personalised gesture-based expressions and how to engage the creativity of the participants in their gesture-based experiences. The findings indicated that, in terms of gesture-based interaction, the participants preferred to engage with the visual traces that were displayed at specific timings in multi-experience spaces. Their gesture-based interactions could effectively support non-verbal emotional expression. In addition, the participants were shown to be strongly inclined to combine their personal stories and emotions into their own gesture-based artworks. Based on the participants’ different cultural and occupational backgrounds, their artistic creation could be spontaneously formed.
Highlights
As one of the many domains within the human–computer interaction (HCI), gesture-based interaction effectively supports both the gestures and body movements of users’ interactions with the systems of digital devices [1]
Because the depth cameras used in these devices are becoming more broadly available consumer products, opportunities are emerging for such systems that are to be used in novel body-interaction techniques [5], this poses new challenges for interaction designers
Fourteen of the participants (63%) wanted to try the experience again, mainly because they wanted to attempt more gestures or other types of artwork creation. Of these 14 participants, four wanted to invite friends to collaborate in the experience, three wanted to spend more time experiencing the prototype at home, three wanted to try new ideas for interacting with the gestures, such as finger dancing, two wanted to explore the environment more, and two wanted to try the experience again with music for inspiration
Summary
As one of the many domains within the human–computer interaction (HCI), gesture-based interaction effectively supports both the gestures and body movements of users’ interactions with the systems of digital devices [1]. As gesture-based interaction is an intuitive and natural approach, it may have the potential to support the self-expression of users [2], while allowing users from different backgrounds to experience and participate in artistic engagement [3]. Because the depth cameras used in these devices are becoming more broadly available consumer products, opportunities are emerging for such systems that are to be used in novel body-interaction techniques [5], this poses new challenges for interaction designers. The overall aim of the present study was to determine how users’ experiences could be integrated with their multi-cultural and occupational backgrounds, with the intention of enabling interactive gesture-based expression and creativity
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
