3D object deforming and manipulating through dynamic hand gestures

Abstract

Deformation of 3D objects is increasingly used in human–computer interaction applications and computer games. Achieving a natural user interface like hand gestures is the most important challenge in these fields. In this paper, we propose a system for 3D object deformation through hand natural gestures. The purpose of this research is to represent the whole process of hand involvement in different tasks from start to the end, describe the challenges in each step, and resolve them in proper ways. A part of the study focuses on constraints and rules of the hand. In the proposed system, we use a camera and colored gloves to create a vision-based method to track hands. Compared to similar systems, more complex scenarios of deformations and more natural interactions are provided in our proposed framework. Furthermore, a model of the hand is created with the intention of giving a better sense of hand-object interaction to users. The hand model simulates the hand movements in the desktop environment. We conducted a set of experiments to evaluate different parts of the proposed system. The results in each step show that the proposed system can provide a precise interaction and a good experience for users to deform objects.