Multimodal Human Hand Motion Sensing and Analysis—A Review

Abstract

Human hand motion (HHM) analysis is an essential research topic in recent applications, especially for dexterous robot hand manipulation learning from human hand skills. It provides important information about the gestures, tactile, speed, and contact force, captured via multiple sensing technologies. This paper introduces a comprehensive survey of current hand motion sensing technologies and analysis approaches in recent emerging applications. First, the nature of HHMs is discussed in terms of simple motions, such as grasps and gestures, and complex motions, e.g., in-hand manipulations and regrasps; second, different techniques for hand motion sensing, including contact-based and noncontact-based approaches, are discussed with comparisons with their pros and cons; then, the state-of-the-art analysis methods are introduced, with a particular focus on the multimodal hand motion sensing and analysis; finally, cutting-edge applications of hand motion analysis are reviewed, with further discussion on facing challenges and new future directions.