Hand shape classification in various pronation angles using a wearable wrist contour sensor

Abstract

Hand gestures are potentially useful for communications between humans and between a human and a machine. However, existing methods entail several problems for practical use. We have proposed an approach to hand shape recognition based on wrist contour measurement. Especially in this paper, two assignments are addressed. First is the development of a new sensing device in which all elements are installed in a wrist-watch-type device. Second is the development of a new hand shape classifier that can accommodate pronation angle changes. The developed sensing device enables wrist contour data collection under conditions in which the pronation angle varies. The classifier recognizes the hand shape based on statistics produced through data forming and statistics conversion processes. The most important result is that no large difference exists between classification rates that include or those that exclude the independent (preliminary) pronation estimation process using inertia measurement units. This result shows two possible insights: (1) the wrist contour has some features that depend on the hand shape but which do not depend on the pronation angle, or (2) the wrist contour potentially includes pronation angle variation information. These insights indicate the possibility that hand shape can be recognized solely from the wrist contour, even while changing the pronation angle.