Hand-object pose estimation based on HOPE-net and attention mechanism

Abstract

Abstract Hand-object pose estimation is an important part of studying hand pose, focusing on the joint detection of hand and object poses. Although CNN has shown advantages in various hand pose estimation, due to various problems such as the complex structure of the hand pose and self-occlusion, there are limitations in the extraction of image features and the amount of calculation. Existing studies have shown that GCNs have a good performance in dealing with such problems. In this paper, we propose to combine the attention module with two adaptive GCNs, and perform feature enhancement operations on hand features. While ensuring the accuracy of feature extraction, it can effectively improve the network calculation speed and avoid some questions such as self-occlusion. Experimental results show that, through end-to-end training, the algorithm has a great performance on the problem of hand-object pose estimation.