Dynamic Gesture Recognition Based on iCPM and RNN

Abstract

Aim to solve the problem that continuous complex actions are difficult to be recognized by computer vision technology in actual production, this paper collects gesture video from single-and double-viewpoint, constructs gesture joint point coordinate recognition network model by improved Convolutional Pose Machine(iCPM) model, obtains gesture Gauss heat map and joint point coordinates in each frame of video, and then inputs joint point coordinates with time series into gesture sequence recognition network. Finally, the gesture sequence is obtained. The experimental results show that the recognition accuracy of gesture recognition model based on double-viewpoint is 4.18% ∼ 6.92% higher than that of the single-viewpoint gesture recognition model, which verifies that the gesture recognition model based on dual-viewpoint has better recognition effect. In addition, the video samples of Tin-Lead Soldering including continuous and complex actions verify that the model has ideal recognition ability for dynamic gesture in actual production process.