2D Pose Estimation Based on Deep Learning for Mobile System

Abstract

Pose estimation is the detection of human action poses, which is an important task of computer vision. The requirements of tasks such as unmanned driving and intelligent surveillance have also contributed to the development of human pose estimation. In this context, deep learning (DL) has a remarkable impact on human pose estimation. In this study, we investigate a pose estimation algorithm called convolutional pose machines (CPM) and implement it on a mobile platform (i.e., Android). By combining the classical CPM and the mobile deep learning framework Mobile AI Compute Engine (MACE), the model is deployed to the mobile platform to estimate the human pose directly and locally on the mobile phone without relying on the Internet. Thus, the proposed method can achieve effective performance while protecting users’ personal data. Experimental results on real-world data validate that this system has achieved the expected results of accurate recognition of common actions with a simple interface.