A markless 3D human motion data acquisition method based on the binocular stereo vision and lightweight open pose algorithm

Abstract

This study aimed to achieve precise 3D human motion data acquisition without the need for markers. Specifically, the proposed system utilized two affordable cameras to capture human motion from diverse angles. It developed a lightweight Open Pose algorithm to extract 2D human body joints from recorded videos. Subsequently, a stereo-matching method was applied to derive accurate 3D human body joint data. Comprehensive experiments with 10 healthy participants showcased the system's exceptional performance, demonstrating superior measurement accuracy compared to established standards like the NOKOV system (RMSE values consistently below 9°) and commonly used Microsoft Kinect devices (V2 and Azure). This innovative binocular vision system presents a new approach to motion capture, potentially offering a cost-effective and precise tool for practical applications across various scenarios (e.g., motor functional assessment, virtual avatar streaming), contributing significantly to both scientific and academic communities.