Validity Analysis of Monocular Human Pose Estimation Models Interfaced with a Mobile Application for Assessing Upper Limb Range of Motion

Abstract

Listen

Translate article

Human Pose Estimation (HPE) is a computer vision application that utilizes deep learning techniques to precisely locate Key Joint Points (KJPs), enabling the accurate description of a person’s pose. HPE models can be extended to facilitate Range of Motion (ROM) assessment by leveraging patient photographs. This study aims to evaluate and compare the performance of HPE models for assessing upper limbs ROM. A physiotherapist evaluated the degrees of ROM in shoulders (flexion, extension, and abduction) and elbows (flexion and extension) for fifty-two participants using both Universal Goniometer (UG) and five HPE models. Participants were instructed to repeat each movement three times to obtain measurements with the UG, then positioned while photos were captured using the NLMeasurer mobile application. The paired t-test, bias, and error measures were employed to evaluate the difference and agreement between measurement methods. Results indicated that the MoveNet Thunder INT16 model exhibited superior performance. Root Mean Square Errors obtained through this model were <10° in 8 of 10 analyzed movements. HPE models demonstrated better performance in shoulder flexion and abduction movements while exhibiting unsatisfactory performance in elbow flexion. Challenges such as image perspective distortion, environmental lighting conditions, images in monocular view, and complications in the pose may influence the models’ performance. Nevertheless, HPE models show promise in identifying KJPs and facilitating ROM measurements, potentially enhancing convenience and efficiency in assessments. However, their current accuracy for this application is unsatisfactory, highlighting the need for caution when considering automated upper limb ROM measurement with them. The implementation of these models in clinical practice does not diminish the crucial role of examiners in carefully inspecting images and making adjustments to ensure measurement reliability.