Augmented Reality Approach for Marker-based Posture Measurement on Smartphones.

Abstract

Marker tracking for postural and range of motion (ROM) measurements transcends multiple disciplines (e.g., healthcare, ergonomics, engineering). A viable real-time mobile application is currently lacking for measuring limb angles and body posture. To address this need, a novel Android smartphone augmented-reality-based application was developed using the AprilTag2 fiducial marker system. To evaluate the app, two markers were printed on paper and attached to a wall. A Samsung S6 mobile phone was fixed on a tripod, parallel to the wall. The smartphone app tracked and recorded marker orientation and 2D position data in the camera frame, from front and rear cameras, for different smartphone placements. The average error between mobile phone and measured angles was less than 1 degree for all test settings (back camera=0.29°, front camera=0.33°, yaw rotation=0.75°, tilt rotation=0.22°). The average error between mobile phone and measured distance was less than 4 mm for all test settings (back camera=1.8 mm, front camera=2.5 mm, yaw rotation=3 mm, tilt rotation=3.8 mm). Overall, the app obtained valid and reliable angle and distance measurements with smartphone positions and cameras that would be expected in practice. Thus, this app is viable for clinical ROM and posture assessments.