Robust transmission of motion capture data using interleaved LDPC and inverse kinematics

Abstract

Recent advances in smart-sensor technology have improved precision in Motion Capture (MoCap) data for realistic animation. However, precision also imposes challenges on bandwidth. While research efforts have focussed on MoCap compression in recent years, little attention has been given to lossy transmission taking advantage of the human perceptual threshold, which allows many online applications, e.g., interactive games, on-demand broadcast, movies and tutoring using dynamic motion sequences. Given the growing applications on mobile devices and wireless networks, associated with insufficient bandwidth, unreliable connection and potential interference or shadowing, data loss is inevitable. We introduce a new Representation for MoCap data, integrating Interleaved Low-Density Parity-Check (I-LDPC), with Keyframe-based Interpolation and Inverse Kinematics, to better address the problem of MoCap data loss during transmission. We believe this is the first study to address robust transmission of MoCap data considering loss. Experimental results assessed using mean opinion scores demonstrate that our approach achieves substantial improvement over alternative transmission methods.