Robust Precise Dynamic Point Reconstruction From Multi-View

Abstract

Reconstructing precise dynamic points with multiple camera systems (MCSs) is a pivotal work in many computer vision applications, such as motion capture. However, the deviation of 2-D position leads to frequent mismatch when searching for correspondence from multi-view. This paper puts forward a two-stage framework based on passive optical motion capture system to reconstruct precise dynamic points with MCSs. Our proposed method improves the performance of calibration and matching simultaneously. In the calibration stage, the extrinsic parameters of numerous cameras are calibrated synchronously via an L-shaped frame, where the position of four reference points is optimized with multiple geometric constraints. Bundle adjustment occurs after calibration. In the reconstruction stage, we propose a novel sparse multi-view matching method called cyclical voting, which includes multiple pairs of global voting and in-group voting. Point residual method is proposed to exclude outliers in matching groups further. The experiments show that our proposed method can decrease mismatching significantly and achieve commendable reconstruction results compared with Cortex (one of the most successful commercial motion analysis software).