Abstract

Motivated by the theoretical interest in reconstructing long 3D trajectories of individual birds in large flocks, we developed CoMo, a comoving camera system of two synchronized cameras coupled with rotational stages, which allows us to dynamically follow the motion of a target flock. With the rotation of the cameras, we overcome the limitations of standard static systems that restrict the duration of the collected data to the short interval of time in which targets are in the cameras common field of view, but, at the same time, we change, in time, the external parameters of the system, which have then to be calibrated frame by frame. We address the calibration of the external parameters measuring the position of the cameras and their three angles of yaw, pitch, and roll in the system <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">home</i> configuration (rotational stage at an angle equal to 0°) and combining this static information with the time-dependent rotation due to the stages. We evaluate the robustness and accuracy of the system by comparing reconstructed and measured 3D distances in what we call 3D tests that show a relative error of the order of 1%. The novelty of the work presented in this article is not only on the system itself but also on the approach that we use in the tests, which we show to be a very powerful tool in detecting and fixing calibration inaccuracies, and it, for this reason, may be relevant for a broad audience.

Highlights

  • I N recent years technological advances in the field of imaging and computer vision, together with the growing demand for 3D contents, contributed to make digital camera stereo systems accurate in the 3D reconstruction and at the same time accessible to a wide audience

  • In this paper we present a novel co-moving 3D system, CoMo, inspired by the human ability to follow the trajectory of a target with a coordinate movement of the eyes: cameras are coupled with rotational stages that drive a controlled rotation of all the cameras in the same direction and at the same rotational speed, in this way dynamically adapting the field of view to the motion of the targets

  • We presented a novel co-moving camera stereo system, CoMo, developed in the context of 3D tracking of large groups of targets moving in a wide and non-confined space

Read more

Summary

INTRODUCTION

I N recent years technological advances in the field of imaging and computer vision, together with the growing demand for 3D contents, contributed to make digital camera stereo systems accurate in the 3D reconstruction and at the same time accessible to a wide audience. A third approach, which is robust with respect to the 3D reconstruction accuracy regardless the size of the field of view, consists in calibrating the external parameters of the system by directly measuring the orientation and position of all the cameras in a common reference frame. This latter approach represents a valid alternative to the 3D methods described above, but it is generally not used because it requires a particular care in the system set-up that has to be designed to guarantee a precise measurement of the external parameters. The coupling between the cameras (with a sensor size of 17.9mm×11.2mm) and the optics (with a focal length of 28mm) produces a wide field of view of 35.5◦ in width and 22.6◦ in height

Design
Motion control
CoMo calibration
Calibration of the internal parameters
Calibration of the external parameters
DYNAMIC 3D RECONSTRUCTION
Camera reference frame
Pinhole model
World reference frame
External parameters
Time discretization
TIME DISCRETIZATION
Frame rate consistency and cameras synchronization
YAW ANGLES ACCURACY IN TIME
Stage home repeatability
Angle interpolation
SYSTEM ACCURACY EVALUATION
Accuracy on the calibration of the internal and external parameters
Improving the focal length calibration
Set-up and alignment consistency
Findings
CONCLUSIONS

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.