Omnidirectional Video Camera Research Articles

Development and evaluation of mire vegetation survey method using UAV equipped with omnidirectional video camera.

Development and evaluation of mire vegetation survey method using UAV equipped with omnidirectional video camera.

Using an omnidirectional video logger to observe the underwater life of marine animals: Humpback whale resting behaviour

Animal-borne video loggers are powerful tools for investigating animal behaviour because they directly record immediate and extended peripheral animal activities; however, typical video loggers capture only a limited area on one side of an animal being monitored owing to their narrow field of view. Here, we investigated the resting behaviour of humpback whales using an animal-borne omnidirectional video camera combined with a behavioural data logger. In the video logger footage, two non-tagged resting individuals, which did not spread their flippers or move their flukes, were observed above a tagged animal, representing an apparent bout of group resting. During the video logger recording, the swim speed was relatively slow (0.75 m s−1), and the tagged animal made only a few strokes of very low amplitude during drift diving. We report the drift dives as resting behaviour specific to baleen whales as same as seals, sperm whales and loggerhead turtles. Overall, our study shows that an omnidirectional video logger is a valuable tool for interpreting animal ecology with improved accuracy owing to its ability to record a wide field of view.

Omnidirectional Audio-Visual Talker Localization Based on Dynamic Fusion of Audio-Visual Features Using Validity and Reliability Criteria

This paper proposes a robust omnidirectional audio-visual (AV) talker localizer for AV applications. The proposed localizer consists of two innovations. One of them is robust omnidirectional audio and visual features. The direction of arrival (DOA) estimation using an equilateral triangular microphone array, and human position estimation using an omnidirectional video camera extract the AV features. The other is a dynamic fusion of the AV features. The validity criterion, called the audio-or visual-localization counter, validates each audio-or visual-feature. The reliability criterion, called the speech arriving evaluator, acts as a dynamic weight to eliminate any prior statistical properties from its fusion procedure. The proposed localizer can compatibly achieve talker localization in a speech activity and user localization in a non-speech activity under the identical fusion rule. Talker localization experiments were conducted in an actual room to evaluate the effectiveness of the proposed localizer. The results confirmed that the talker localization performance of the proposed AV localizer using the validity and reliability criteria is superior to that of conventional localizers.

Cooperative Localization and Tracking in Distributed Robot-Sensor Networks

This paper addresses the problem of real-time position and orientation estimation of networked mobile robots in two-dimensional Euclidean space with simultaneous tracking of a rigid unknown object based on exteroceptive sensory information extracted from distributed vision systems. The sufficient and necessary conditions for team localization are proposed. A localization and object tracking approach based on statistical operators and graph searching algorithms is presented for a team of robots localized with heterogeneous sensors. The approach was implemented in an experimental platform consisting of car-like mobile robots equipped with omnidirectional video cameras and IEEE 802.11b wireless networking. The experimental results validate the approach.

VideoPlus: a method for capturing the structure and appearance of immersive environments

This paper presents a simple approach to capturing the appearance and structure of immersive scenes based on the imagery acquired with an omnidirectional video camera. The scheme proceeds by combining techniques from structure-from-motion with ideas from image-based rendering. An interactive photogrammetric modeling scheme is used to recover the locations of a set of salient features in the scene (points and lines) from image measurements in a small set of keyframe images. The estimates obtained from this process are then used as a basis for estimating the position and orientation of the camera at every frame in the video clip. By augmenting the video sequence with pose information, we provide the end-user with the ability to index the video sequence spatially as opposed to temporally. This allows the user to explore the immersive scene by interactively selecting the desired viewpoint and viewing direction.