Abstract

Long-range horizontal path imaging through atmospheric turbulence is hampered by spatiotemporally randomly varying shifting and blurring of scene points in recorded imagery. Although existing software-based mitigation strategies can produce sharp and stable imagery of static scenes, it remains highly challenging to mitigate turbulence in scenes with moving objects such that they remain visible as moving objects in the output. In our work, we investigate if and how event (also called neuromorphic) cameras can be used for this challenge. We explore how the high temporal resolution of the event stream can be used to distinguish between the apparent motion due to turbulence and the actual motion of physical objects in the scene. We use this to propose an algorithm to reconstruct output image sequences in which the static background of the scene is mitigated for turbulence, while the moving objects in the scene are preserved. The algorithm is demonstrated on indoor experimental recordings of moving objects imaged through artificially generated turbulence.

Highlights

  • Light traveling through the atmosphere encounters turbulent regions that modify the optical path length.[1]

  • Atmospheric turbulence limits the effective resolution of optical imaging in many long-range observation applications such as surveillance or astronomy

  • In our first set of experiments, we evaluate the quality of the reconstructed static background image

Read more

Summary

Introduction

Light traveling through the atmosphere encounters turbulent regions that modify the optical path length.[1]. We present our results combining image processing on an intensity image recorded by a camera and event processing to show the enhancement brought by the additional event stream over classical frame-based mitigation Because this is a first exploration of this possibility, the scope of the investigation is limited here to applications in which the camera itself is static and moving objects exhibit rigid body motion.

Event Camera
Event-Based Turbulence Mitigation
Image Reconstruction from Events
Background Reconstruction
Features for Moving Object Detection
Moving Object Classification
Moving Object Reconstruction
Experimental Setup
Moving Object Segmentation
Comparison with State-of-the-Art Methods
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call