Abstract

Previous research demonstrated that global phase alone can be used to faithfully represent visual scenes. Here we provide a reconstruction algorithm by using only local phase information. We also demonstrate that local phase alone can be effectively used to detect local motion. The local phase-based motion detector is akin to models employed to detect motion in biological vision, for example, the Reichardt detector. The local phase-based motion detection algorithm introduced here consists of two building blocks. The first building block measures/evaluates the temporal change of the local phase. The temporal derivative of the local phase is shown to exhibit the structure of a second order Volterra kernel with two normalized inputs. We provide an efficient, FFT-based algorithm for implementing the change of the local phase. The second processing building block implements the detector; it compares the maximum of the Radon transform of the local phase derivative with a chosen threshold. We demonstrate examples of applying the local phase-based motion detection algorithm on several video sequences. We also show how the locally detected motion can be used for segmenting moving objects in video scenes and compare our local phase-based algorithm to segmentation achieved with a widely used optic flow algorithm.

Highlights

  • Following Marr, the design of an information processing system can be approached on multiple levels [1]

  • We put forth a simple motion detection algorithm that is inspired by motion detection models of biological visual systems and provide an efficient realization that can be implemented on commodity DSP chips

  • Previous research demonstrated that global phase information alone can be used to faithfully represent visual scenes

Read more

Summary

Introduction

Following Marr, the design of an information processing system can be approached on multiple levels [1]. We put forth a simple motion detection algorithm that is inspired by motion detection models of biological visual systems (in vivo neural circuit) and provide an efficient realization that can be implemented on commodity (in silico) DSP chips. We provide an alternative motion detection algorithm based on local phase information of the visual scene. The Fourier shift property clearly suggests the relationship between the global shift of an image and the global phase shift in the frequency domain We elevate this relationship by computing the change of local phase to indicate motion that appears locally in the visual scene. Together with our result for motion detection, these studies suggest that phase information has a great potential for achieving efficient visual signal processing.

Representation of Visual Scenes Using Phase Information
Visual Motion Detection from Phase Information
The Change of Local Phase
Exploratory Results
Discussion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call