Multi-Target Tracking Using Windowed Fourier Single-Pixel Imaging.

Jinyu Zhang,Zelong Xiao,Yingjiao Rong,Taiyang Hu,Mengxuan Xiao,Xiaolang Shao

doi:10.3390/s21237934

Abstract

The single-pixel imaging (SPI) technique enables the tracking of moving targets at a high frame rate. However, when extended to the problem of multi-target tracking, there is no effective solution using SPI yet. Thus, a multi-target tracking method using windowed Fourier single-pixel imaging (WFSI) is proposed in this paper. The WFSI technique uses a series of windowed Fourier basis patterns to illuminate the target. This method can estimate the displacements of K independently moving targets by implementing measurements and calculating windowed Fourier coefficients, which is a measurement method with low redundancy. To enhance the capability of the proposed method, we propose a joint estimation approach for multi-target displacement, which solves the problem where different targets in close proximity cannot be distinguished. Using the independent and joint estimation approaches, multi-target tracking can be implemented with WFSI. The accuracy of the proposed multi-target tracking method is verified by numerical simulation to be less than 2 pixels. The tracking effectiveness is analyzed by a video experiment. This method provides, for the first time, an effective idea of multi-target tracking using SPI.

Highlights

To enhance the capability of the proposed method, we propose a joint estimation approach for multi-target displacement, which solves the problem where different targets in close proximity cannot be distinguished
The accuracy of the proposed multi-target tracking method is verified by numerical simulation to be less than 2 pixels
The scene image is 512 × 512 pixels in size, and the target position at the moment t1 is set to T1 (t1 ) = (20, 20), T2 (t1 ) = (20, 200), T3 (t1 ) =

Summary

Introduction

There are two types of conventional multi-target tracking methods. The first one is an image-free method, such as laser radar and millimeter radar, which emits electromagnetic waves with different beam steering to illuminate the target and receives the back-scattered echoes to estimate the target’s position and velocity. The multi-target tracking capability of the radar relies on the construction of multiple beams, and the antenna system is more difficult to design. The tracking systems usually require multi-channel compounding that is complex and costly. Compared to radar systems, imagebased target tracking systems are less expensive. High-speed cameras are costly, and the data throughput is usually huge in a short amount of time. High-speed imaging devices in the millimeter waveband are more challenging to be designed

Results

Discussion

Conclusion