Video rate spectroscopy via Fourier-spectral-multiplexing

Abstract

Spectroscopy is an important tool having already been applied in various research fields, but still limited in observation of dynamic scenes. In this paper, we propose a video rate spectroscopy via Fourier-spectral-multiplexing (FSM-VRS) which exploits both spectral and spatial sparsity. Under the computational imaging scheme, the hyperspectral datacube is first modulated by several broadband bases, and then mapped into different regions in the Fourier domain. The encoded image compressed both in spectral and spatial are finally collected by a monochrome detector. Correspondingly, the reconstruction is essentially a Fourier domain extraction and spectral dimensional back projection with low computational load. The encoding and decoding process of the FSM-VRS is simple thus can be implemented in a low cost manner. The temporary resolution of the FSM-VRS is only limited by the camera frame rate. We demonstrate the high performance of our method by quantitative evaluation on simulation data and build a prototype system experimentally for further validation.