Fast physic-informed mixer architecture for color Lensfree holographic reconstruction

Abstract

Accurate color image reconstruction from multi-wavelength holograms is crucial in biomedical imaging applications. Current data-driven deep learning methods have made significant progress with promising reconstruction performance. Especially, untrained neural network methods have been developed to overcome data acquisition and the generalization issue. However, improving reconstruction quality requires more iterations, which can lead to longer convergence time. To address this challenge, we proposed an efficient complex-valued attention mixer (ECA-Mixer) architecture for fast and accurate physic-informed color holographic reconstruction. Our architecture consists of three core modules, an encoder, a nonlinear transformer and a decoder, each combining efficient attention mechanisms and Mixer layers for channel feature extraction and spatial information transformation. To preserve high-frequency information, we also introduced the use of 2D Haar wavelet and its inverse transform for encoding and decoding features. We then validate our method with extensive experiments on simulated and experimental samples and achieve state-of-art color reconstruction results in terms of computation time and image quality. Besides, we also demonstrate that our proposed lightweight network is capable of imaging large-size wide-field samples at a higher resolution in just a few minutes. The code is available and will be uploaded later at https://github.com/DeepPhysicVision/ECA-Mixer.git.