Bayesian self-supervised learning allying with Transformer powered compressed sensing imaging

Abstract

Deep learning based compressed sensing imaging algorithms usually adopt supervised learning mechanism, which generally require massive high-quality images paired with the measured data in the training process. However, clear images are difficult to obtain in some specific application scenarios. In view of this, we propose a self-attention powered multi-scale compressed sensing imaging network named BNN-SANet with the Bayesian self-supervised learning manner in this paper. BNN-SANet can automatically learn effective feature representation from the measured data and reconstruct high-quality images without large-scale training samples. In particular, the self-attention based Transformer employed in BNN-SANet is effective to exploit global and long-range dependencies. Multi-scale dual path design in BNN-SANet performs well in extracting the semantic information at different scales to further improve the CS reconstruction quality. Experimental results illustrate that the proposed approach is substantially superior to previous compressed sensing imaging methods in terms of Peak Signal to Noise Ratio (PSNR), Structural Similarity Index Measure (SSIM) and visual metrics.