Multimodal image fusion based on global-regional-local rule in NSST domain

Abstract

An accurate representation of the source image is vital in image fusion processing. However, among most of the traditional multi-scale decomposition based image fusion methods, they fail to accurately interpret the source images, only capturing local information without considering the regional and global information. To overcome this drawback, a novel image fusion method based on the global-regional-local rule is proposed in the nonsubsampled shearlet transform (NSST) domain. First, the source paired images are decomposed into the low-pass subbands and high-pass subbands with the NSST transformation. Second, for comprehensively representing the statistical correlation of source image, three-level statistical models, that is, global contextual hidden Markov model (G-CHMM), regional contextual hidden Markov model (R-CHMM), and local contextual hidden Markov model (L-CHMM) are established for the high-pass subbands. In the R-CHMM, a novel feature vector is extracted for getting the region map of source image by the fuzzy cluster method (FCM). Third, to get accurate active measures of the source image, a global-regional-local fusion rule based on the statistical characteristics extracted from global-regional-local CHMM is designed, which is used to fuse the high-pass subbands. The low-pass subbands are fused with the choose-max rule based on the local gradient measure. Finally, the fused image is obtained by the inverse NSST. Experimental results on serials of infrared and visible images, medical images and multi-focus images demonstrate the advantage of the proposed method in terms of detail preserving.