Multimodal medical image fusion based on IHS and PCA

Abstract

The fusion of multimodal brain imaging for a given clinical application is a very important performance. Generally, the PET image indicates the brain function and has a low spatial resolution, the MRI image shows the brain tissue anatomy and contains no functional information. Hence, a perfect fused image should contain both more functional information and more spatial characteristics with no spatial and color distortion. There have been a number of approaches proposed for fusing multitask or multimodal image information. But, every approach has its limited domain for a particular application. Study indicated that intensity-hue-saturation (IHS) transform and principal component analysis (PCA) can preserve more spatial feature and more required functional information with no color distortion. The presented algorithm integrates the advantages of both IHS and PCA fusion methods to improve the fused image quality. Visual and quantitative analysis show that the proposed algorithm significantly improves the fusion quality; compared to fusion methods including PCA, Brovey, discrete wavelet transform (DWT).