Robust Multispectral Image Registration Using Mutual-Information Models

Abstract

Image registration is a vital step in the processing of multispectral imagery. The accuracy to which imagery collected at multiple wavelengths can be aligned directly affects the resolution of the spectral end products. Automated registration of the multispectral imagery can often be unreliable, particularly between visible and infrared imagery, due to the significant differences in scene reflectance at different wavelengths. This is further complicated by the thermal features that exist at longer wavelengths. We develop new mathematical and computational models for robust image registration. In particular, we develop a frequency-domain model for the mutual-information surface around the optimal parameters and use it to develop a robust gradient ascent algorithm. For a robust performance, we require that the algorithm be initialized close to the optimal registration parameters. As a measure of how close we need to be, we propose the use of the correlation length and provide an efficient algorithm for estimating it. We measure the performance of the proposed algorithm over hundreds of random initializations to demonstrate its robustness on real data. We find that the algorithm should be expected to converge, as long as the registration parameters are initialized to be within the correlation-length distance from the optimum