Nonsubsampled contourlet transform (NSCT) provides flexible multiresolution, anisotropy, and directional expansion for images. When the NSCT is introduced to image fusion, more information for fusion can be obtained and the impacts of mis-registration on the fused results can also be reduced effectively. Therefore, the NSCT is more suitable for image fusion. Based on NSCT and adaptive Genetic Algorithm (AGA), this paper proposes a new adaptive fusion method. This method can optimize decomposition level of the NSCT, lowpass subband coefficients and bandpass directional subband coefficients of the fused image. Finally, the algorithm is tested and compared with existing algorithms. The results show that the algorithm can produce high-quality fused images rapidly.