The visible-IR scanning radiometer (VIRR) of FY1-C/D meteorological satellites consists of 10 bands with 4 different focal plane assemblies (FPAs). However, there are significant band-to-band registration (BBR) errors between different bands, which cannot be compensated for by a simple shift in the along-scan direction. A rigorous BBR frame was proposed to analyze the sources of misregistration in the whisk-broom camera. According to theory, the 45° scanning mirror introduces tangent function style misregistration in the along-track direction and secant function style misregistration in the across-track direction between different bands if the bands are not in the same optical axis. As proven by the experiments of both FY-1C and FY-1D, the image rotation caused by the 45° scanning mirrors plays a major role in the misregistration. However, misregistration between different FPAs does not strictly adhere to this theory. Therefore, a polynomial-based co-registration method was proposed to model the BBR errors for the VIRR. To achieve 0.1 pixel accuracy, a fourth-degree polynomial was used for BBR in the along-scan direction, and a fifth-degree polynomial was used for the along-track direction. For the reflective bands, the root-mean-square errors (RMSEs) of misregistration could be improved from 3 pixels to 0.11 pixels. Limited by matching accuracy, the RMSEs of misregistration between thermal bands and reflective bands were approximately 0.2 to 0.4 pixels, depending on the signal-to-noise ratio.