Preserving quality in minimum frame selection within multi-frame super-resolution

Abstract

As there are data redundancies in successive frames in a multi-frame super resolution (SR) algorithm, one can expect that discarding some of these superfluous frames would have no impact on the quality of the high resolution (HR) output image. The present paper presents an efficient algorithm for selecting the proper combination of the minimum frames required for multi-frame SR algorithms so as to not only preserve the quality of the obtained HR output, but also reduce the SR procedure complexity and memory. To achieve this, the present study first seeks to prove that minimizing the spectral interference between the selected frames for SR procedure will result in maximizing the HR output power. Then, the criterion for measuring the Upper Bound on Spectral Interferences (UBSI) among the selected frames for SR procedure is presented; the formulation is expressed in such a way that it can be extended to global sub-pixel translations between frames. Our proposed frame selection algorithm evaluates all candidate combinations from input frames so that the best option capable of minimizing the UBSI can be selected. In order to evaluate our proposed frame selection algorithm, five well-known SR image reconstruction methods are applied both in four standard simulated images and in three well known real video sequences, employing two different procedures: Using our proposed frame selection algorithm and otherwise. The obtained results indicate that when our proposed frame selection algorithm is applied, the quality of the HR output images is preserved tantamount to considering all available frames. Besides, the computational complexity of the SR algorithms is dramatically reduced adopting the proposed frame selection algorithm, for the number of frames engaged in the SR is diminished. Also compared with the SR algorithms presented in the literature, our proposed frame selection method takes relatively negligible time to execute.