Multiframe adaptive Wiener filter super-resolution with JPEG2000-compressed images

Barath Narayanan Narayanan,Eric J Balster,Russell C Hardie

doi:10.1186/1687-6180-2014-55

Barath Narayanan Narayanan, Eric J Balster + Show 1 more

Open Access

https://doi.org/10.1186/1687-6180-2014-55

Copy DOI

Abstract

Historically, Joint Photographic Experts Group 2000 (JPEG2000) image compression and multiframe super-resolution (SR) image processing techniques have evolved separately. In this paper, we propose and compare novel processing architectures for applying multiframe SR with JPEG2000 compression. We propose a modified adaptive Wiener filter (AWF) SR method and study its performance as JPEG2000 is incorporated in different ways. In particular, we perform compression prior to SR and compare this to compression after SR. We also compare both independent-frame compression and difference-frame compression approaches. We find that some of the SR artifacts that result from compression can be reduced by decreasing the assumed global signal-to-noise ratio (SNR) for the AWF SR method. We also propose a novel spatially adaptive SNR estimate for the AWF designed to compensate for the spatially varying compression artifacts in the input frames. The experimental results include the use of simulated imagery for quantitative analysis. We also include real-video results for subjective analysis.

Highlights

Multiframe super-resolution (SR) is a post processing technique designed to reduce aliasing and enhance resolution for detector-limited imaging systems [1]
We show that by modifying the signal-to-noise ratio (SNR) present in the correlation model used by the adaptive Wiener filter (AWF) SR method, the compression artifacts can be better tolerated
These results show that SR prior compression consistently produces the lowest error followed by difference-frame method before AWF SR

Summary

Introduction

Multiframe super-resolution (SR) is a post processing technique designed to reduce aliasing and enhance resolution for detector-limited imaging systems [1]. These results show that SR prior compression consistently produces the lowest error followed by difference-frame method (using spatially varying SNR) before AWF SR. The spatially varying SNR method provides good results for both individual- and difference-frame methods when compared to a global SNR.

Results

Conclusion