Realtime Super Resolution for 4K/8K with Nonlinear Signal Processing

Abstract

The 8K system is intended to be the ultimate high-resolution broadcasting system. However, 8K equipment is still under development, and there will be a lack of 8K content once broadcasting begins. It would thus be very useful if 4K content could be converted to a sufficient resolution level to be viewed on 8K systems. Conventional upconverters, from standard-definition television to high-definition television, change the video format with interpolation technology and enhancers. They cannot create higher frequency elements than those of the original content. The same problem affects upconverted 8K content; simply upconverting 4K to 8K does not produce high-resolution 8K content. This paper describes a 4K-to-8K upconverter that uses a novel form of super resolution (SR) technology. The SR technology creates frequency elements that are higher than those of the original 4K content. It can even create elements above the Nyquist frequency, which had been considered a theoretical limitation. The 4K-to-8K upconverter can create content with the same resolution as that of an 8K camera operated in realtime.