P‐100: Consistent Low‐Light Image Restoration for Under‐Display Camera

Abstract

Under‐display camera (UDC) allows viewers to interact with the camera and watch the display at the same time. This paper introduces the UDC for Mini‐LED/Micro‐LED displays embedding the camera by drilling a pinhole between LED dies. Based on such an application, the main issues of UDC images are low‐light and noise. We propose a CNN‐based image restoration approach to enhance brightness and remove noise. Moreover, the input of the proposed neural network uses three consecutive frames to reduce the temporal flickering of videos. The processing speed on GPU can reach 1080p@30fps, which is feasible for real‐time streaming applications.