A reliable and unobtrusive approach to display area detection for imperceptible display camera communication

Abstract

Object framework detection has been extensively studied in computer vision for applications such as document digitization and whiteboard scanning. Similarly, it is essential for display-camera communication systems, particularly when imperceptible data modulation is employed to enable simultaneous video playback and data transmission. Reliable and accurate localization of the encoded display area is critical for data demodulation and decoding. However, existing systems typically adapt established methods developed for other applications that do not meet the system requirements for high-rate data transmission.In this article, we propose a novel method for display area detection in the camera images by embedding a new localization marker into the display corners. While the localization marker is less obtrusive than conventional fiducial markers, our detection algorithm demonstrated excellent reliability regardless of the display content and background, according to simulation and experimental results. In addition, the detector achieved subpixel accuracy and real-time performance with modern smartphones.