The deep convolution network in immersive design of digital media art in smart city

Abstract

Listen

Translate article

The goal of the paper is to examine how convolutional neural network (CNN) is used in the immersive world of digital media art. In order to do this, this paper first explains digital media art in the context of smart cities and the use of immersive scenarios. Next, a brief analysis of the Unet network model and deep aggregation structure is provided. Then, a projector, camera, and computer-based immersive projector-camera display system is constructed. Based on the mathematical reflection model of the system, this paper discusses the method of using CNN to solve the photometric compensation of the projection picture. Meanwhile, a Projection Compensation Network (PCN) is designed, and a multi-scale perceptual loss is added to this compensation network, and the content information of the compensated image is improved by calculating the loss of feature maps of different scales. The final network is named Perceptual Loss-Projection Compensation Network (PL-PCN). Experiments are used to confirm the PL-PCN model’s efficacy. The outcomes demonstrate that the SSIM and PSNR of the projected picture compensated by PL-PCN are boosted by 35.8% and 31.6%, respectively. While the RMSE is reduced by 40.9%, demonstrating an improvement in the compensated image’s quality. Additionally, utilizing a CNN makes it possible to do cross-reflection compensation. Additionally, compared to the network without deep polymerization, the PL-PCN with deep polymerization structure boosts the projected image’s SSIM and PSNR by 6% and 7.57%, respectively, and lowers the RMSE by 13.3% This demonstrates that the addition of deep polymerization structure can have a stronger compensatory effect. This paper can offer a theoretical framework for improving the immersive scene quality of digital media art.