Intelligent Splicing Method of Virtual Reality Lingnan Cultural Heritage Panorama Based on Automatic Machine Learning

Abstract

Listen

Translate article

With the increasing expansion of virtual reality application fields and the complexity of application content, the demand for real-time rendering of realistic graphics has increased sharply. This research mainly discusses the intelligent mosaic method of virtual reality Lingnan cultural heritage panorama based on automatic machine learning. In order to effectively make up for the impact of the insufficiency of the collection process on the quality of the final panoramic image of Lingnan cultural heritage, it is necessary to minimize the irregular rotation of the camera and collect images according to the overlapping area between adjacent images of appropriate size. In order to make Lingnan cultural heritage panoramic images have better visual effects, it is necessary to preprocess the images before image registration and fusion. Image preprocessing mainly includes image denoising and image projection transformation. In this study, cylindrical projection is used to construct the panorama of Lingnan cultural heritage. For each Lingnan cultural heritage training image, we first perform image segmentation to obtain multiple regions and extract the visual features of each region. We use automatic machine learning models to train the visual feature set and use the bagging method to generate different training subsets. In order to generate each component classifier, we determine the overlap area of the two images according to the matched SIFT feature points and determine the best stitching line during the implementation of stitching. In this paper, the number of pixels in the first row of the overlapping area is used to determine the candidate stitching line column, and the best stitching line position should be determined in consideration of the smallest color difference in the stitching area and the most similar texture on both sides. This article uses a Java Applet-based approach to realize virtual roaming of viewing panoramic images of Lingnan cultural heritage in IE browser. The highest accuracy of SIFT is 82.22%, and the lowest recognition time is 0.01 s. This research will promote the development of Lingnan cultural heritage.