Visual Quality of Compressed Mesh and Point Cloud Sequences

Keming Cao,Pamela Cosman,Yi Xu

doi:10.1109/access.2020.3024633

Keming Cao, Pamela Cosman + Show 1 more

Open Access

https://doi.org/10.1109/access.2020.3024633

Copy DOI

Abstract

With the development of immersive video, the delivery and storage of 3D content have become important research areas. While compression methods for meshes and point clouds, the two main representations for 3D content, are actively studied, there are few studies of their perceptual compression quality and none that consider observation distance. In this paper, we study the perceptual quality of compressed 3D sequences, for both point cloud compression and mesh-based compression. We explore the impact of bit rate and observation distance on perceptual quality. Evaluation of perceptual quality is carried out both by collecting viewer opinion scores of the compressed sequences separately, and with a side-by-side comparison. A functional model for mesh and point cloud compression quality is estimated to predict Mean Opinion Score (MOS) which yields high Pearson correlation and rank correlation scores with measured MOS.

Highlights

Immersive video, as one rapidly growing multimedia form in daily life, is an important future direction of interaction with content and the real world, due to the richer experience it provides compared to traditional 2D media content, including innovative navigation and interactive functionalities [1], [2]
We provide a comparison of point cloud (PC) and mesh compression across many different bit rates and across three different observation distances, in order to explore the effect that both rate and observation distance have on perceived quality
This study provides several new results regarding subjective quality of compressed 3D content as it relates to choice of representation, observation distance, bit rate, and scaling

Summary

Introduction

As one rapidly growing multimedia form in daily life, is an important future direction of interaction with content and the real world, due to the richer experience it provides compared to traditional 2D media content, including innovative navigation and interactive functionalities [1], [2]. The advantages of immersive video lead to multimedia applications in many areas, such as teleconferencing [3], [4], sports [5] and education [6]. The development of depth sensors, such as Kinect from Microsoft and RealSense from Intel, led to an increase in 3D data processing applications. Along with the advantages over traditional 2D video, huge amounts of 3D data lead to storage problems and the need for compression

Objectives

Results

Conclusion