Abstract
To visualize omnidirectional (or 360°) visual content, a sphere to plane projection is employed, that maps pixels from the observed sphere region to a 2D image, called as <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">viewport</i> . However, this projection introduces geometrical distortions on the rendered image, such as object shape stretching, or shearing, and bending of straight lines, which may affect the user’s quality of experience (QoE). This paper proposes an object-based quality metric to assess the subjective impact of the objects shape deformation. The metric uses semantic segmentation to identify the relevant objects in the viewport, where the stretching distortion has a higher perceptual impact, and computes the stretching distortion for each object. Two distinct approaches were exploited and evaluated: the first one, directly computes and compares object shape measures on the sphere and on the viewport; the second one is based on Tissot indicatrices, which are computed for individual objects in the viewport. The experimental results show that while the Tissot based method performs slightly better than the direct shape measurement, both approaches outperform benchmark solutions; furthermore, they are able to classify the viewport quality, with respect to quality scores obtained in a subjective crowdsourcing study, with a correct decision percentage close to 90%. Additionally, the Tissot based approach was used in a global quality metric that finds out the Pannini projection parameters that result in the least perceivable geometric distortion. It is shown that the automatically tuned Pannini projection results in viewports with a more pleasant visual quality than the considered benchmark projections.
Highlights
In recent years, the popularity of omnidirectional visual content and applications is increasing rapidly, notably in virtual reality (VR) and augmented reality (AR) fields
Both bending and stretching measures were validated with respect to perceived geometric distortion, by correlating their values with the perceptual scores obtained from a subjective test campaign; while the bending metrics showed to be well correlated with those scores, the stretching measures achieved a low performance
The experimental results show that the proposed metric outperforms the considered benchmark metrics, and is able to assess the viewport quality, with respect to perceptual scores, with a correct decision percentage close to 90%
Summary
The popularity of omnidirectional visual content and applications is increasing rapidly, notably in virtual reality (VR) and augmented reality (AR) fields. A procedure, that integrates one of the new metrics with a line bending measure, is proposed to automatically tune the Pannini projection parameters, d and vc, according to the viewport content In this context, the main contributions of this paper can be summarized as follows:. A procedure to automatically tune the Pannini projection parameters, d and vc, according to the image content, is proposed It integrates one of the new object-based stretching distortion metrics, showing that it can be exploited to minimize, in a perceptual way, the geometric distortions resulting from the rendering process.
Sign-in/Register to view highlights & summary Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
