12.2: A 3D Display Parallel System: Light Field Re‐rendering and Depth Sense Optimization

Abstract

The main benefit of 3D display over 2D display is the obvious ability to create a more lifelike character with high depth sense. However, the limitation of human eye's visual mechanism, unartful 3D scene structure design, or bad viewing condition always emerges poor depth perception experience or even physiological discomfort during the watching time, which is often sub‐optimal for mass high‐quality 3D display productions. To solve this problem, we propose a novel 3D display parallel system for depth sense optimization and it empirically guides how the light field should be re‐rendered. Structurally, the parallel system consists of an artificial perception measurement system, a display evaluation model and a light field display rendering system, which includes the display calibration, scene capture, light field data processing and display. Particularly, the system can systematically analyze and model various factors affecting the depth sense which learned through the measurement system, like scene structure, objects’ speeds in 3D video and so on. And those sense factors can be personally modified or increased according to the viewer's demands or technical improvement. Moreover, the light field could be real‐time re‐rendered, based on some image processing technology, optical flow analysis and object segmentation (or tracking) (especially the one‐shot video segmentation). Theory and algorithms are developed and experimental validation results show a superior performance.