Real-time volume data three-dimensional display with a modified single-pass multiview rendering method

Abstract

A modified single-pass multiview rendering method is proposed to achieve real-time large viewing angle volume data three-dimensional (3-D) display. By modifying the volume rendering pipeline, the mapping of the synthetic image pixel and multiperspective information is directly accomplished in once rendering pass. And then shear-transformed ray is cast to integrate multiperspective information into the synthetic image used for 3-D display. Proof-of-concept experimental setups are constructed with the autostereoscopic 3-D display and the 3-D light-field display to demonstrate the proposed method without loss of generality. The experimental results show that the real-time frame rates of the autostereoscopic 3-D display and the 3-D light-field display are more than 30 and 60 fps at 4K (3840 × 2160) resolution, respectively. The rendering efficiency of the proposed method is irrespective of the viewpoint number and viewing angle size. In addition, it is not only compatible with the volume drawing pipeline but also robust to different types of 3-D displays based on pixel coding. A feasible way of applying 3-D display to the biological and medical fields is presented.