Computational Integral Imaging Reconstruction Technique Research Articles

3D 깊이우선 집적영상 디스플레이에서의 키넥트 센서를 이용한 컴퓨터적인 요소영상 생성방법

In this paper, we propose a generation of 2D elemental images for 3D objects using Kinect in 3D depth-priority integral imaging (DPII) display. First, we analyze a principle to pickup elemental images based on ray optics. Based on our analysis, elemental images are generated with both RGB image and depth image recorded from Kinect. We reconstruct 3D images from the elemental images with the computational integral imaging reconstruction technique and then compare various perspective images. To show the usefulness of the proposed method, we carried out the preliminary experiments. The experimental results reveal that our method can provide correct 3D images with full parallax.

Modified computational integral imaging-based double image encryption using fractional Fourier transform

In this paper, we propose an image encryption technique to simultaneously encrypt double or multiple images into one encrypted image using computational integral imaging (CII) and fractional Fourier transform (FrFT). In the encryption, each of the input plane images are located at different positions along a pickup plane, and simultaneously recorded in the form of an elemental image array (EIA) through a lenslet array. The recorded EIA to be encrypted is multiplied by FrFT with two different fractional orders. In order to mitigate the drawbacks of occlusion noise in computational integral imaging reconstruction (CIIR), the plane images can be reconstructed using a modified CIIR technique. To further improve the solution of the reconstructed plane images, a block matching algorithm is also introduced. Numerical simulation results verify the feasibility and effectiveness of the proposed method.

Blur-metric-based resolution enhancement of computationally reconstructed integral images

A computational integral imaging reconstruction technique can reconstruct a set of plane images of three-dimensional (3-D) objects along the output plane, in which only the plane object image (POI) reconstructed on the right planes where the objects were positioned is highly focused, whereas the other POIs reconstructed away from these planes are unfocused and blurred. In fact, these blurred POIs act as additional noises to other object images reconstructed on different output planes, so that the resolution of reconstructed object images should be considerably deteriorated. In this paper, a novel approach is proposed to effectively reduce the blurred images occurring in the focused POIs by employing a blur metric. From the estimated blur metric of each reconstructed POI, the right output planes where the objects were located can be detected. In addition, with an estimated blur metric, focused POIs can be adaptively eroded by a simple gray level erosion operation because it reduces regional expansion caused by the blur effect. The gray values of the eroded POIs are then finally remapped by referencing the original POIs. Some experiments revealed an average increase of 1.95 dB in the peak signal-to-noise ratio in the remapped POIs compared with that of the originally reconstructed POIs, and that the original forms of the object images in the remapped POIs could be preserved even after they had gone through an erosion operation. This feasibility test of the proposed scheme finally suggests a possibility of its application to robust detection and recognition of 3-D objects in a scene.

Depth extraction of three-dimensional objects in space by the computational integral imaging reconstruction technique

A novel approach to extract the depth data of 3D objects in space by using the computational integral imaging reconstruction (CIIR) technique is proposed. With elemental images of 3D objects captured by the CCD camera through a pinhole array, depth-dependent object images can be reconstructed on the output plane by the CIIR technique. Only the images reconstructed on the output planes where 3D objects were located are clearly focused; so the depth data of 3D objects in space can be extracted by discriminating these focused output images from the others by using an image separation technique. A feasibility test of the proposed CIIR-based depth extraction method is carried out, and its results are discussed as well.

Curved computational integral imaging reconstruction technique for resolution-enhanced display of three-dimensional object images

A novel curved computational integral imaging reconstruction (C-CIIR) technique for the virtually curved integral imaging (VCII) system is proposed, and its performances are analyzed. In the C-CIIR model, an additional virtual large-aperture lens is included to provide a multidirectional curving effect in the reconstruction process, and its effect is analyzed in detail by using the ABCD matrix. With this method, resolution-enhanced 3D object images can be computationally reconstructed from the picked-up elemental images of the VCII system. To confirm the feasibility of the proposed model, some experiments are carried out. Experiments revealed that the sampling rate in the VCII system could be kept at a maximum value within some range of the distance z, whereas in the conventional integral imaging system it linearly decreased as the distance z increased. It is also shown that resolutions of the object images reconstructed by the C-CIIR method have been significantly improved compared with those of the conventional CIIR method.

Resolution-enhanced 3D image correlator using computationally reconstructed integral images

In this paper, a novel resolution-enhanced three-dimensional (3D) image correlator using the computationally reconstructed integral images is proposed in order to extract target object’s 3D location data in a scene. Elemental images of the reference and target objects are picked up by lenslet arrays and using these elemental images, reference and target plane images are reconstructed on the output plane by means of a modified computational integral imaging reconstruction technique. Then, through cross-correlations between the reconstructed reference and the target plane images, 3D location data of the target object can be extracted from the correlation outputs. With the purpose of showing the feasibility of the proposed method, some computational and optical experiments on the target objects in space are carried out and the results are presented.

Improved Viewing Quality of 3-D Images in Computational Integral Imaging Reconstruction Based on Lenslet Array Model

In this letter, we propose a novel computational integral imaging reconstruction technique based on a lenslet array model. The proposed technique provides improvement of viewing images by extracting multiple pixels from elemental images according to ray tracing based on the lenslet array model. To show the feasibility of the proposed technique, we analyze it according to ray optics and present the experimental results.